[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:56:42.920051   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34301
I20260709 12:56:42.925891   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:56:42.927165   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:42.946801   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:42.946813   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:42.948284   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:42.949643   431 server_base.cc:1061] running on GCE node
I20260709 12:56:44.210457   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:44.210757   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:44.211033   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601804211002 us; error 0 us; skew 500 ppm
I20260709 12:56:44.212044   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:44.219563   431 webserver.cc:533] Webserver started at http://127.0.107.254:35073/ using document root <none> and password file <none>
I20260709 12:56:44.220920   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:44.221299   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:44.221899   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:44.228662   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/master-0-root/instance:
uuid: "0fe845d6c8944e78b323fe6f95dd5844"
format_stamp: "Formatted at 2026-07-09 12:56:44 on dist-test-slave-qv7r"
I20260709 12:56:44.238382   431 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:56:44.244835   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:44.246377   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 12:56:44.246827   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/master-0-root
uuid: "0fe845d6c8944e78b323fe6f95dd5844"
format_stamp: "Formatted at 2026-07-09 12:56:44 on dist-test-slave-qv7r"
I20260709 12:56:44.247218   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:44.318439   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:44.320176   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:56:44.320681   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:44.408061   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34301
I20260709 12:56:44.408121   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34301 every 8 connection(s)
I20260709 12:56:44.416659   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:44.442657   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844: Bootstrap starting.
I20260709 12:56:44.449177   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:44.451295   498 log.cc:826] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844: Log is configured to *not* fsync() on all Append() calls
I20260709 12:56:44.456825   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844: No bootstrap required, opened a new log
I20260709 12:56:44.480412   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe845d6c8944e78b323fe6f95dd5844" member_type: VOTER }
I20260709 12:56:44.481005   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:44.481323   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe845d6c8944e78b323fe6f95dd5844, State: Initialized, Role: FOLLOWER
I20260709 12:56:44.482476   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe845d6c8944e78b323fe6f95dd5844" member_type: VOTER }
I20260709 12:56:44.483024   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:56:44.483348   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:56:44.483721   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.489014   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe845d6c8944e78b323fe6f95dd5844" member_type: VOTER }
I20260709 12:56:44.490322   498 leader_election.cc:304] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fe845d6c8944e78b323fe6f95dd5844; no voters: 
I20260709 12:56:44.492826   498 leader_election.cc:290] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:56:44.493219   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:44.496881   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe845d6c8944e78b323fe6f95dd5844, State: Running, Role: LEADER
I20260709 12:56:44.498116   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe845d6c8944e78b323fe6f95dd5844" member_type: VOTER }
I20260709 12:56:44.499300   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:56:44.511386   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fe845d6c8944e78b323fe6f95dd5844. Latest consensus state: current_term: 1 leader_uuid: "0fe845d6c8944e78b323fe6f95dd5844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe845d6c8944e78b323fe6f95dd5844" member_type: VOTER } }
I20260709 12:56:44.512682   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:44.513134   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fe845d6c8944e78b323fe6f95dd5844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe845d6c8944e78b323fe6f95dd5844" member_type: VOTER } }
I20260709 12:56:44.514094   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:44.521409   510 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:56:44.535096   510 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:56:44.538450   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:56:44.555898   510 catalog_manager.cc:1383] Generated new cluster ID: 2ca2b2fc8f61469a9e56996c4ca4bf06
I20260709 12:56:44.556223   510 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:56:44.610072   510 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:56:44.612254   510 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:56:44.636314   510 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844: Generated new TSK 0
I20260709 12:56:44.637347   510 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:56:44.670444   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:44.682181   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:44.683828   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:44.689293   431 server_base.cc:1061] running on GCE node
W20260709 12:56:44.689396   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:44.690743   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:44.691048   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:44.691259   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601804691243 us; error 0 us; skew 500 ppm
I20260709 12:56:44.691910   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:44.697144   431 webserver.cc:533] Webserver started at http://127.0.107.193:39691/ using document root <none> and password file <none>
I20260709 12:56:44.698005   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:44.698305   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:44.698671   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:44.700090   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-0-root/instance:
uuid: "78bfb847470a430dbd76c6274d8fe34b"
format_stamp: "Formatted at 2026-07-09 12:56:44 on dist-test-slave-qv7r"
I20260709 12:56:44.707381   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:56:44.712248   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:44.713209   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:56:44.713609   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "78bfb847470a430dbd76c6274d8fe34b"
format_stamp: "Formatted at 2026-07-09 12:56:44 on dist-test-slave-qv7r"
I20260709 12:56:44.713987   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:44.744349   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:44.746404   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:44.749853   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:44.756171   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:44.756551   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:44.756958   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:44.757193   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:44.864197   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38329
I20260709 12:56:44.864266   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38329 every 8 connection(s)
I20260709 12:56:44.873499   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:44.888722   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:44.896770   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:44.904470   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:44.905431   431 server_base.cc:1061] running on GCE node
I20260709 12:56:44.906473   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:44.906944   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:44.907184   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601804907167 us; error 0 us; skew 500 ppm
I20260709 12:56:44.907946   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:44.909376   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34301
I20260709 12:56:44.909830   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:44.910939   591 heartbeater.cc:507] Master 127.0.107.254:34301 requested a full tablet report, sending...
I20260709 12:56:44.914563   463 ts_manager.cc:194] Registered new tserver with Master: 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329)
I20260709 12:56:44.914676   431 webserver.cc:533] Webserver started at http://127.0.107.194:35293/ using document root <none> and password file <none>
I20260709 12:56:44.915467   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:44.915732   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:44.916060   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:44.917119   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46858
I20260709 12:56:44.917583   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-1-root/instance:
uuid: "a0eb8adea9854f229bac55c51c68cf16"
format_stamp: "Formatted at 2026-07-09 12:56:44 on dist-test-slave-qv7r"
I20260709 12:56:44.924917   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:56:44.930527   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:44.931558   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:56:44.931910   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-1-root
uuid: "a0eb8adea9854f229bac55c51c68cf16"
format_stamp: "Formatted at 2026-07-09 12:56:44 on dist-test-slave-qv7r"
I20260709 12:56:44.932282   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:44.979809   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:44.981523   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:44.983371   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:44.987210   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:44.987483   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:44.987763   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:44.987974   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:45.090378   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33119
I20260709 12:56:45.090489   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33119 every 8 connection(s)
I20260709 12:56:45.098567   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:45.113639   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:45.114746   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:45.120244   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34301
I20260709 12:56:45.120741   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:45.121676   666 heartbeater.cc:507] Master 127.0.107.254:34301 requested a full tablet report, sending...
I20260709 12:56:45.125108   463 ts_manager.cc:194] Registered new tserver with Master: a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:45.127722   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46872
I20260709 12:56:45.128857   431 server_base.cc:1061] running on GCE node
W20260709 12:56:45.131309   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:45.132604   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:45.132897   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:45.133136   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601805133116 us; error 0 us; skew 500 ppm
I20260709 12:56:45.133981   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:45.137247   431 webserver.cc:533] Webserver started at http://127.0.107.195:34299/ using document root <none> and password file <none>
I20260709 12:56:45.137884   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:45.138119   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:45.138391   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:45.139446   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-2-root/instance:
uuid: "73861428f3944b419b44bfb808192574"
format_stamp: "Formatted at 2026-07-09 12:56:45 on dist-test-slave-qv7r"
I20260709 12:56:45.144363   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:56:45.148285   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:45.149313   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:56:45.149793   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-2-root
uuid: "73861428f3944b419b44bfb808192574"
format_stamp: "Formatted at 2026-07-09 12:56:45 on dist-test-slave-qv7r"
I20260709 12:56:45.150153   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601802742860-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:45.173069   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:45.174527   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:45.176733   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:45.180145   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:45.180410   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:45.180686   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:45.180886   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:45.290658   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35789
I20260709 12:56:45.290752   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35789 every 8 connection(s)
I20260709 12:56:45.309856   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34301
I20260709 12:56:45.310377   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:45.311250   740 heartbeater.cc:507] Master 127.0.107.254:34301 requested a full tablet report, sending...
I20260709 12:56:45.313604   463 ts_manager.cc:194] Registered new tserver with Master: 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:45.314167   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018225301s
I20260709 12:56:45.316084   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46882
I20260709 12:56:45.374059   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46898:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:56:45.378177   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:56:45.513803   704 tablet_service.cc:1511] Processing CreateTablet for tablet 47ed6d22d2464020b9454102ad082f1b (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:45.512249   705 tablet_service.cc:1511] Processing CreateTablet for tablet 69dc00d3511e410a958190d4a489bba7 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:45.517784   703 tablet_service.cc:1511] Processing CreateTablet for tablet 28d8cbb82392471882fe2a7398b1e75c (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:45.521781   702 tablet_service.cc:1511] Processing CreateTablet for tablet 2f127270ca4b4533a66d9c959924a287 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:45.525934   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ed6d22d2464020b9454102ad082f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.521884   701 tablet_service.cc:1511] Processing CreateTablet for tablet a06778b4dce04870ac4da4fbd684e573 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 12:56:45.529772   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:45.535202   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d8cbb82392471882fe2a7398b1e75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.536927   553 tablet_service.cc:1511] Processing CreateTablet for tablet 2f127270ca4b4533a66d9c959924a287 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:45.541469   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06778b4dce04870ac4da4fbd684e573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.541355   552 tablet_service.cc:1511] Processing CreateTablet for tablet a06778b4dce04870ac4da4fbd684e573 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:56:45.532660   555 tablet_service.cc:1511] Processing CreateTablet for tablet 47ed6d22d2464020b9454102ad082f1b (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:45.540468   554 tablet_service.cc:1511] Processing CreateTablet for tablet 28d8cbb82392471882fe2a7398b1e75c (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:45.544739   556 tablet_service.cc:1511] Processing CreateTablet for tablet 69dc00d3511e410a958190d4a489bba7 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:45.545913   551 tablet_service.cc:1511] Processing CreateTablet for tablet eef229be9ced4c81a421d5d5bc753fa7 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:45.548086   700 tablet_service.cc:1511] Processing CreateTablet for tablet eef229be9ced4c81a421d5d5bc753fa7 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:45.550818   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06778b4dce04870ac4da4fbd684e573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.551893   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69dc00d3511e410a958190d4a489bba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.552145   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69dc00d3511e410a958190d4a489bba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.554358   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef229be9ced4c81a421d5d5bc753fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.555696   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef229be9ced4c81a421d5d5bc753fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.560923   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d8cbb82392471882fe2a7398b1e75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.564667   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f127270ca4b4533a66d9c959924a287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.564477   630 tablet_service.cc:1511] Processing CreateTablet for tablet 47ed6d22d2464020b9454102ad082f1b (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:45.568602   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ed6d22d2464020b9454102ad082f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.573274   550 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd580d8b609425490ea243c21e9580b (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:45.573418   631 tablet_service.cc:1511] Processing CreateTablet for tablet 69dc00d3511e410a958190d4a489bba7 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:45.579020   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69dc00d3511e410a958190d4a489bba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.572220   629 tablet_service.cc:1511] Processing CreateTablet for tablet 28d8cbb82392471882fe2a7398b1e75c (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:45.581710   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f127270ca4b4533a66d9c959924a287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.596333   626 tablet_service.cc:1511] Processing CreateTablet for tablet eef229be9ced4c81a421d5d5bc753fa7 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:45.600118   627 tablet_service.cc:1511] Processing CreateTablet for tablet a06778b4dce04870ac4da4fbd684e573 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:56:45.601887   628 tablet_service.cc:1511] Processing CreateTablet for tablet 2f127270ca4b4533a66d9c959924a287 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:45.598613   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ed6d22d2464020b9454102ad082f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.606483   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f127270ca4b4533a66d9c959924a287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.607347   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd580d8b609425490ea243c21e9580b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.611200   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d8cbb82392471882fe2a7398b1e75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.613623   699 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd580d8b609425490ea243c21e9580b (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:45.617612   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06778b4dce04870ac4da4fbd684e573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.623060   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd580d8b609425490ea243c21e9580b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.625385   625 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd580d8b609425490ea243c21e9580b (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:45.633898   549 tablet_service.cc:1511] Processing CreateTablet for tablet bfe76d0e313f4a0aab09abc123d170f3 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:45.635972   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe76d0e313f4a0aab09abc123d170f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.630470   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef229be9ced4c81a421d5d5bc753fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.641201   624 tablet_service.cc:1511] Processing CreateTablet for tablet bfe76d0e313f4a0aab09abc123d170f3 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:45.644996   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd580d8b609425490ea243c21e9580b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.655097   698 tablet_service.cc:1511] Processing CreateTablet for tablet bfe76d0e313f4a0aab09abc123d170f3 (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:45.663291   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe76d0e313f4a0aab09abc123d170f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.664211   548 tablet_service.cc:1511] Processing CreateTablet for tablet 6444d9ff5e4d4fd4bdc1b93e36ee7cde (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:45.668421   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe76d0e313f4a0aab09abc123d170f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.680540   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6444d9ff5e4d4fd4bdc1b93e36ee7cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.704068   697 tablet_service.cc:1511] Processing CreateTablet for tablet 6444d9ff5e4d4fd4bdc1b93e36ee7cde (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:45.707921   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6444d9ff5e4d4fd4bdc1b93e36ee7cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.693192   623 tablet_service.cc:1511] Processing CreateTablet for tablet 6444d9ff5e4d4fd4bdc1b93e36ee7cde (DEFAULT_TABLE table=test-workload [id=61143120253d44388229b697c4e9b657]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:45.711647   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6444d9ff5e4d4fd4bdc1b93e36ee7cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:45.834203   758 tablet_bootstrap.cc:492] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:45.865886   759 tablet_bootstrap.cc:492] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574: Bootstrap starting.
I20260709 12:56:45.875497   759 tablet_bootstrap.cc:654] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:45.908443   760 tablet_bootstrap.cc:492] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:45.920374   591 heartbeater.cc:499] Master 127.0.107.254:34301 was elected leader, sending a full tablet report...
I20260709 12:56:45.928930   758 tablet_bootstrap.cc:654] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:45.932209   759 tablet_bootstrap.cc:492] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:45.932864   759 ts_tablet_manager.cc:1403] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.068s	user 0.003s	sys 0.023s
I20260709 12:56:45.935494   760 tablet_bootstrap.cc:654] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:45.941468   759 raft_consensus.cc:359] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:45.942411   759 raft_consensus.cc:385] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:45.942780   759 raft_consensus.cc:740] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:45.943681   759 consensus_queue.cc:260] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:45.950852   758 tablet_bootstrap.cc:492] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:45.951395   758 ts_tablet_manager.cc:1403] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.154s	user 0.009s	sys 0.014s
I20260709 12:56:45.953366   740 heartbeater.cc:499] Master 127.0.107.254:34301 was elected leader, sending a full tablet report...
I20260709 12:56:45.953672   759 ts_tablet_manager.cc:1434] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:56:45.954785   759 tablet_bootstrap.cc:492] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574: Bootstrap starting.
I20260709 12:56:45.958037   763 raft_consensus.cc:493] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:45.958513   763 raft_consensus.cc:515] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:45.967278   758 raft_consensus.cc:359] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:45.968369   758 raft_consensus.cc:385] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:45.968676   758 raft_consensus.cc:740] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:45.969381   758 consensus_queue.cc:260] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:45.971350   760 tablet_bootstrap.cc:492] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:45.971966   760 ts_tablet_manager.cc:1403] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.004s
I20260709 12:56:45.975070   759 tablet_bootstrap.cc:654] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:45.975230   763 leader_election.cc:290] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:45.974969   760 raft_consensus.cc:359] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:45.982437   760 raft_consensus.cc:385] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:45.982903   760 raft_consensus.cc:740] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:45.984033   760 consensus_queue.cc:260] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.004616   758 ts_tablet_manager.cc:1434] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.013s
I20260709 12:56:46.013267   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
W20260709 12:56:46.015528   680 leader_election.cc:343] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.018170   758 tablet_bootstrap.cc:492] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:46.022836   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16" is_pre_election: true
W20260709 12:56:46.024674   681 leader_election.cc:343] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.025147   681 leader_election.cc:304] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73861428f3944b419b44bfb808192574; no voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:46.026281   763 raft_consensus.cc:2749] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:46.029657   666 heartbeater.cc:499] Master 127.0.107.254:34301 was elected leader, sending a full tablet report...
I20260709 12:56:46.029949   759 tablet_bootstrap.cc:492] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:46.030493   759 ts_tablet_manager.cc:1403] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.037s
I20260709 12:56:46.031848   758 tablet_bootstrap.cc:654] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.032081   760 ts_tablet_manager.cc:1434] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.041s
I20260709 12:56:46.033063   760 tablet_bootstrap.cc:492] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:46.033516   759 raft_consensus.cc:359] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.034287   759 raft_consensus.cc:385] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.034575   759 raft_consensus.cc:740] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.035326   759 consensus_queue.cc:260] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.037869   759 ts_tablet_manager.cc:1434] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:56:46.039258   759 tablet_bootstrap.cc:492] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574: Bootstrap starting.
I20260709 12:56:46.041105   760 tablet_bootstrap.cc:654] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:46.047164   741 tablet.cc:2406] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:56:46.048102   759 tablet_bootstrap.cc:654] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.053970   760 tablet_bootstrap.cc:492] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:46.054633   760 ts_tablet_manager.cc:1403] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:56:46.060453   758 tablet_bootstrap.cc:492] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:46.061115   758 ts_tablet_manager.cc:1403] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.009s
I20260709 12:56:46.065217   758 raft_consensus.cc:359] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.066291   758 raft_consensus.cc:385] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.066711   758 raft_consensus.cc:740] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.066566   760 raft_consensus.cc:359] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.067473   760 raft_consensus.cc:385] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.067850   760 raft_consensus.cc:740] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.067754   758 consensus_queue.cc:260] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.069283   760 consensus_queue.cc:260] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.071499   758 ts_tablet_manager.cc:1434] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 12:56:46.072983   758 tablet_bootstrap.cc:492] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:46.074357   760 ts_tablet_manager.cc:1434] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:56:46.075382   760 tablet_bootstrap.cc:492] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:46.082731   758 tablet_bootstrap.cc:654] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.091184   759 tablet_bootstrap.cc:492] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:46.091722   759 ts_tablet_manager.cc:1403] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.053s	user 0.030s	sys 0.016s
I20260709 12:56:46.093648   760 tablet_bootstrap.cc:654] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.094429   758 tablet_bootstrap.cc:492] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:46.094946   758 ts_tablet_manager.cc:1403] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.001s
I20260709 12:56:46.094700   759 raft_consensus.cc:359] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.095501   759 raft_consensus.cc:385] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.095818   759 raft_consensus.cc:740] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.097111   759 consensus_queue.cc:260] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.100416   759 ts_tablet_manager.cc:1434] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:56:46.101748   759 tablet_bootstrap.cc:492] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574: Bootstrap starting.
I20260709 12:56:46.112020   759 tablet_bootstrap.cc:654] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.112792   758 raft_consensus.cc:359] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.113924   758 raft_consensus.cc:385] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.114905   758 raft_consensus.cc:740] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.115890   758 consensus_queue.cc:260] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.118628   760 tablet_bootstrap.cc:492] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:46.118741   758 ts_tablet_manager.cc:1434] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:56:46.119325   760 ts_tablet_manager.cc:1403] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.020s
I20260709 12:56:46.121814   758 tablet_bootstrap.cc:492] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:46.127723   760 raft_consensus.cc:359] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.128935   760 raft_consensus.cc:385] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.129410   760 raft_consensus.cc:740] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.131502   760 consensus_queue.cc:260] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.132483   759 tablet_bootstrap.cc:492] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:46.132962   759 ts_tablet_manager.cc:1403] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.010s
I20260709 12:56:46.134300   760 ts_tablet_manager.cc:1434] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:56:46.135414   760 tablet_bootstrap.cc:492] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:46.135861   759 raft_consensus.cc:359] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:46.136598   759 raft_consensus.cc:385] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.136896   759 raft_consensus.cc:740] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.137665   759 consensus_queue.cc:260] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:46.146596   759 ts_tablet_manager.cc:1434] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:56:46.147439   760 tablet_bootstrap.cc:654] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.148306   758 tablet_bootstrap.cc:654] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.150399   759 tablet_bootstrap.cc:492] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574: Bootstrap starting.
I20260709 12:56:46.160511   759 tablet_bootstrap.cc:654] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.163561   760 tablet_bootstrap.cc:492] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:46.164335   760 ts_tablet_manager.cc:1403] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.010s
I20260709 12:56:46.167912   760 raft_consensus.cc:359] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.168742   760 raft_consensus.cc:385] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.169003   759 tablet_bootstrap.cc:492] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:46.169003   758 tablet_bootstrap.cc:492] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:46.169104   760 raft_consensus.cc:740] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.169715   759 ts_tablet_manager.cc:1403] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.012s
I20260709 12:56:46.169807   758 ts_tablet_manager.cc:1403] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.002s
I20260709 12:56:46.170289   760 consensus_queue.cc:260] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.172598   760 ts_tablet_manager.cc:1434] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 12:56:46.172863   759 raft_consensus.cc:359] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.173552   760 tablet_bootstrap.cc:492] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:46.173643   759 raft_consensus.cc:385] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.174531   759 raft_consensus.cc:740] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.175261   759 consensus_queue.cc:260] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.177891   759 ts_tablet_manager.cc:1434] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:56:46.178885   759 tablet_bootstrap.cc:492] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574: Bootstrap starting.
I20260709 12:56:46.181083   760 tablet_bootstrap.cc:654] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.187295   758 raft_consensus.cc:359] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.188066   758 raft_consensus.cc:385] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.188395   758 raft_consensus.cc:740] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.190039   769 raft_consensus.cc:493] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.190007   758 consensus_queue.cc:260] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.190598   769 raft_consensus.cc:515] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.192481   758 ts_tablet_manager.cc:1434] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.004s
I20260709 12:56:46.192940   763 raft_consensus.cc:493] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.193480   769 leader_election.cc:290] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.198876   758 tablet_bootstrap.cc:492] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:46.214573   760 tablet_bootstrap.cc:492] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:46.200498   759 tablet_bootstrap.cc:654] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.193414   763 raft_consensus.cc:515] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.217346   760 ts_tablet_manager.cc:1403] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.004s
I20260709 12:56:46.219201   780 raft_consensus.cc:493] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.220758   763 leader_election.cc:290] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:46.222685   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
W20260709 12:56:46.224947   680 leader_election.cc:343] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.226812   780 raft_consensus.cc:515] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.229148   758 tablet_bootstrap.cc:654] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.236111   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
I20260709 12:56:46.236111   760 raft_consensus.cc:359] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.237416   566 raft_consensus.cc:2468] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 0.
I20260709 12:56:46.237895   760 raft_consensus.cc:385] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.238472   760 raft_consensus.cc:740] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.234238   780 leader_election.cc:290] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:46.242199   760 consensus_queue.cc:260] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.239369   680 leader_election.cc:304] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:46.258208   767 raft_consensus.cc:493] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.258914   767 raft_consensus.cc:515] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.247185   780 raft_consensus.cc:2804] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.261219   780 raft_consensus.cc:493] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.261596   780 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.263804   760 ts_tablet_manager.cc:1434] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:56:46.264881   760 tablet_bootstrap.cc:492] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:46.270889   767 leader_election.cc:290] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.276943   760 tablet_bootstrap.cc:654] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.282420   780 raft_consensus.cc:515] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.287523   759 tablet_bootstrap.cc:492] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:46.291549   759 ts_tablet_manager.cc:1403] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.113s	user 0.022s	sys 0.040s
I20260709 12:56:46.295809   759 raft_consensus.cc:359] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.291121   780 leader_election.cc:290] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:46.296799   759 raft_consensus.cc:385] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.297621   759 raft_consensus.cc:740] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.299914   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:46.301226   566 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.298419   759 consensus_queue.cc:260] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.316139   759 ts_tablet_manager.cc:1434] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.005s
I20260709 12:56:46.317270   759 tablet_bootstrap.cc:492] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574: Bootstrap starting.
I20260709 12:56:46.328003   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f127270ca4b4533a66d9c959924a287" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
I20260709 12:56:46.330354   715 raft_consensus.cc:2468] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 0.
I20260709 12:56:46.332038   760 tablet_bootstrap.cc:492] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:46.332511   760 ts_tablet_manager.cc:1403] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.006s
I20260709 12:56:46.335557   758 tablet_bootstrap.cc:492] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:46.335495   531 leader_election.cc:304] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:46.336630   767 raft_consensus.cc:2804] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.334509   759 tablet_bootstrap.cc:654] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.337534   767 raft_consensus.cc:493] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.336834   760 raft_consensus.cc:359] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.337997   767 raft_consensus.cc:3060] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.338265   760 raft_consensus.cc:385] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.330543   566 raft_consensus.cc:2468] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 1.
I20260709 12:56:46.336408   758 ts_tablet_manager.cc:1403] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.026s
I20260709 12:56:46.341415   680 leader_election.cc:304] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:46.341492   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16" is_pre_election: true
I20260709 12:56:46.342378   641 raft_consensus.cc:2468] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 0.
I20260709 12:56:46.339221   760 raft_consensus.cc:740] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.343549   780 raft_consensus.cc:2804] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.342905   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f127270ca4b4533a66d9c959924a287" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16" is_pre_election: true
I20260709 12:56:46.344276   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16" is_pre_election: true
I20260709 12:56:46.344676   780 raft_consensus.cc:697] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Becoming Leader. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:46.345316   640 raft_consensus.cc:2468] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 0.
I20260709 12:56:46.344431   760 consensus_queue.cc:260] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.346318   780 consensus_queue.cc:237] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.347921   760 ts_tablet_manager.cc:1434] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:56:46.348855   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:46.350291   681 leader_election.cc:304] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:46.351256   763 raft_consensus.cc:2804] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.351599   763 raft_consensus.cc:493] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.351909   763 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:46.352155   681 leader_election.cc:343] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.352969   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd580d8b609425490ea243c21e9580b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
W20260709 12:56:46.353515   681 leader_election.cc:343] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.353940   715 raft_consensus.cc:2468] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 0.
I20260709 12:56:46.362931   606 leader_election.cc:304] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:46.361826   767 raft_consensus.cc:515] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.365767   767 leader_election.cc:290] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 election: Requested vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.366405   769 raft_consensus.cc:2804] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.366787   769 raft_consensus.cc:493] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.366812   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f127270ca4b4533a66d9c959924a287" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:46.367195   769 raft_consensus.cc:3060] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.366812   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f127270ca4b4533a66d9c959924a287" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:46.367945   640 raft_consensus.cc:3060] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.368150   715 raft_consensus.cc:3060] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.362025   760 tablet_bootstrap.cc:492] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:46.355582   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd580d8b609425490ea243c21e9580b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
I20260709 12:56:46.374979   462 catalog_manager.cc:5697] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73861428f3944b419b44bfb808192574 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "73861428f3944b419b44bfb808192574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:46.374509   566 raft_consensus.cc:2468] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 0.
I20260709 12:56:46.387313   769 raft_consensus.cc:515] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.382781   763 raft_consensus.cc:515] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.395052   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd580d8b609425490ea243c21e9580b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:46.395942   565 raft_consensus.cc:3060] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.405135   767 raft_consensus.cc:493] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.405194   769 leader_election.cc:290] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.403038   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:46.405788   767 raft_consensus.cc:515] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:46.410458   769 raft_consensus.cc:493] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.413226   769 raft_consensus.cc:515] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.414304   767 leader_election.cc:290] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73861428f3944b419b44bfb808192574 (127.0.107.195:35789), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
W20260709 12:56:46.414867   680 leader_election.cc:343] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.411134   763 leader_election.cc:290] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:46.417006   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
I20260709 12:56:46.418668   714 raft_consensus.cc:2468] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 0.
I20260709 12:56:46.419817   759 tablet_bootstrap.cc:492] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:46.420043   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16" is_pre_election: true
I20260709 12:56:46.421481   531 leader_election.cc:304] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:46.423854   767 raft_consensus.cc:2804] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:56:46.423931   532 leader_election.cc:343] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.424304   767 raft_consensus.cc:493] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.424686   767 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.425634   640 raft_consensus.cc:2468] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 1.
I20260709 12:56:46.426936   532 leader_election.cc:304] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:46.412001   758 raft_consensus.cc:359] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.427168   759 ts_tablet_manager.cc:1403] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.018s
I20260709 12:56:46.430914   758 raft_consensus.cc:385] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.430665   715 raft_consensus.cc:2468] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 1.
I20260709 12:56:46.425652   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd580d8b609425490ea243c21e9580b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:46.437966   714 raft_consensus.cc:3060] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.440671   769 leader_election.cc:290] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.435518   758 raft_consensus.cc:740] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.443714   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:46.444377   640 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.447985   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
I20260709 12:56:46.449833   767 raft_consensus.cc:515] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:46.448213   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
I20260709 12:56:46.452425   565 raft_consensus.cc:2468] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 1.
I20260709 12:56:46.454195   794 raft_consensus.cc:2804] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:56:46.457309   606 leader_election.cc:343] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.457021   794 raft_consensus.cc:697] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Becoming Leader. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:46.459863   606 leader_election.cc:304] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:46.461321   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:46.460513   767 leader_election.cc:290] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 election: Requested vote from peers 73861428f3944b419b44bfb808192574 (127.0.107.195:35789), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:46.453107   758 consensus_queue.cc:260] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.462231   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:46.465417   759 raft_consensus.cc:359] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.470256   759 raft_consensus.cc:385] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.470691   759 raft_consensus.cc:740] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.465942   714 raft_consensus.cc:2468] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 1.
I20260709 12:56:46.471537   715 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:46.471325   532 leader_election.cc:343] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.464340   640 raft_consensus.cc:2468] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 1.
I20260709 12:56:46.472792   769 raft_consensus.cc:2804] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.473881   759 consensus_queue.cc:260] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.474362   769 raft_consensus.cc:697] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:46.475675   769 consensus_queue.cc:237] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.464618   794 consensus_queue.cc:237] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.464125   760 tablet_bootstrap.cc:654] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.478863   681 leader_election.cc:304] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:46.480504   763 raft_consensus.cc:2804] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.481066   763 raft_consensus.cc:697] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Becoming Leader. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:46.476181   759 ts_tablet_manager.cc:1434] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
I20260709 12:56:46.471346   758 ts_tablet_manager.cc:1434] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.129s	user 0.010s	sys 0.003s
I20260709 12:56:46.482340   763 consensus_queue.cc:237] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.485517   758 tablet_bootstrap.cc:492] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:46.491664   759 tablet_bootstrap.cc:492] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574: Bootstrap starting.
W20260709 12:56:46.495105   606 leader_election.cc:343] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73861428f3944b419b44bfb808192574 (127.0.107.195:35789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.496791   606 leader_election.cc:304] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0eb8adea9854f229bac55c51c68cf16; no voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:46.497180   715 raft_consensus.cc:2468] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 1.
I20260709 12:56:46.497659   793 raft_consensus.cc:493] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.498276   793 raft_consensus.cc:515] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.499652   531 leader_election.cc:304] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:46.500844   767 raft_consensus.cc:2804] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.501350   767 raft_consensus.cc:697] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Becoming Leader. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:46.502405   767 consensus_queue.cc:237] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:46.503891   793 leader_election.cc:290] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.514559   758 tablet_bootstrap.cc:654] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.562382   461 catalog_manager.cc:5697] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.563143   460 catalog_manager.cc:5697] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b reported cstate change: term changed from 0 to 1, leader changed from <none> to 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "78bfb847470a430dbd76c6274d8fe34b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
W20260709 12:56:46.615370   606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35789, user_credentials={real_user=slave}} blocked reactor thread for 124290us
W20260709 12:56:46.539135   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:46.625911   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6444d9ff5e4d4fd4bdc1b93e36ee7cde" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
I20260709 12:56:46.626644   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6444d9ff5e4d4fd4bdc1b93e36ee7cde" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
W20260709 12:56:46.628304   606 leader_election.cc:343] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73861428f3944b419b44bfb808192574 (127.0.107.195:35789): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:46.628978   606 leader_election.cc:343] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.619735   758 tablet_bootstrap.cc:492] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:46.629896   758 ts_tablet_manager.cc:1403] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.145s	user 0.058s	sys 0.053s
I20260709 12:56:46.508525   793 raft_consensus.cc:2749] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:46.621656   760 tablet_bootstrap.cc:492] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:46.632143   760 ts_tablet_manager.cc:1403] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.272s	user 0.016s	sys 0.006s
I20260709 12:56:46.634635   759 tablet_bootstrap.cc:654] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.635119   760 raft_consensus.cc:359] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.636014   760 raft_consensus.cc:385] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.636317   760 raft_consensus.cc:740] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.637435   760 consensus_queue.cc:260] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.640790   760 ts_tablet_manager.cc:1434] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:56:46.642982   760 tablet_bootstrap.cc:492] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:46.629359   606 leader_election.cc:304] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0eb8adea9854f229bac55c51c68cf16; no voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:46.649492   793 raft_consensus.cc:2749] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:46.650648   462 catalog_manager.cc:5697] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73861428f3944b419b44bfb808192574 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "73861428f3944b419b44bfb808192574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:46.652313   758 raft_consensus.cc:359] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.653095   758 raft_consensus.cc:385] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.653421   758 raft_consensus.cc:740] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.655973   759 tablet_bootstrap.cc:492] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:46.656469   759 ts_tablet_manager.cc:1403] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.009s
I20260709 12:56:46.659322   760 tablet_bootstrap.cc:654] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.659108   759 raft_consensus.cc:359] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.660276   759 raft_consensus.cc:385] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.660558   759 raft_consensus.cc:740] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.660692   758 consensus_queue.cc:260] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.661242   759 consensus_queue.cc:260] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.663347   759 ts_tablet_manager.cc:1434] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:56:46.663347   758 ts_tablet_manager.cc:1434] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:56:46.664315   759 tablet_bootstrap.cc:492] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574: Bootstrap starting.
I20260709 12:56:46.665215   758 tablet_bootstrap.cc:492] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:46.671653   759 tablet_bootstrap.cc:654] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.674470   460 catalog_manager.cc:5697] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b reported cstate change: term changed from 0 to 1, leader changed from <none> to 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "78bfb847470a430dbd76c6274d8fe34b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.675360   758 tablet_bootstrap.cc:654] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.684096   759 tablet_bootstrap.cc:492] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574: No bootstrap required, opened a new log
I20260709 12:56:46.684226   763 raft_consensus.cc:493] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.690047   763 raft_consensus.cc:515] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.692826   763 leader_election.cc:290] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:46.684021   760 tablet_bootstrap.cc:492] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:46.693929   760 ts_tablet_manager.cc:1403] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.003s
I20260709 12:56:46.693854   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6444d9ff5e4d4fd4bdc1b93e36ee7cde" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
I20260709 12:56:46.694315   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6444d9ff5e4d4fd4bdc1b93e36ee7cde" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16" is_pre_election: true
I20260709 12:56:46.695024   640 raft_consensus.cc:2468] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 0.
I20260709 12:56:46.696314   681 leader_election.cc:304] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
W20260709 12:56:46.697329   680 leader_election.cc:343] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.698928   758 tablet_bootstrap.cc:492] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:46.699458   758 ts_tablet_manager.cc:1403] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.007s
I20260709 12:56:46.699780   763 raft_consensus.cc:2804] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.700210   763 raft_consensus.cc:493] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.700587   763 raft_consensus.cc:3060] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.702266   759 ts_tablet_manager.cc:1403] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.008s
I20260709 12:56:46.702893   758 raft_consensus.cc:359] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.703685   758 raft_consensus.cc:385] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.704110   758 raft_consensus.cc:740] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.706070   760 raft_consensus.cc:359] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.706843   760 raft_consensus.cc:385] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.707341   760 raft_consensus.cc:740] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.706873   759 raft_consensus.cc:359] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.708142   759 raft_consensus.cc:385] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.708465   759 raft_consensus.cc:740] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.707039   758 consensus_queue.cc:260] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.708356   760 consensus_queue.cc:260] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.709273   759 consensus_queue.cc:260] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.711140   758 ts_tablet_manager.cc:1434] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:56:46.712222   758 tablet_bootstrap.cc:492] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:46.714732   759 ts_tablet_manager.cc:1434] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:56:46.720086   760 ts_tablet_manager.cc:1434] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 12:56:46.722769   760 tablet_bootstrap.cc:492] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16: Bootstrap starting.
I20260709 12:56:46.726433   758 tablet_bootstrap.cc:654] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.717430   763 raft_consensus.cc:515] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.730351   793 raft_consensus.cc:493] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.730859   793 raft_consensus.cc:515] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.732131   763 leader_election.cc:290] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:46.733088   793 leader_election.cc:290] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.733536   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6444d9ff5e4d4fd4bdc1b93e36ee7cde" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:46.735435   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6444d9ff5e4d4fd4bdc1b93e36ee7cde" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:46.735939   758 tablet_bootstrap.cc:492] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:46.736286   640 raft_consensus.cc:3060] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.736497   758 ts_tablet_manager.cc:1403] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.003s
W20260709 12:56:46.738641   680 leader_election.cc:343] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.739588   758 raft_consensus.cc:359] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.739866   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef229be9ced4c81a421d5d5bc753fa7" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
I20260709 12:56:46.740438   715 raft_consensus.cc:2468] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 0.
I20260709 12:56:46.740504   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef229be9ced4c81a421d5d5bc753fa7" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
I20260709 12:56:46.741189   758 raft_consensus.cc:385] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.741487   758 raft_consensus.cc:740] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.742031   606 leader_election.cc:304] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:46.742153   758 consensus_queue.cc:260] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.741088   565 raft_consensus.cc:2468] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 0.
I20260709 12:56:46.744391   758 ts_tablet_manager.cc:1434] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:56:46.745302   758 tablet_bootstrap.cc:492] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b: Bootstrap starting.
I20260709 12:56:46.745741   793 raft_consensus.cc:2804] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.746279   793 raft_consensus.cc:493] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.746692   793 raft_consensus.cc:3060] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.752710   758 tablet_bootstrap.cc:654] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.757803   640 raft_consensus.cc:2468] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 1.
I20260709 12:56:46.759477   681 leader_election.cc:304] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:46.760550   763 raft_consensus.cc:2804] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.761051   763 raft_consensus.cc:697] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Becoming Leader. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:46.761942   763 consensus_queue.cc:237] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.774983   793 raft_consensus.cc:515] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.778896   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef229be9ced4c81a421d5d5bc753fa7" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:46.779524   565 raft_consensus.cc:3060] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.787287   760 tablet_bootstrap.cc:654] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.793857   802 raft_consensus.cc:493] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.794950   802 raft_consensus.cc:515] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.795711   565 raft_consensus.cc:2468] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 1.
I20260709 12:56:46.797219   606 leader_election.cc:304] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:46.798862   769 raft_consensus.cc:2804] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.801411   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
I20260709 12:56:46.802376   715 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 0.
I20260709 12:56:46.802800   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
I20260709 12:56:46.804265   565 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 0.
I20260709 12:56:46.804100   606 leader_election.cc:304] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:46.798818   802 leader_election.cc:290] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.807456   802 raft_consensus.cc:2804] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.807936   802 raft_consensus.cc:493] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.808833   802 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.814442   769 raft_consensus.cc:697] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:46.815641   769 consensus_queue.cc:237] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.817158   793 leader_election.cc:290] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.829355   758 tablet_bootstrap.cc:492] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b: No bootstrap required, opened a new log
I20260709 12:56:46.829924   758 ts_tablet_manager.cc:1403] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b: Time spent bootstrapping tablet: real 0.085s	user 0.039s	sys 0.020s
I20260709 12:56:46.831809   640 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.833267   758 raft_consensus.cc:359] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.834702   758 raft_consensus.cc:385] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.835299   758 raft_consensus.cc:740] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.836700   758 consensus_queue.cc:260] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.839995   760 tablet_bootstrap.cc:492] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16: No bootstrap required, opened a new log
I20260709 12:56:46.840994   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef229be9ced4c81a421d5d5bc753fa7" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:46.843314   715 raft_consensus.cc:3060] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.845345   461 catalog_manager.cc:5697] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73861428f3944b419b44bfb808192574 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "73861428f3944b419b44bfb808192574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:46.840996   760 ts_tablet_manager.cc:1403] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.001s
I20260709 12:56:46.840963   758 ts_tablet_manager.cc:1434] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:56:46.854705   760 raft_consensus.cc:359] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:46.855484   760 raft_consensus.cc:385] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.856256   760 raft_consensus.cc:740] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.856981   760 consensus_queue.cc:260] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:46.848856   463 catalog_manager.cc:5697] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.859704   760 ts_tablet_manager.cc:1434] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:56:46.857036   715 raft_consensus.cc:2468] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 1.
I20260709 12:56:46.868563   763 consensus_queue.cc:1048] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:46.877292   763 consensus_queue.cc:1048] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:46.849956   802 raft_consensus.cc:515] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.879772   769 raft_consensus.cc:493] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.880833   802 leader_election.cc:290] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.880532   769 raft_consensus.cc:515] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.882815   769 leader_election.cc:290] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.883095   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:46.883703   715 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.882699   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:46.884289   564 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.886610   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bfb847470a430dbd76c6274d8fe34b" is_pre_election: true
I20260709 12:56:46.889321   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
I20260709 12:56:46.893276   606 leader_election.cc:304] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0eb8adea9854f229bac55c51c68cf16; no voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:46.902973   767 consensus_queue.cc:1048] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:46.912431   564 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 1.
I20260709 12:56:46.914227   606 leader_election.cc:304] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:46.915683   769 raft_consensus.cc:2804] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.916270   769 raft_consensus.cc:697] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:46.917101   769 consensus_queue.cc:237] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.893262   715 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 1.
I20260709 12:56:46.921955   767 consensus_queue.cc:1048] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:46.935150   564 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.937988   802 raft_consensus.cc:2749] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:56:46.938807   641 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.951392   767 consensus_queue.cc:1048] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:46.960448   463 catalog_manager.cc:5697] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.969154   780 consensus_queue.cc:1048] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:56:46.974897   767 raft_consensus.cc:493] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.975509   767 raft_consensus.cc:515] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:46.991935   795 consensus_queue.cc:1048] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:56:46.992079   767 leader_election.cc:290] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:46.996994   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
I20260709 12:56:46.998266   715 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 0.
I20260709 12:56:47.001219   767 raft_consensus.cc:493] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.002154   767 raft_consensus.cc:515] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.002929   531 leader_election.cc:304] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:47.001204   769 consensus_queue.cc:1048] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:56:47.008869   794 raft_consensus.cc:2804] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:47.012745   767 leader_election.cc:290] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:47.007545   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16" is_pre_election: true
I20260709 12:56:47.013010   794 raft_consensus.cc:493] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:47.021509   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6444d9ff5e4d4fd4bdc1b93e36ee7cde" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16" is_pre_election: true
I20260709 12:56:47.022850   639 raft_consensus.cc:2393] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 78bfb847470a430dbd76c6274d8fe34b in current term 1: Already voted for candidate 73861428f3944b419b44bfb808192574 in this term.
I20260709 12:56:47.019444   794 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.019702   640 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 0.
W20260709 12:56:47.051587   531 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35789, user_credentials={real_user=slave}} blocked reactor thread for 48719.7us
I20260709 12:56:47.067798   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6444d9ff5e4d4fd4bdc1b93e36ee7cde" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574" is_pre_election: true
I20260709 12:56:47.069896   794 raft_consensus.cc:515] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.076437   794 leader_election.cc:290] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 election: Requested vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:47.076555   769 consensus_queue.cc:1048] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:47.079957   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:47.084000   638 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.086414   827 consensus_queue.cc:1048] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:56:47.081231   531 leader_election.cc:304] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b; no voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:47.090975   794 raft_consensus.cc:3060] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.100499   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:47.101181   714 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.100927   794 raft_consensus.cc:2749] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:47.109539   638 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 1.
I20260709 12:56:47.111616   532 leader_election.cc:304] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:47.116168   767 raft_consensus.cc:2804] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:47.117269   767 raft_consensus.cc:697] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Becoming Leader. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:47.119052   767 consensus_queue.cc:237] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.150591   714 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 1.
I20260709 12:56:47.179314   462 catalog_manager.cc:5697] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b reported cstate change: term changed from 0 to 1, leader changed from <none> to 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "78bfb847470a430dbd76c6274d8fe34b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.196923   827 consensus_queue.cc:1048] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:47.210124   780 consensus_queue.cc:1048] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.306959   815 consensus_queue.cc:1048] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.318068   793 consensus_queue.cc:1048] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.322355   793 consensus_queue.cc:1048] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.341595   815 consensus_queue.cc:1048] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.376716   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
mode: GRACEFUL
new_leader_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:40108
I20260709 12:56:47.377456   641 raft_consensus.cc:606] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Received request to transfer leadership to TS 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:47.393438   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c"
dest_uuid: "73861428f3944b419b44bfb808192574"
mode: GRACEFUL
new_leader_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:50540
I20260709 12:56:47.394132   714 raft_consensus.cc:606] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Received request to transfer leadership to TS 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:47.403796   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573"
dest_uuid: "73861428f3944b419b44bfb808192574"
mode: GRACEFUL
new_leader_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:50540
I20260709 12:56:47.404388   714 raft_consensus.cc:606] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Received request to transfer leadership to TS a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:47.428855   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
mode: GRACEFUL
new_leader_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:43742
I20260709 12:56:47.429509   564 raft_consensus.cc:606] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Received request to transfer leadership to TS a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:47.515002   794 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.523598   831 raft_consensus.cc:993] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b: : Instructing follower a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:47.524029   831 raft_consensus.cc:1081] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Signalling peer a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:47.526854   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:40102
I20260709 12:56:47.530479   638 raft_consensus.cc:493] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:47.530903   638 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.532209   831 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:47.541275   638 raft_consensus.cc:515] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.547148   638 leader_election.cc:290] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:47.549538   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:47.550266   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:47.550853   564 raft_consensus.cc:3055] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:47.551183   564 raft_consensus.cc:740] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:47.551990   564 consensus_queue.cc:260] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.553387   564 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.553769   827 raft_consensus.cc:993] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574: : Instructing follower 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:47.554186   827 raft_consensus.cc:1081] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Signalling peer 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:47.550243   714 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.556433   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:43726
I20260709 12:56:47.557219   565 raft_consensus.cc:493] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:47.557691   565 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.560621   564 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 2.
I20260709 12:56:47.565358   565 raft_consensus.cc:515] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.566253   606 leader_election.cc:304] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:47.566416   714 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 2.
I20260709 12:56:47.567603   769 raft_consensus.cc:2804] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:47.568081   769 raft_consensus.cc:697] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:47.569016   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:47.569764   641 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.571019   565 leader_election.cc:290] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 2 election: Requested vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:47.575416   769 consensus_queue.cc:237] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.576526   641 raft_consensus.cc:2468] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 2.
I20260709 12:56:47.577778   532 leader_election.cc:304] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:47.578600   831 raft_consensus.cc:2804] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:47.579067   831 raft_consensus.cc:697] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Becoming Leader. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:47.579866   831 consensus_queue.cc:237] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.580555   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:47.581836   714 raft_consensus.cc:3055] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:47.582214   714 raft_consensus.cc:740] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:47.583525   714 consensus_queue.cc:260] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.584200   462 catalog_manager.cc:5697] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 1 to 2, leader changed from 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193) to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.585004   714 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.589632   461 catalog_manager.cc:5697] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b reported cstate change: term changed from 1 to 2, leader changed from 73861428f3944b419b44bfb808192574 (127.0.107.195) to 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "78bfb847470a430dbd76c6274d8fe34b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.592463   714 raft_consensus.cc:2468] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 2.
I20260709 12:56:47.677297   780 raft_consensus.cc:993] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574: : Instructing follower a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:47.677846   780 raft_consensus.cc:1081] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Signalling peer a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:47.679607   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:40088
I20260709 12:56:47.680229   641 raft_consensus.cc:493] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:47.680625   641 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.686162   641 raft_consensus.cc:515] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.687879   641 leader_election.cc:290] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:47.688851   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:47.689100   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:47.689697   714 raft_consensus.cc:3055] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:47.690061   714 raft_consensus.cc:740] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:47.689687   565 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.690879   714 consensus_queue.cc:260] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.691835   714 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.696439   714 raft_consensus.cc:2468] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 2.
I20260709 12:56:47.697503   565 raft_consensus.cc:2468] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 2.
I20260709 12:56:47.697636   606 leader_election.cc:304] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:47.698555   769 raft_consensus.cc:2804] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:47.699030   769 raft_consensus.cc:697] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:47.699846   769 consensus_queue.cc:237] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.708313   461 catalog_manager.cc:5697] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 1 to 2, leader changed from 73861428f3944b419b44bfb808192574 (127.0.107.195) to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.791759   815 raft_consensus.cc:993] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16: : Instructing follower 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:47.792224   815 raft_consensus.cc:1081] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Signalling peer 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:47.793823   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:43728
I20260709 12:56:47.794399   565 raft_consensus.cc:493] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:47.794867   565 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.800395   565 raft_consensus.cc:515] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.802523   565 leader_election.cc:290] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 2 election: Requested vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:47.803222   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:47.803594   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:47.803809   641 raft_consensus.cc:3055] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:47.804171   714 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.804150   641 raft_consensus.cc:740] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:47.805155   641 consensus_queue.cc:260] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.806384   641 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:47.813503   641 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 2.
I20260709 12:56:47.813503   714 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 2.
I20260709 12:56:47.815253   532 leader_election.cc:304] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:47.816998   831 raft_consensus.cc:2804] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:47.817488   831 raft_consensus.cc:697] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Becoming Leader. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:47.818292   831 consensus_queue.cc:237] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:47.825863   461 catalog_manager.cc:5697] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b reported cstate change: term changed from 1 to 2, leader changed from a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194) to 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "78bfb847470a430dbd76c6274d8fe34b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.965744   715 raft_consensus.cc:1275] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:47.967233   831 consensus_queue.cc:1048] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:47.980834   641 raft_consensus.cc:1275] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:47.983614   767 consensus_queue.cc:1048] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.066895   565 raft_consensus.cc:1275] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:48.068483   769 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.079295   715 raft_consensus.cc:1275] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:48.080768   815 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.195996   565 raft_consensus.cc:1275] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:48.197342   802 consensus_queue.cc:1048] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:48.213063   714 raft_consensus.cc:1275] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:48.214728   815 consensus_queue.cc:1048] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.347772   714 raft_consensus.cc:1275] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:48.348987   641 raft_consensus.cc:1275] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:48.349180   767 consensus_queue.cc:1048] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.350515   794 consensus_queue.cc:1048] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:50.469956   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:56:50.470867   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:50.493433   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
mode: GRACEFUL
new_leader_uuid: "73861428f3944b419b44bfb808192574"
 from {username='slave'} at 127.0.0.1:43756
I20260709 12:56:50.494087   564 raft_consensus.cc:606] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Received request to transfer leadership to TS 73861428f3944b419b44bfb808192574
I20260709 12:56:50.505716   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
mode: GRACEFUL
new_leader_uuid: "73861428f3944b419b44bfb808192574"
 from {username='slave'} at 127.0.0.1:40122
I20260709 12:56:50.506386   641 raft_consensus.cc:606] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Received request to transfer leadership to TS 73861428f3944b419b44bfb808192574
I20260709 12:56:50.507709   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:56:50.508148   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:50.758242   861 raft_consensus.cc:993] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16: : Instructing follower 73861428f3944b419b44bfb808192574 to start an election
I20260709 12:56:50.758702   861 raft_consensus.cc:1081] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Signalling peer 73861428f3944b419b44bfb808192574 to start an election
I20260709 12:56:50.760408   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3"
dest_uuid: "73861428f3944b419b44bfb808192574"
 from {username='slave'} at 127.0.0.1:50520
I20260709 12:56:50.760861   715 raft_consensus.cc:493] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:50.761134   715 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:50.765480   715 raft_consensus.cc:515] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:50.767112   715 leader_election.cc:290] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 3 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:50.768114   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:50.768123   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:50.769125   564 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:50.769104   641 raft_consensus.cc:3055] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:50.769788   641 raft_consensus.cc:740] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:50.770628   641 consensus_queue.cc:260] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:50.771842   641 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:50.776480   564 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 3.
I20260709 12:56:50.778270   680 leader_election.cc:304] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:50.778894   641 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 3.
I20260709 12:56:50.779312   856 raft_consensus.cc:2804] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:50.781380   856 raft_consensus.cc:697] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Becoming Leader. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:50.782274   856 consensus_queue.cc:237] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:50.790895   461 catalog_manager.cc:5697] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 reported cstate change: term changed from 2 to 3, leader changed from a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194) to 73861428f3944b419b44bfb808192574 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "73861428f3944b419b44bfb808192574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:50.952564   831 raft_consensus.cc:993] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b: : Instructing follower 73861428f3944b419b44bfb808192574 to start an election
I20260709 12:56:50.953122   857 raft_consensus.cc:1081] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Signalling peer 73861428f3944b419b44bfb808192574 to start an election
I20260709 12:56:50.954977   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c"
dest_uuid: "73861428f3944b419b44bfb808192574"
 from {username='slave'} at 127.0.0.1:50536
I20260709 12:56:50.955612   715 raft_consensus.cc:493] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:50.956009   715 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:50.961225   715 raft_consensus.cc:515] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:50.962984   715 leader_election.cc:290] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 3 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:50.963903   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:50.964123   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:50.964593   641 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:50.964582   564 raft_consensus.cc:3055] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:50.965140   564 raft_consensus.cc:740] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:50.966414   564 consensus_queue.cc:260] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:50.967605   564 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:50.972023   641 raft_consensus.cc:2468] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 3.
I20260709 12:56:50.973443   681 leader_election.cc:304] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:50.973930   564 raft_consensus.cc:2468] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 3.
I20260709 12:56:50.974377   856 raft_consensus.cc:2804] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:50.974923   856 raft_consensus.cc:697] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Becoming Leader. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:50.975632   856 consensus_queue.cc:237] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:50.982543   461 catalog_manager.cc:5697] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 reported cstate change: term changed from 2 to 3, leader changed from 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193) to 73861428f3944b419b44bfb808192574 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "73861428f3944b419b44bfb808192574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:51.174400   564 raft_consensus.cc:1275] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Refusing update from remote peer 73861428f3944b419b44bfb808192574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:51.175803   856 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:51.188203   641 raft_consensus.cc:1275] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Refusing update from remote peer 73861428f3944b419b44bfb808192574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:51.190867   862 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:51.411916   641 raft_consensus.cc:1275] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Refusing update from remote peer 73861428f3944b419b44bfb808192574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:51.413142   862 consensus_queue.cc:1048] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:51.422431   564 raft_consensus.cc:1275] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Refusing update from remote peer 73861428f3944b419b44bfb808192574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:51.424834   862 consensus_queue.cc:1048] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:51.508934   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:51.518947   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
mode: GRACEFUL
new_leader_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:43742
I20260709 12:56:51.519433   564 raft_consensus.cc:606] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Received request to transfer leadership to TS a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:51.524313   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
mode: GRACEFUL
new_leader_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:43742
I20260709 12:56:51.524787   564 raft_consensus.cc:606] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Received request to transfer leadership to TS a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:51.529726   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c"
dest_uuid: "73861428f3944b419b44bfb808192574"
mode: GRACEFUL
new_leader_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:50540
I20260709 12:56:51.530303   715 raft_consensus.cc:606] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Received request to transfer leadership to TS a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:51.535177   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f127270ca4b4533a66d9c959924a287"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
mode: GRACEFUL
new_leader_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:43742
I20260709 12:56:51.535696   564 raft_consensus.cc:606] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Received request to transfer leadership to TS a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:51.549376   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3"
dest_uuid: "73861428f3944b419b44bfb808192574"
mode: GRACEFUL
new_leader_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:50540
I20260709 12:56:51.550010   715 raft_consensus.cc:606] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Received request to transfer leadership to TS a0eb8adea9854f229bac55c51c68cf16
I20260709 12:56:51.572395   875 raft_consensus.cc:993] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574: : Instructing follower a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:51.572892   862 raft_consensus.cc:1081] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Signalling peer a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:51.574306   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:40088
I20260709 12:56:51.574826   641 raft_consensus.cc:493] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:51.575101   641 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:51.579563   641 raft_consensus.cc:515] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.581732   641 leader_election.cc:290] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 4 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:51.582482   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:51.582738   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:51.583073   564 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:51.583241   714 raft_consensus.cc:3055] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:51.583595   714 raft_consensus.cc:740] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:51.584383   714 consensus_queue.cc:260] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.585544   714 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:51.589921   564 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 4.
I20260709 12:56:51.591238   606 leader_election.cc:304] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:51.592036   878 raft_consensus.cc:2804] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:51.592180   714 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 4.
I20260709 12:56:51.592517   878 raft_consensus.cc:697] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 4 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:51.593786   878 consensus_queue.cc:237] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.599565   461 catalog_manager.cc:5697] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 3 to 4, leader changed from 73861428f3944b419b44bfb808192574 (127.0.107.195) to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:51.759239   831 raft_consensus.cc:993] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b: : Instructing follower a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:51.759745   831 raft_consensus.cc:1081] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Signalling peer a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:51.761278   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f127270ca4b4533a66d9c959924a287"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:40102
I20260709 12:56:51.761873   641 raft_consensus.cc:493] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:51.762163   641 raft_consensus.cc:3060] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:51.766932   641 raft_consensus.cc:515] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.768235   641 leader_election.cc:290] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:51.769354   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f127270ca4b4533a66d9c959924a287" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:51.769484   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f127270ca4b4533a66d9c959924a287" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:51.769905   564 raft_consensus.cc:3055] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:51.770071   714 raft_consensus.cc:3060] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:51.770238   564 raft_consensus.cc:740] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:51.770947   564 consensus_queue.cc:260] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.772228   564 raft_consensus.cc:3060] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:51.774972   714 raft_consensus.cc:2468] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 2.
I20260709 12:56:51.776156   606 leader_election.cc:304] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:51.776943   878 raft_consensus.cc:2804] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:51.776973   564 raft_consensus.cc:2468] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 2.
I20260709 12:56:51.777495   878 raft_consensus.cc:697] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:51.778390   878 consensus_queue.cc:237] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.786011   461 catalog_manager.cc:5697] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 1 to 2, leader changed from 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193) to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:51.871058   875 raft_consensus.cc:993] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574: : Instructing follower a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:51.871695   875 raft_consensus.cc:1081] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Signalling peer a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:51.873449   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:40088
I20260709 12:56:51.873979   641 raft_consensus.cc:493] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:51.874296   641 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:51.878530   641 raft_consensus.cc:515] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.880923   641 leader_election.cc:290] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 4 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:51.881270   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:51.881976   565 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:51.883630   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d8cbb82392471882fe2a7398b1e75c" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:51.884312   714 raft_consensus.cc:3055] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:51.884686   714 raft_consensus.cc:740] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:51.885766   714 consensus_queue.cc:260] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.887080   714 raft_consensus.cc:3060] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:51.888924   565 raft_consensus.cc:2468] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 4.
I20260709 12:56:51.889675   566 raft_consensus.cc:1240] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Rejecting Update request from peer 73861428f3944b419b44bfb808192574 for earlier term 3. Current term is 4. Ops: []
I20260709 12:56:51.891484   606 leader_election.cc:304] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bfb847470a430dbd76c6274d8fe34b, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:51.892336   878 raft_consensus.cc:2804] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:51.892822   878 raft_consensus.cc:697] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 4 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:51.893736   714 raft_consensus.cc:2468] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 4.
I20260709 12:56:51.893517   878 consensus_queue.cc:237] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:51.900043   461 catalog_manager.cc:5697] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 3 to 4, leader changed from 73861428f3944b419b44bfb808192574 (127.0.107.195) to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:51.925422   882 raft_consensus.cc:993] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b: : Instructing follower a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:51.926007   831 raft_consensus.cc:1081] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Signalling peer a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:51.927706   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:40102
I20260709 12:56:51.928211   641 raft_consensus.cc:493] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:51.928500   641 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:51.932964   641 raft_consensus.cc:515] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:51.934543   641 leader_election.cc:290] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 election: Requested vote from peers 73861428f3944b419b44bfb808192574 (127.0.107.195:35789), 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329)
I20260709 12:56:51.935833   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:51.935968   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:51.936368   714 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:51.936576   566 raft_consensus.cc:3055] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:51.936954   566 raft_consensus.cc:740] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:51.937759   566 consensus_queue.cc:260] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:51.938747   566 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:51.941516   714 raft_consensus.cc:2468] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 2.
I20260709 12:56:51.942803   606 leader_election.cc:304] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:51.943535   878 raft_consensus.cc:2804] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:51.943974   878 raft_consensus.cc:697] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:51.944231   566 raft_consensus.cc:2468] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 2.
I20260709 12:56:51.944754   878 consensus_queue.cc:237] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:51.951818   461 catalog_manager.cc:5697] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 1 to 2, leader changed from 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193) to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:52.001808   882 raft_consensus.cc:993] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b: : Instructing follower a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:52.002262   831 raft_consensus.cc:1081] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Signalling peer a0eb8adea9854f229bac55c51c68cf16 to start an election
I20260709 12:56:52.003871   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
 from {username='slave'} at 127.0.0.1:40102
I20260709 12:56:52.004371   641 raft_consensus.cc:493] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:52.004639   641 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:52.009814   641 raft_consensus.cc:515] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:52.011327   641 leader_election.cc:290] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 3 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:52.012356   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:52.012681   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "a0eb8adea9854f229bac55c51c68cf16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:52.012930   566 raft_consensus.cc:3055] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:52.013288   714 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:52.013310   566 raft_consensus.cc:740] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:52.014426   566 consensus_queue.cc:260] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:52.015477   566 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:52.018630   714 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 3.
I20260709 12:56:52.019767   606 leader_election.cc:304] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, a0eb8adea9854f229bac55c51c68cf16; no voters: 
I20260709 12:56:52.020592   878 raft_consensus.cc:2804] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:52.020992   566 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0eb8adea9854f229bac55c51c68cf16 in term 3.
I20260709 12:56:52.021056   878 raft_consensus.cc:697] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 3 LEADER]: Becoming Leader. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:52.022195   878 consensus_queue.cc:237] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:52.029186   461 catalog_manager.cc:5697] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 reported cstate change: term changed from 2 to 3, leader changed from 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193) to a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "a0eb8adea9854f229bac55c51c68cf16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:52.108569   566 raft_consensus.cc:1275] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:52.109969   878 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:52.120090   714 raft_consensus.cc:1275] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:52.121592   861 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:52.309428   714 raft_consensus.cc:1275] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:52.310606   861 consensus_queue.cc:1048] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.322207   566 raft_consensus.cc:1275] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:52.323823   890 consensus_queue.cc:1048] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.413321   566 raft_consensus.cc:1275] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:52.415151   861 consensus_queue.cc:1048] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:52.416990   715 raft_consensus.cc:1275] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:52.418325   565 raft_consensus.cc:1275] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:52.418890   861 consensus_queue.cc:1048] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.419806   890 consensus_queue.cc:1048] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.427830   714 raft_consensus.cc:1275] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:52.430281   713 raft_consensus.cc:1275] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:52.433982   564 raft_consensus.cc:1275] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Refusing update from remote peer a0eb8adea9854f229bac55c51c68cf16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:52.435022   890 consensus_queue.cc:1048] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:52.437395   890 consensus_queue.cc:1048] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:52.447479   861 consensus_queue.cc:1048] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:54.554980   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:54.562433   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
mode: GRACEFUL
new_leader_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:40122
I20260709 12:56:54.563381   641 raft_consensus.cc:606] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 3 LEADER]: Received request to transfer leadership to TS 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:54.566285   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
mode: GRACEFUL
new_leader_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:40122
I20260709 12:56:54.566730   641 raft_consensus.cc:606] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Received request to transfer leadership to TS 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:54.569018   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
mode: GRACEFUL
new_leader_uuid: "73861428f3944b419b44bfb808192574"
 from {username='slave'} at 127.0.0.1:40122
I20260709 12:56:54.569459   641 raft_consensus.cc:606] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Received request to transfer leadership to TS 73861428f3944b419b44bfb808192574
I20260709 12:56:54.571661   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
mode: GRACEFUL
new_leader_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:40122
I20260709 12:56:54.572147   641 raft_consensus.cc:606] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 4 LEADER]: Received request to transfer leadership to TS 78bfb847470a430dbd76c6274d8fe34b
I20260709 12:56:54.574843   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eef229be9ced4c81a421d5d5bc753fa7"
dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
mode: GRACEFUL
new_leader_uuid: "73861428f3944b419b44bfb808192574"
 from {username='slave'} at 127.0.0.1:40122
I20260709 12:56:54.575285   641 raft_consensus.cc:606] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Received request to transfer leadership to TS 73861428f3944b419b44bfb808192574
I20260709 12:56:54.576407   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:56:54.576948   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:54.628608   898 raft_consensus.cc:993] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16: : Instructing follower 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:54.629132   861 raft_consensus.cc:1081] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 4 LEADER]: Signalling peer 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:54.630889   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:43728
I20260709 12:56:54.631448   566 raft_consensus.cc:493] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:54.631788   566 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:54.638216   566 raft_consensus.cc:515] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.640671   566 leader_election.cc:290] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 5 election: Requested vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:54.641875   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:54.642148   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe76d0e313f4a0aab09abc123d170f3" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:54.642772   641 raft_consensus.cc:3055] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:56:54.642879   714 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:54.643154   641 raft_consensus.cc:740] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:54.644011   641 consensus_queue.cc:260] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.644878   641 raft_consensus.cc:3060] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:54.647943   714 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 5.
I20260709 12:56:54.649119   641 raft_consensus.cc:2468] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 5.
I20260709 12:56:54.649161   531 leader_election.cc:304] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:54.650951   899 raft_consensus.cc:2804] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:56:54.651916   899 raft_consensus.cc:697] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 5 LEADER]: Becoming Leader. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:54.653059   899 consensus_queue.cc:237] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.660847   461 catalog_manager.cc:5697] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b reported cstate change: term changed from 4 to 5, leader changed from a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194) to 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193). New cstate: current_term: 5 leader_uuid: "78bfb847470a430dbd76c6274d8fe34b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:54.844431   861 raft_consensus.cc:993] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16: : Instructing follower 73861428f3944b419b44bfb808192574 to start an election
I20260709 12:56:54.844959   898 raft_consensus.cc:1081] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Signalling peer 73861428f3944b419b44bfb808192574 to start an election
I20260709 12:56:54.846475   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573"
dest_uuid: "73861428f3944b419b44bfb808192574"
 from {username='slave'} at 127.0.0.1:50520
I20260709 12:56:54.846921   714 raft_consensus.cc:493] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:54.847204   861 raft_consensus.cc:993] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16: : Instructing follower 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:54.847218   714 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:54.847648   898 raft_consensus.cc:1081] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Signalling peer 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:54.849195   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:43728
I20260709 12:56:54.849692   566 raft_consensus.cc:493] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:54.850006   566 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:54.851970   714 raft_consensus.cc:515] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.853843   714 leader_election.cc:290] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 3 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:54.854941   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:54.854872   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06778b4dce04870ac4da4fbd684e573" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:54.855180   566 raft_consensus.cc:515] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:54.855624   641 raft_consensus.cc:3055] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:54.855670   564 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:54.856108   641 raft_consensus.cc:740] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:54.856885   641 consensus_queue.cc:260] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.857653   566 leader_election.cc:290] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 3 election: Requested vote from peers 73861428f3944b419b44bfb808192574 (127.0.107.195:35789), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:54.858091   641 raft_consensus.cc:3060] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:54.858721   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:54.859257   714 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:54.859093   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dc00d3511e410a958190d4a489bba7" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:54.859692   638 raft_consensus.cc:3055] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:54.859993   638 raft_consensus.cc:740] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:54.860879   638 consensus_queue.cc:260] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:54.862039   638 raft_consensus.cc:3060] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:54.863421   564 raft_consensus.cc:2468] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 3.
I20260709 12:56:54.863680   714 raft_consensus.cc:2468] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 3.
I20260709 12:56:54.867293   680 leader_election.cc:304] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:54.867240   531 leader_election.cc:304] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:54.867636   638 raft_consensus.cc:2468] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 3.
I20260709 12:56:54.868294   641 raft_consensus.cc:2468] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 3.
I20260709 12:56:54.868407   899 raft_consensus.cc:2804] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:54.868503   862 raft_consensus.cc:2804] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:54.869053   899 raft_consensus.cc:697] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 3 LEADER]: Becoming Leader. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:54.869904   862 raft_consensus.cc:697] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Becoming Leader. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:54.870007   899 consensus_queue.cc:237] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } }
I20260709 12:56:54.870949   862 consensus_queue.cc:237] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.879920   461 catalog_manager.cc:5697] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b reported cstate change: term changed from 2 to 3, leader changed from a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194) to 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193). New cstate: current_term: 3 leader_uuid: "78bfb847470a430dbd76c6274d8fe34b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:54.882526   460 catalog_manager.cc:5697] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 reported cstate change: term changed from 2 to 3, leader changed from a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194) to 73861428f3944b419b44bfb808192574 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "73861428f3944b419b44bfb808192574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:54.966444   861 raft_consensus.cc:993] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16: : Instructing follower 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:54.966883   861 raft_consensus.cc:1081] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 3 LEADER]: Signalling peer 78bfb847470a430dbd76c6274d8fe34b to start an election
I20260709 12:56:54.968353   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b"
dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
 from {username='slave'} at 127.0.0.1:43728
I20260709 12:56:54.968767   564 raft_consensus.cc:493] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:54.969129   564 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:54.973899   564 raft_consensus.cc:515] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.975569   564 leader_election.cc:290] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 4 election: Requested vote from peers a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119), 73861428f3944b419b44bfb808192574 (127.0.107.195:35789)
I20260709 12:56:54.976534   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:54.976910   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ed6d22d2464020b9454102ad082f1b" candidate_uuid: "78bfb847470a430dbd76c6274d8fe34b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73861428f3944b419b44bfb808192574"
I20260709 12:56:54.977044   638 raft_consensus.cc:3055] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:54.977376   638 raft_consensus.cc:740] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:54.977392   714 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:54.978263   638 consensus_queue.cc:260] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.979185   638 raft_consensus.cc:3060] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:54.981949   714 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 4.
I20260709 12:56:54.982918   531 leader_election.cc:304] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:54.983593   899 raft_consensus.cc:2804] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:54.984066   899 raft_consensus.cc:697] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 4 LEADER]: Becoming Leader. State: Replica: 78bfb847470a430dbd76c6274d8fe34b, State: Running, Role: LEADER
I20260709 12:56:54.984360   638 raft_consensus.cc:2468] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bfb847470a430dbd76c6274d8fe34b in term 4.
I20260709 12:56:54.984941   899 consensus_queue.cc:237] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:54.993381   460 catalog_manager.cc:5697] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b reported cstate change: term changed from 3 to 4, leader changed from a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194) to 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193). New cstate: current_term: 4 leader_uuid: "78bfb847470a430dbd76c6274d8fe34b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:55.010778   898 raft_consensus.cc:993] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16: : Instructing follower 73861428f3944b419b44bfb808192574 to start an election
I20260709 12:56:55.011200   861 raft_consensus.cc:1081] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Signalling peer 73861428f3944b419b44bfb808192574 to start an election
I20260709 12:56:55.012598   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eef229be9ced4c81a421d5d5bc753fa7"
dest_uuid: "73861428f3944b419b44bfb808192574"
 from {username='slave'} at 127.0.0.1:50520
I20260709 12:56:55.013113   714 raft_consensus.cc:493] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:55.013355   714 raft_consensus.cc:3060] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:55.017438   714 raft_consensus.cc:515] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:55.018989   714 leader_election.cc:290] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 2 election: Requested vote from peers 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329), a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119)
I20260709 12:56:55.019966   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef229be9ced4c81a421d5d5bc753fa7" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0eb8adea9854f229bac55c51c68cf16"
I20260709 12:56:55.020048   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef229be9ced4c81a421d5d5bc753fa7" candidate_uuid: "73861428f3944b419b44bfb808192574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78bfb847470a430dbd76c6274d8fe34b"
I20260709 12:56:55.020555   638 raft_consensus.cc:3055] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:55.020654   564 raft_consensus.cc:3060] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:55.020872   638 raft_consensus.cc:740] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0eb8adea9854f229bac55c51c68cf16, State: Running, Role: LEADER
I20260709 12:56:55.021708   638 consensus_queue.cc:260] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:55.022713   638 raft_consensus.cc:3060] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:55.025143   564 raft_consensus.cc:2468] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 2.
I20260709 12:56:55.026202   680 leader_election.cc:304] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73861428f3944b419b44bfb808192574, 78bfb847470a430dbd76c6274d8fe34b; no voters: 
I20260709 12:56:55.027194   862 raft_consensus.cc:2804] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:55.027786   862 raft_consensus.cc:697] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 2 LEADER]: Becoming Leader. State: Replica: 73861428f3944b419b44bfb808192574, State: Running, Role: LEADER
I20260709 12:56:55.027967   638 raft_consensus.cc:2468] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73861428f3944b419b44bfb808192574 in term 2.
I20260709 12:56:55.028815   862 consensus_queue.cc:237] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } }
I20260709 12:56:55.035789   460 catalog_manager.cc:5697] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 reported cstate change: term changed from 1 to 2, leader changed from a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194) to 73861428f3944b419b44bfb808192574 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "73861428f3944b419b44bfb808192574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:55.092500   638 raft_consensus.cc:1275] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 5 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:55.093827   899 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:56:55.106312   714 raft_consensus.cc:1275] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 5 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:55.107717   899 consensus_queue.cc:1048] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:56:55.273052   714 raft_consensus.cc:1275] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:55.274355   899 consensus_queue.cc:1048] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:55.284051   638 raft_consensus.cc:1275] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:55.285519   899 consensus_queue.cc:1048] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:55.451349   564 raft_consensus.cc:1275] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Refusing update from remote peer 73861428f3944b419b44bfb808192574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:55.452425   638 raft_consensus.cc:1275] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:55.452723   862 consensus_queue.cc:1048] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:55.454106   899 consensus_queue.cc:1048] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:55.467818   714 raft_consensus.cc:1275] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Refusing update from remote peer 78bfb847470a430dbd76c6274d8fe34b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:55.471761   638 raft_consensus.cc:1275] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Refusing update from remote peer 73861428f3944b419b44bfb808192574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:55.473474   906 consensus_queue.cc:1048] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:55.474716   913 consensus_queue.cc:1048] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [LEADER]: Connected to new peer: Peer: permanent_uuid: "73861428f3944b419b44bfb808192574" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:55.483865   564 raft_consensus.cc:1275] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Refusing update from remote peer 73861428f3944b419b44bfb808192574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:55.486069   906 consensus_queue.cc:1048] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bfb847470a430dbd76c6274d8fe34b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:55.500469   638 raft_consensus.cc:1275] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Refusing update from remote peer 73861428f3944b419b44bfb808192574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:55.502398   921 consensus_queue.cc:1048] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eb8adea9854f229bac55c51c68cf16" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:55.577876   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:55.583565   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:56:55.616910   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:55.617663   431 tablet_replica.cc:333] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.618443   431 raft_consensus.cc:2243] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.619026   431 raft_consensus.cc:2272] T a06778b4dce04870ac4da4fbd684e573 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.622953   431 tablet_replica.cc:333] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.623508   431 raft_consensus.cc:2243] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.623979   431 raft_consensus.cc:2272] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.626070   431 tablet_replica.cc:333] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.626698   431 raft_consensus.cc:2243] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:56:55.627585   431 raft_consensus.cc:2272] T bfe76d0e313f4a0aab09abc123d170f3 P 78bfb847470a430dbd76c6274d8fe34b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:56:55.627745   606 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:56:55.630722   431 tablet_replica.cc:333] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.631428   431 raft_consensus.cc:2243] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:56:55.632184   606 consensus_peers.cc:597] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 -> Peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Couldn't send request to peer 78bfb847470a430dbd76c6274d8fe34b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:55.632277   431 raft_consensus.cc:2272] T 69dc00d3511e410a958190d4a489bba7 P 78bfb847470a430dbd76c6274d8fe34b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.634627   431 tablet_replica.cc:333] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.635468   431 raft_consensus.cc:2243] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:55.636332   431 raft_consensus.cc:2272] T 47ed6d22d2464020b9454102ad082f1b P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.638554   431 tablet_replica.cc:333] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.639292   431 raft_consensus.cc:2243] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.639849   431 raft_consensus.cc:2272] T 1cd580d8b609425490ea243c21e9580b P 78bfb847470a430dbd76c6274d8fe34b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.641765   431 tablet_replica.cc:333] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.642365   431 raft_consensus.cc:2243] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.642794   431 raft_consensus.cc:2272] T eef229be9ced4c81a421d5d5bc753fa7 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.645056   431 tablet_replica.cc:333] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.645630   431 raft_consensus.cc:2243] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.646049   431 raft_consensus.cc:2272] T 28d8cbb82392471882fe2a7398b1e75c P 78bfb847470a430dbd76c6274d8fe34b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.647974   431 tablet_replica.cc:333] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b: stopping tablet replica
I20260709 12:56:55.648516   431 raft_consensus.cc:2243] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.648909   431 raft_consensus.cc:2272] T 2f127270ca4b4533a66d9c959924a287 P 78bfb847470a430dbd76c6274d8fe34b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:56:55.765607   680 consensus_peers.cc:597] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 -> Peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Couldn't send request to peer 78bfb847470a430dbd76c6274d8fe34b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:55.765856   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:56:55.784350   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:56:55.815899   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:55.816605   431 tablet_replica.cc:333] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.817178   431 raft_consensus.cc:2243] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:55.818070   431 raft_consensus.cc:2272] T 28d8cbb82392471882fe2a7398b1e75c P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.820194   431 tablet_replica.cc:333] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.820710   431 raft_consensus.cc:2243] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.821111   431 raft_consensus.cc:2272] T eef229be9ced4c81a421d5d5bc753fa7 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.823392   431 tablet_replica.cc:333] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.823892   431 raft_consensus.cc:2243] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.824314   431 raft_consensus.cc:2272] T bfe76d0e313f4a0aab09abc123d170f3 P a0eb8adea9854f229bac55c51c68cf16 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.827016   431 tablet_replica.cc:333] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.827546   431 raft_consensus.cc:2243] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.827955   431 raft_consensus.cc:2272] T a06778b4dce04870ac4da4fbd684e573 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.829877   431 tablet_replica.cc:333] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.830372   431 raft_consensus.cc:2243] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.830796   431 raft_consensus.cc:2272] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.832325   431 tablet_replica.cc:333] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.832814   431 raft_consensus.cc:2243] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.833199   431 raft_consensus.cc:2272] T 69dc00d3511e410a958190d4a489bba7 P a0eb8adea9854f229bac55c51c68cf16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.835423   431 tablet_replica.cc:333] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.835899   431 raft_consensus.cc:2243] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.836292   431 raft_consensus.cc:2272] T 47ed6d22d2464020b9454102ad082f1b P a0eb8adea9854f229bac55c51c68cf16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.839291   431 tablet_replica.cc:333] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.839821   431 raft_consensus.cc:2243] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:55.840622   431 raft_consensus.cc:2272] T 1cd580d8b609425490ea243c21e9580b P a0eb8adea9854f229bac55c51c68cf16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.842718   431 tablet_replica.cc:333] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16: stopping tablet replica
I20260709 12:56:55.843240   431 raft_consensus.cc:2243] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:55.844039   431 raft_consensus.cc:2272] T 2f127270ca4b4533a66d9c959924a287 P a0eb8adea9854f229bac55c51c68cf16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.872959   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:56:55.892400   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 12:56:55.898595   680 consensus_peers.cc:597] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 -> Peer 78bfb847470a430dbd76c6274d8fe34b (127.0.107.193:38329): Couldn't send request to peer 78bfb847470a430dbd76c6274d8fe34b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:56:55.907338   681 consensus_peers.cc:597] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 -> Peer a0eb8adea9854f229bac55c51c68cf16 (127.0.107.194:33119): Couldn't send request to peer a0eb8adea9854f229bac55c51c68cf16. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33119: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:55.923429   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:55.924207   431 tablet_replica.cc:333] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.924993   431 raft_consensus.cc:2243] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.925451   431 raft_consensus.cc:2272] T bfe76d0e313f4a0aab09abc123d170f3 P 73861428f3944b419b44bfb808192574 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.927897   431 tablet_replica.cc:333] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.928406   431 raft_consensus.cc:2243] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:55.929062   431 raft_consensus.cc:2272] T 6444d9ff5e4d4fd4bdc1b93e36ee7cde P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.930729   431 tablet_replica.cc:333] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.931167   431 raft_consensus.cc:2243] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.931526   431 raft_consensus.cc:2272] T 2f127270ca4b4533a66d9c959924a287 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.933095   431 tablet_replica.cc:333] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.933527   431 raft_consensus.cc:2243] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:55.934247   431 raft_consensus.cc:2272] T eef229be9ced4c81a421d5d5bc753fa7 P 73861428f3944b419b44bfb808192574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.936051   431 tablet_replica.cc:333] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.936478   431 raft_consensus.cc:2243] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.936841   431 raft_consensus.cc:2272] T 28d8cbb82392471882fe2a7398b1e75c P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.938338   431 tablet_replica.cc:333] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.938748   431 raft_consensus.cc:2243] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.939110   431 raft_consensus.cc:2272] T 47ed6d22d2464020b9454102ad082f1b P 73861428f3944b419b44bfb808192574 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.940981   431 tablet_replica.cc:333] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.941475   431 raft_consensus.cc:2243] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.941888   431 raft_consensus.cc:2272] T 1cd580d8b609425490ea243c21e9580b P 73861428f3944b419b44bfb808192574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.943401   431 tablet_replica.cc:333] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.943787   431 raft_consensus.cc:2243] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:55.944108   431 raft_consensus.cc:2272] T 69dc00d3511e410a958190d4a489bba7 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.946193   431 tablet_replica.cc:333] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574: stopping tablet replica
I20260709 12:56:55.946586   431 raft_consensus.cc:2243] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:55.947240   431 raft_consensus.cc:2272] T a06778b4dce04870ac4da4fbd684e573 P 73861428f3944b419b44bfb808192574 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:55.974503   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:56:55.990585   431 master.cc:562] Master@127.0.107.254:34301 shutting down...
I20260709 12:56:56.197724   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:56.198333   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:56.198639   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0fe845d6c8944e78b323fe6f95dd5844: stopping tablet replica
I20260709 12:56:56.219576   431 master.cc:584] Master@127.0.107.254:34301 shutdown complete.
73861428f3944b419b44bfb808192574  1
78bfb847470a430dbd76c6274d8fe34b  4
a0eb8adea9854f229bac55c51c68cf16  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13345 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:56:56.261976   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:40733
I20260709 12:56:56.263104   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:56.270233   929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:56.270290   930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:56.270462   932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:56.271386   431 server_base.cc:1061] running on GCE node
I20260709 12:56:56.272284   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:56.272497   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:56.272678   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601816272660 us; error 0 us; skew 500 ppm
I20260709 12:56:56.273196   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:56.275754   431 webserver.cc:533] Webserver started at http://127.0.107.254:40717/ using document root <none> and password file <none>
I20260709 12:56:56.276268   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:56.276463   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:56.276746   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:56.277959   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/master-0-root/instance:
uuid: "6a2cc91c2e07410da63ad16dd40dcc8c"
format_stamp: "Formatted at 2026-07-09 12:56:56 on dist-test-slave-qv7r"
I20260709 12:56:56.282292   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:56:56.286034   937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.286808   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:56:56.287117   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/master-0-root
uuid: "6a2cc91c2e07410da63ad16dd40dcc8c"
format_stamp: "Formatted at 2026-07-09 12:56:56 on dist-test-slave-qv7r"
I20260709 12:56:56.287418   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:56.322376   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:56.323599   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:56.363287   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:40733
I20260709 12:56:56.363435   988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:40733 every 8 connection(s)
I20260709 12:56:56.367241   989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:56.376228   989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c: Bootstrap starting.
I20260709 12:56:56.380713   989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.384711   989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c: No bootstrap required, opened a new log
I20260709 12:56:56.386777   989 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2cc91c2e07410da63ad16dd40dcc8c" member_type: VOTER }
I20260709 12:56:56.387130   989 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.387315   989 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2cc91c2e07410da63ad16dd40dcc8c, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.387885   989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2cc91c2e07410da63ad16dd40dcc8c" member_type: VOTER }
I20260709 12:56:56.388310   989 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:56:56.388504   989 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:56:56.388801   989 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.392807   989 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2cc91c2e07410da63ad16dd40dcc8c" member_type: VOTER }
I20260709 12:56:56.393293   989 leader_election.cc:304] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a2cc91c2e07410da63ad16dd40dcc8c; no voters: 
I20260709 12:56:56.394484   989 leader_election.cc:290] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:56:56.394961   992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:56.396395   992 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 1 LEADER]: Becoming Leader. State: Replica: 6a2cc91c2e07410da63ad16dd40dcc8c, State: Running, Role: LEADER
I20260709 12:56:56.397120   992 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2cc91c2e07410da63ad16dd40dcc8c" member_type: VOTER }
I20260709 12:56:56.397795   989 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:56:56.401958   993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a2cc91c2e07410da63ad16dd40dcc8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2cc91c2e07410da63ad16dd40dcc8c" member_type: VOTER } }
I20260709 12:56:56.402464   994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a2cc91c2e07410da63ad16dd40dcc8c. Latest consensus state: current_term: 1 leader_uuid: "6a2cc91c2e07410da63ad16dd40dcc8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a2cc91c2e07410da63ad16dd40dcc8c" member_type: VOTER } }
I20260709 12:56:56.402863   993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:56.403182   994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:56.411933   999 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:56:56.417258   999 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:56:56.420202   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:56:56.426380   999 catalog_manager.cc:1383] Generated new cluster ID: f1d0e11ab7544bea95680d448dc6bca8
I20260709 12:56:56.426651   999 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:56:56.467777   999 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:56:56.469112   999 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:56:56.482949   999 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c: Generated new TSK 0
I20260709 12:56:56.483567   999 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:56:56.551682   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:56.558099  1010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:56.559247  1011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:56.561192   431 server_base.cc:1061] running on GCE node
W20260709 12:56:56.561136  1013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:56.562389   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:56.562603   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:56.562829   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601816562807 us; error 0 us; skew 500 ppm
I20260709 12:56:56.563364   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:56.565871   431 webserver.cc:533] Webserver started at http://127.0.107.193:33771/ using document root <none> and password file <none>
I20260709 12:56:56.566357   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:56.566548   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:56.566826   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:56.567967   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-0-root/instance:
uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
format_stamp: "Formatted at 2026-07-09 12:56:56 on dist-test-slave-qv7r"
I20260709 12:56:56.572784   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:56:56.576584  1018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.577524   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:56:56.577883   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
format_stamp: "Formatted at 2026-07-09 12:56:56 on dist-test-slave-qv7r"
I20260709 12:56:56.578150   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:56.598068   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:56.599336   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:56.600791   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:56.603088   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:56.603282   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.603554   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:56.603765   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.646422   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39429
I20260709 12:56:56.646495  1080 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39429 every 8 connection(s)
I20260709 12:56:56.651798   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:56.660519  1086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:56.661567  1085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:56.662081  1088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:56.664239   431 server_base.cc:1061] running on GCE node
I20260709 12:56:56.665295   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:56.665545   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:56.665879   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601816665858 us; error 0 us; skew 500 ppm
I20260709 12:56:56.666510   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:56.669440   431 webserver.cc:533] Webserver started at http://127.0.107.194:40631/ using document root <none> and password file <none>
I20260709 12:56:56.669875  1081 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40733
I20260709 12:56:56.670131   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:56.670253  1081 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:56.670380   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:56.670720   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:56.671182  1081 heartbeater.cc:507] Master 127.0.107.254:40733 requested a full tablet report, sending...
I20260709 12:56:56.672196   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-1-root/instance:
uuid: "958c729a4a664752a522116a24628314"
format_stamp: "Formatted at 2026-07-09 12:56:56 on dist-test-slave-qv7r"
I20260709 12:56:56.673491   954 ts_manager.cc:194] Registered new tserver with Master: b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429)
I20260709 12:56:56.675257   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55794
I20260709 12:56:56.677065   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 12:56:56.680784  1093 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.681639   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:56:56.681945   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-1-root
uuid: "958c729a4a664752a522116a24628314"
format_stamp: "Formatted at 2026-07-09 12:56:56 on dist-test-slave-qv7r"
I20260709 12:56:56.682242   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:56.692250   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:56.693428   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:56.695139   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:56.697485   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:56.697791   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.698048   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:56.698220   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.738432   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33033
I20260709 12:56:56.738538  1155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33033 every 8 connection(s)
I20260709 12:56:56.743302   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:56.752290  1159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:56.759667  1156 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40733
I20260709 12:56:56.760289  1156 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:56.761662  1156 heartbeater.cc:507] Master 127.0.107.254:40733 requested a full tablet report, sending...
W20260709 12:56:56.765494  1160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:56.766922   954 ts_manager.cc:194] Registered new tserver with Master: 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:56.768635   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55798
I20260709 12:56:56.769990   431 server_base.cc:1061] running on GCE node
W20260709 12:56:56.772101  1162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:56.773075   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:56.773324   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:56.773500   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601816773485 us; error 0 us; skew 500 ppm
I20260709 12:56:56.774077   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:56.776486   431 webserver.cc:533] Webserver started at http://127.0.107.195:41439/ using document root <none> and password file <none>
I20260709 12:56:56.776983   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:56.777194   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:56.777453   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:56.779054   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-2-root/instance:
uuid: "96149732f3624bd899cb6d2e0d241c52"
format_stamp: "Formatted at 2026-07-09 12:56:56 on dist-test-slave-qv7r"
I20260709 12:56:56.783703   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:56:56.787482  1167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.788415   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:56:56.788681   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-2-root
uuid: "96149732f3624bd899cb6d2e0d241c52"
format_stamp: "Formatted at 2026-07-09 12:56:56 on dist-test-slave-qv7r"
I20260709 12:56:56.788915   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601802742860-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:56.833256   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:56.834554   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:56.836042   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:56.838963   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:56.839231   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.839473   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:56.839653   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:56.882324   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:37129
I20260709 12:56:56.882475  1229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:37129 every 8 connection(s)
I20260709 12:56:56.897501  1230 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40733
I20260709 12:56:56.897970  1230 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:56.898805  1230 heartbeater.cc:507] Master 127.0.107.254:40733 requested a full tablet report, sending...
I20260709 12:56:56.900843   954 ts_manager.cc:194] Registered new tserver with Master: 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:56.900960   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015119342s
I20260709 12:56:56.902295   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55802
I20260709 12:56:56.929016   954 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55804:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:56:56.931995   954 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:56:57.004604  1046 tablet_service.cc:1511] Processing CreateTablet for tablet 7406821b6f4149bf87e3e15690933ec9 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:57.011597  1043 tablet_service.cc:1511] Processing CreateTablet for tablet a0822e9e459a4969ae81632768652ea7 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:57.012221  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7406821b6f4149bf87e3e15690933ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.013041  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0822e9e459a4969ae81632768652ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.007208  1045 tablet_service.cc:1511] Processing CreateTablet for tablet a1d21deb7ff3427a8368d88a65474750 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:57.009897  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 36c8d358164f47d791b69272c0c0a68a (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:57.018132  1042 tablet_service.cc:1511] Processing CreateTablet for tablet e2662eddc6d8400ea96022e1a99b0cea (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:57.022042  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d21deb7ff3427a8368d88a65474750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.021929  1041 tablet_service.cc:1511] Processing CreateTablet for tablet a48199149e924bbdb3cbe8083e0170f6 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:57.023505  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48199149e924bbdb3cbe8083e0170f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.023551  1121 tablet_service.cc:1511] Processing CreateTablet for tablet 7406821b6f4149bf87e3e15690933ec9 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:57.025049  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7406821b6f4149bf87e3e15690933ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.027403  1040 tablet_service.cc:1511] Processing CreateTablet for tablet d376b33866624bdabc27449638e8224d (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:57.028875  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d376b33866624bdabc27449638e8224d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.038393  1039 tablet_service.cc:1511] Processing CreateTablet for tablet cb7816e4acb64a79b58fd3427442510a (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:57.039106  1120 tablet_service.cc:1511] Processing CreateTablet for tablet a1d21deb7ff3427a8368d88a65474750 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:57.040369  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d21deb7ff3427a8368d88a65474750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.040776  1038 tablet_service.cc:1511] Processing CreateTablet for tablet e2294da4651c49f5974373b1eca01c0b (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:57.032789  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c8d358164f47d791b69272c0c0a68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.043973  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2662eddc6d8400ea96022e1a99b0cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.049508  1118 tablet_service.cc:1511] Processing CreateTablet for tablet a0822e9e459a4969ae81632768652ea7 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:57.051105  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0822e9e459a4969ae81632768652ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.054020  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2294da4651c49f5974373b1eca01c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.054890  1117 tablet_service.cc:1511] Processing CreateTablet for tablet e2662eddc6d8400ea96022e1a99b0cea (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:57.056236  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2662eddc6d8400ea96022e1a99b0cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.058389  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7816e4acb64a79b58fd3427442510a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.059060  1116 tablet_service.cc:1511] Processing CreateTablet for tablet a48199149e924bbdb3cbe8083e0170f6 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:57.045908  1037 tablet_service.cc:1511] Processing CreateTablet for tablet 3547bd2c6380460a9d5c2bce3530abd5 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:57.069744  1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3547bd2c6380460a9d5c2bce3530abd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.070844  1193 tablet_service.cc:1511] Processing CreateTablet for tablet 36c8d358164f47d791b69272c0c0a68a (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:57.072233  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c8d358164f47d791b69272c0c0a68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.069763  1194 tablet_service.cc:1511] Processing CreateTablet for tablet a1d21deb7ff3427a8368d88a65474750 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:57.074777  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d21deb7ff3427a8368d88a65474750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.047720  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 36c8d358164f47d791b69272c0c0a68a (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:57.060884  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48199149e924bbdb3cbe8083e0170f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.062841  1114 tablet_service.cc:1511] Processing CreateTablet for tablet cb7816e4acb64a79b58fd3427442510a (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:57.064464  1113 tablet_service.cc:1511] Processing CreateTablet for tablet e2294da4651c49f5974373b1eca01c0b (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:57.076709  1191 tablet_service.cc:1511] Processing CreateTablet for tablet e2662eddc6d8400ea96022e1a99b0cea (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:57.066241  1115 tablet_service.cc:1511] Processing CreateTablet for tablet d376b33866624bdabc27449638e8224d (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:57.067983  1195 tablet_service.cc:1511] Processing CreateTablet for tablet 7406821b6f4149bf87e3e15690933ec9 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:57.077735  1189 tablet_service.cc:1511] Processing CreateTablet for tablet d376b33866624bdabc27449638e8224d (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:57.078168  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2662eddc6d8400ea96022e1a99b0cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.068118  1112 tablet_service.cc:1511] Processing CreateTablet for tablet 3547bd2c6380460a9d5c2bce3530abd5 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:57.081120  1190 tablet_service.cc:1511] Processing CreateTablet for tablet a48199149e924bbdb3cbe8083e0170f6 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:57.074764  1192 tablet_service.cc:1511] Processing CreateTablet for tablet a0822e9e459a4969ae81632768652ea7 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:57.079639  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7406821b6f4149bf87e3e15690933ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.084362  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48199149e924bbdb3cbe8083e0170f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.086771  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0822e9e459a4969ae81632768652ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.093734  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c8d358164f47d791b69272c0c0a68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.094101  1187 tablet_service.cc:1511] Processing CreateTablet for tablet e2294da4651c49f5974373b1eca01c0b (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:57.095505  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d376b33866624bdabc27449638e8224d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.101073  1188 tablet_service.cc:1511] Processing CreateTablet for tablet cb7816e4acb64a79b58fd3427442510a (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:57.104490  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2294da4651c49f5974373b1eca01c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.105062  1186 tablet_service.cc:1511] Processing CreateTablet for tablet 3547bd2c6380460a9d5c2bce3530abd5 (DEFAULT_TABLE table=test-workload [id=a79785dc03ca4e9880e44a0973efa904]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:57.109968  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7816e4acb64a79b58fd3427442510a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.111644  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3547bd2c6380460a9d5c2bce3530abd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.118867  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3547bd2c6380460a9d5c2bce3530abd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.121917  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2294da4651c49f5974373b1eca01c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.124342  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7816e4acb64a79b58fd3427442510a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.133915  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d376b33866624bdabc27449638e8224d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.190387  1244 tablet_bootstrap.cc:492] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.191243  1246 tablet_bootstrap.cc:492] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.198616  1244 tablet_bootstrap.cc:654] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.207433  1246 tablet_bootstrap.cc:654] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.214094  1245 tablet_bootstrap.cc:492] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.232556  1245 tablet_bootstrap.cc:654] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.236598  1244 tablet_bootstrap.cc:492] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.237139  1244 ts_tablet_manager.cc:1403] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.027s
I20260709 12:56:57.238271  1246 tablet_bootstrap.cc:492] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.238750  1246 ts_tablet_manager.cc:1403] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.004s
I20260709 12:56:57.240355  1244 raft_consensus.cc:359] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.241204  1244 raft_consensus.cc:385] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.241588  1244 raft_consensus.cc:740] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.241549  1246 raft_consensus.cc:359] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.242457  1246 raft_consensus.cc:385] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.243728  1246 raft_consensus.cc:740] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.245190  1244 consensus_queue.cc:260] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.245429  1246 consensus_queue.cc:260] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.247210  1249 raft_consensus.cc:493] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.248081  1249 raft_consensus.cc:515] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.251031  1249 leader_election.cc:290] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.253032  1156 heartbeater.cc:499] Master 127.0.107.254:40733 was elected leader, sending a full tablet report...
I20260709 12:56:57.253991  1230 heartbeater.cc:499] Master 127.0.107.254:40733 was elected leader, sending a full tablet report...
I20260709 12:56:57.260594  1246 ts_tablet_manager.cc:1434] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:56:57.261919  1246 tablet_bootstrap.cc:492] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.270866  1246 tablet_bootstrap.cc:654] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.281999  1245 tablet_bootstrap.cc:492] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.282543  1245 ts_tablet_manager.cc:1403] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.069s	user 0.004s	sys 0.008s
I20260709 12:56:57.293637  1244 ts_tablet_manager.cc:1434] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.056s	user 0.028s	sys 0.024s
I20260709 12:56:57.295439  1244 tablet_bootstrap.cc:492] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.296700  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
I20260709 12:56:57.299244  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
W20260709 12:56:57.301365  1096 leader_election.cc:343] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:57.302244  1096 leader_election.cc:343] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.302695  1096 leader_election.cc:304] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 958c729a4a664752a522116a24628314; no voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:57.303592  1252 raft_consensus.cc:2749] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.305814  1244 tablet_bootstrap.cc:654] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.309243  1245 raft_consensus.cc:359] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.310200  1245 raft_consensus.cc:385] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.310524  1245 raft_consensus.cc:740] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.311398  1245 consensus_queue.cc:260] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.316097  1244 tablet_bootstrap.cc:492] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.316741  1244 ts_tablet_manager.cc:1403] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:56:57.318056  1246 tablet_bootstrap.cc:492] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.318568  1246 ts_tablet_manager.cc:1403] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.057s	user 0.033s	sys 0.020s
I20260709 12:56:57.320075  1244 raft_consensus.cc:359] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.320972  1244 raft_consensus.cc:385] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.321084  1245 ts_tablet_manager.cc:1434] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.006s
I20260709 12:56:57.321394  1244 raft_consensus.cc:740] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.322171  1081 heartbeater.cc:499] Master 127.0.107.254:40733 was elected leader, sending a full tablet report...
I20260709 12:56:57.321805  1246 raft_consensus.cc:359] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.322834  1245 tablet_bootstrap.cc:492] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.322790  1246 raft_consensus.cc:385] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.322566  1244 consensus_queue.cc:260] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.323369  1246 raft_consensus.cc:740] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.324416  1246 consensus_queue.cc:260] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.325381  1244 ts_tablet_manager.cc:1434] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:56:57.326489  1244 tablet_bootstrap.cc:492] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.327165  1246 ts_tablet_manager.cc:1434] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:56:57.328203  1246 tablet_bootstrap.cc:492] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.333841  1244 tablet_bootstrap.cc:654] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.335335  1246 tablet_bootstrap.cc:654] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.342708  1245 tablet_bootstrap.cc:654] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.344301  1244 tablet_bootstrap.cc:492] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.344832  1244 ts_tablet_manager.cc:1403] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:56:57.348222  1244 raft_consensus.cc:359] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.348968  1244 raft_consensus.cc:385] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.349311  1246 tablet_bootstrap.cc:492] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.349298  1244 raft_consensus.cc:740] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.349808  1245 tablet_bootstrap.cc:492] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.349915  1246 ts_tablet_manager.cc:1403] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.006s
I20260709 12:56:57.350306  1245 ts_tablet_manager.cc:1403] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.006s
I20260709 12:56:57.350291  1244 consensus_queue.cc:260] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.352862  1246 raft_consensus.cc:359] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.353197  1245 raft_consensus.cc:359] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.353614  1246 raft_consensus.cc:385] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.353892  1245 raft_consensus.cc:385] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.353927  1246 raft_consensus.cc:740] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.354311  1245 raft_consensus.cc:740] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.354526  1244 ts_tablet_manager.cc:1434] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:56:57.356446  1244 tablet_bootstrap.cc:492] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.354868  1246 consensus_queue.cc:260] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.355999  1245 consensus_queue.cc:260] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.357966  1256 raft_consensus.cc:493] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.358465  1256 raft_consensus.cc:515] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.359015  1246 ts_tablet_manager.cc:1434] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:56:57.359967  1246 tablet_bootstrap.cc:492] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.363405  1244 tablet_bootstrap.cc:654] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.367393  1246 tablet_bootstrap.cc:654] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.374037  1256 leader_election.cc:290] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.378997  1244 tablet_bootstrap.cc:492] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.379503  1244 ts_tablet_manager.cc:1403] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 12:56:57.380349  1246 tablet_bootstrap.cc:492] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.380857  1246 ts_tablet_manager.cc:1403] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.003s
I20260709 12:56:57.382329  1244 raft_consensus.cc:359] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.383076  1244 raft_consensus.cc:385] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.383399  1244 raft_consensus.cc:740] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.383819  1246 raft_consensus.cc:359] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.384603  1246 raft_consensus.cc:385] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.384398  1244 consensus_queue.cc:260] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.384940  1246 raft_consensus.cc:740] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.385923  1246 consensus_queue.cc:260] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.390892  1246 ts_tablet_manager.cc:1434] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:56:57.392030  1246 tablet_bootstrap.cc:492] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.392413  1244 ts_tablet_manager.cc:1434] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:56:57.399214  1246 tablet_bootstrap.cc:654] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.402163  1244 tablet_bootstrap.cc:492] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.402364  1245 ts_tablet_manager.cc:1434] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.052s	user 0.014s	sys 0.023s
I20260709 12:56:57.409967  1245 tablet_bootstrap.cc:492] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.410409  1244 tablet_bootstrap.cc:654] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:57.416092  1002 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:57.419690  1246 tablet_bootstrap.cc:492] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.420723  1246 ts_tablet_manager.cc:1403] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 12:56:57.424383  1245 tablet_bootstrap.cc:654] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.424883  1250 raft_consensus.cc:493] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.424769  1246 raft_consensus.cc:359] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.425519  1250 raft_consensus.cc:515] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.426139  1246 raft_consensus.cc:385] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.426697  1246 raft_consensus.cc:740] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.428048  1250 leader_election.cc:290] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.427829  1246 consensus_queue.cc:260] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.430519  1252 raft_consensus.cc:493] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.430982  1252 raft_consensus.cc:515] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.433137  1252 leader_election.cc:290] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.433516  1246 ts_tablet_manager.cc:1434] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:56:57.434610  1246 tablet_bootstrap.cc:492] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.437158  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
I20260709 12:56:57.437681  1244 tablet_bootstrap.cc:492] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.437855  1205 raft_consensus.cc:2468] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 0.
I20260709 12:56:57.438211  1244 ts_tablet_manager.cc:1403] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.012s
I20260709 12:56:57.439277  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
I20260709 12:56:57.440598  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.441368  1131 raft_consensus.cc:2468] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 0.
I20260709 12:56:57.441361  1244 raft_consensus.cc:359] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.442323  1244 raft_consensus.cc:385] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.442649  1244 raft_consensus.cc:740] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.442942  1021 leader_election.cc:304] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.442955  1096 leader_election.cc:304] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: 
I20260709 12:56:57.443544  1244 consensus_queue.cc:260] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.444252  1260 raft_consensus.cc:2804] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.444541  1260 raft_consensus.cc:493] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.444748  1260 raft_consensus.cc:3060] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.444869  1249 raft_consensus.cc:2804] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.445245  1249 raft_consensus.cc:493] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.445604  1249 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:57.449906  1096 leader_election.cc:343] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.453006  1249 raft_consensus.cc:515] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.454093  1260 raft_consensus.cc:515] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.453759  1244 ts_tablet_manager.cc:1434] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:56:57.456359  1244 tablet_bootstrap.cc:492] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.458252  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
W20260709 12:56:57.463485  1021 leader_election.cc:343] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.458482  1245 tablet_bootstrap.cc:492] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.464568  1245 ts_tablet_manager.cc:1403] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.000s
I20260709 12:56:57.465679  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:57.458949  1246 tablet_bootstrap.cc:654] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.459196  1260 leader_election.cc:290] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Requested vote from peers 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.460099  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:57.461596  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314"
W20260709 12:56:57.467175  1096 leader_election.cc:343] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.468359  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
I20260709 12:56:57.468576  1131 raft_consensus.cc:3060] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.470095  1249 leader_election.cc:290] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
W20260709 12:56:57.470124  1170 leader_election.cc:343] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.471155  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:57.471793  1204 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:57.473905  1021 leader_election.cc:343] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.476006  1245 raft_consensus.cc:359] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.476468  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.476766  1245 raft_consensus.cc:385] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.477095  1245 raft_consensus.cc:740] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.477433  1130 raft_consensus.cc:2393] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96149732f3624bd899cb6d2e0d241c52 in current term 1: Already voted for candidate 958c729a4a664752a522116a24628314 in this term.
I20260709 12:56:57.478001  1245 consensus_queue.cc:260] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.478907  1204 raft_consensus.cc:2468] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 1.
I20260709 12:56:57.479136  1170 leader_election.cc:304] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52; no voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:57.480111  1096 leader_election.cc:304] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:57.480412  1245 ts_tablet_manager.cc:1434] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:56:57.475019  1131 raft_consensus.cc:2468] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 1.
I20260709 12:56:57.480208  1250 raft_consensus.cc:2749] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.481341  1249 raft_consensus.cc:2804] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.481855  1249 raft_consensus.cc:697] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Becoming Leader. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:56:57.482729  1249 consensus_queue.cc:237] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.483563  1021 leader_election.cc:304] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 96149732f3624bd899cb6d2e0d241c52
I20260709 12:56:57.471431  1244 tablet_bootstrap.cc:654] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.486128  1260 raft_consensus.cc:2804] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.486996  1260 raft_consensus.cc:697] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:56:57.488104  1260 consensus_queue.cc:237] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.489192  1245 tablet_bootstrap.cc:492] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.498387  1245 tablet_bootstrap.cc:654] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.499193  1246 tablet_bootstrap.cc:492] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.499815  1246 ts_tablet_manager.cc:1403] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.025s
I20260709 12:56:57.502231  1244 tablet_bootstrap.cc:492] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.502758  1244 ts_tablet_manager.cc:1403] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 12:56:57.503856  1246 raft_consensus.cc:359] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.504614  1246 raft_consensus.cc:385] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.505046  1246 raft_consensus.cc:740] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.505810  1244 raft_consensus.cc:359] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.506551  1244 raft_consensus.cc:385] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.506127  1246 consensus_queue.cc:260] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.508880  1246 ts_tablet_manager.cc:1434] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:56:57.510102  1246 tablet_bootstrap.cc:492] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.506870  1244 raft_consensus.cc:740] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.511080  1244 consensus_queue.cc:260] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.510823   951 catalog_manager.cc:5697] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 reported cstate change: term changed from 0 to 1, leader changed from <none> to 958c729a4a664752a522116a24628314 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "958c729a4a664752a522116a24628314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.514308  1244 ts_tablet_manager.cc:1434] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:56:57.517824   954 catalog_manager.cc:5697] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.525094  1244 tablet_bootstrap.cc:492] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.523742  1246 tablet_bootstrap.cc:654] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.527755  1245 tablet_bootstrap.cc:492] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.528236  1245 ts_tablet_manager.cc:1403] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.011s
I20260709 12:56:57.531951  1245 raft_consensus.cc:359] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.532943  1245 raft_consensus.cc:385] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.533324  1245 raft_consensus.cc:740] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.534148  1244 tablet_bootstrap.cc:654] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.534188  1245 consensus_queue.cc:260] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.535070  1249 raft_consensus.cc:493] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.535756  1249 raft_consensus.cc:515] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.538105  1245 ts_tablet_manager.cc:1434] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.008s
I20260709 12:56:57.540057  1245 tablet_bootstrap.cc:492] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.540623  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
W20260709 12:56:57.542850  1096 leader_election.cc:343] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.544310  1249 leader_election.cc:290] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.546465  1260 raft_consensus.cc:493] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.546656  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
I20260709 12:56:57.547050  1260 raft_consensus.cc:515] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
W20260709 12:56:57.548233  1096 leader_election.cc:343] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.548792  1096 leader_election.cc:304] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 958c729a4a664752a522116a24628314; no voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:57.549461  1260 leader_election.cc:290] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.549700  1249 raft_consensus.cc:2749] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.551787  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.551898  1246 tablet_bootstrap.cc:492] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.552783  1246 ts_tablet_manager.cc:1403] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.010s
I20260709 12:56:57.553539  1131 raft_consensus.cc:2468] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 0.
I20260709 12:56:57.552047  1245 tablet_bootstrap.cc:654] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.555166  1021 leader_election.cc:304] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.552688  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
W20260709 12:56:57.556965  1021 leader_election.cc:343] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.557988  1260 raft_consensus.cc:2804] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.557982  1246 raft_consensus.cc:359] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.558763  1260 raft_consensus.cc:493] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.559299  1246 raft_consensus.cc:385] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.559352  1260 raft_consensus.cc:3060] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.559873  1246 raft_consensus.cc:740] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.560989  1246 consensus_queue.cc:260] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.560221  1249 raft_consensus.cc:493] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.562454  1249 raft_consensus.cc:515] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.564641  1249 leader_election.cc:290] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.566761  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376b33866624bdabc27449638e8224d" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
I20260709 12:56:57.567487  1056 raft_consensus.cc:2468] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 0.
I20260709 12:56:57.568086  1246 ts_tablet_manager.cc:1434] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 12:56:57.569375  1246 tablet_bootstrap.cc:492] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.569387  1096 leader_election.cc:304] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.569480  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376b33866624bdabc27449638e8224d" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
I20260709 12:56:57.570538  1204 raft_consensus.cc:2468] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 0.
I20260709 12:56:57.571375  1244 tablet_bootstrap.cc:492] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.571873  1244 ts_tablet_manager.cc:1403] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.011s
I20260709 12:56:57.570560  1249 raft_consensus.cc:2804] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.574079  1249 raft_consensus.cc:493] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.574630  1249 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.574120  1260 raft_consensus.cc:515] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.577553  1246 tablet_bootstrap.cc:654] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.577756  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:57.578508  1131 raft_consensus.cc:3060] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.581405  1244 raft_consensus.cc:359] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.584350  1244 raft_consensus.cc:385] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.584782  1244 raft_consensus.cc:740] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.588203  1131 raft_consensus.cc:2468] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 1.
I20260709 12:56:57.588758  1244 consensus_queue.cc:260] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.590168  1021 leader_election.cc:304] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.591391  1256 raft_consensus.cc:2804] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.592561  1244 ts_tablet_manager.cc:1434] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:56:57.588068  1249 raft_consensus.cc:515] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.597340  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376b33866624bdabc27449638e8224d" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:57.598158  1056 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.607407  1256 raft_consensus.cc:697] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:56:57.607692  1056 raft_consensus.cc:2468] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 1.
I20260709 12:56:57.608868  1096 leader_election.cc:304] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.609727  1252 raft_consensus.cc:2804] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.612509  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376b33866624bdabc27449638e8224d" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:57.613313  1204 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.613445  1260 leader_election.cc:290] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.618703  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
W20260709 12:56:57.620851  1021 leader_election.cc:343] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.622411  1245 tablet_bootstrap.cc:492] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.623063  1245 ts_tablet_manager.cc:1403] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.009s
I20260709 12:56:57.625710  1249 leader_election.cc:290] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.626969  1244 tablet_bootstrap.cc:492] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.627043  1245 raft_consensus.cc:359] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.628244  1245 raft_consensus.cc:385] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.628649  1245 raft_consensus.cc:740] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.629817  1256 consensus_queue.cc:237] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.636400  1204 raft_consensus.cc:2468] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 1.
I20260709 12:56:57.646260  1245 consensus_queue.cc:260] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.647830  1244 tablet_bootstrap.cc:654] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.649124  1245 ts_tablet_manager.cc:1434] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 12:56:57.650497  1245 tablet_bootstrap.cc:492] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.650538  1252 raft_consensus.cc:697] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Becoming Leader. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:56:57.653724  1252 consensus_queue.cc:237] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.656342  1250 raft_consensus.cc:493] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.657675  1246 tablet_bootstrap.cc:492] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.657234  1250 raft_consensus.cc:515] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.659911  1250 leader_election.cc:290] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.660892   953 catalog_manager.cc:5697] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.663101  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.663964  1245 tablet_bootstrap.cc:654] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:57.665059  1170 leader_election.cc:343] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 958c729a4a664752a522116a24628314 (127.0.107.194:33033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.666316  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
W20260709 12:56:57.668118  1170 leader_election.cc:343] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.668690  1170 leader_election.cc:304] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52; no voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:57.670127  1250 raft_consensus.cc:2749] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.671476  1246 ts_tablet_manager.cc:1403] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.045s
I20260709 12:56:57.674986  1246 raft_consensus.cc:359] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.675836  1246 raft_consensus.cc:385] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.675920  1256 raft_consensus.cc:493] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.676182  1246 raft_consensus.cc:740] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.676388  1256 raft_consensus.cc:515] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.676982  1246 consensus_queue.cc:260] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:56:57.678694  1256 leader_election.cc:290] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.680305  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.680727  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
I20260709 12:56:57.680997  1131 raft_consensus.cc:2468] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 0.
I20260709 12:56:57.681368  1204 raft_consensus.cc:2468] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 0.
I20260709 12:56:57.682394  1021 leader_election.cc:304] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.683214  1256 raft_consensus.cc:2804] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.683586  1256 raft_consensus.cc:493] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.683941  1256 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.684675  1245 tablet_bootstrap.cc:492] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.685178  1245 ts_tablet_manager.cc:1403] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.006s
I20260709 12:56:57.688498  1245 raft_consensus.cc:359] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.688180   952 catalog_manager.cc:5697] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 reported cstate change: term changed from 0 to 1, leader changed from <none> to 958c729a4a664752a522116a24628314 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "958c729a4a664752a522116a24628314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.689250  1245 raft_consensus.cc:385] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.691777  1244 tablet_bootstrap.cc:492] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.691952  1256 raft_consensus.cc:515] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.692489  1245 raft_consensus.cc:740] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.692735  1244 ts_tablet_manager.cc:1403] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.008s
I20260709 12:56:57.693531  1245 consensus_queue.cc:260] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.694782  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:57.695314  1131 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.695534  1244 raft_consensus.cc:359] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.696229  1244 raft_consensus.cc:385] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.696506  1244 raft_consensus.cc:740] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.697227  1244 consensus_queue.cc:260] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.698770  1250 raft_consensus.cc:493] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.699441  1244 ts_tablet_manager.cc:1434] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:56:57.699213  1250 raft_consensus.cc:515] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.700397  1244 tablet_bootstrap.cc:492] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.701310  1250 leader_election.cc:290] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.702418  1131 raft_consensus.cc:2468] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 1.
I20260709 12:56:57.702872  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
I20260709 12:56:57.703537  1021 leader_election.cc:304] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.704203  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
W20260709 12:56:57.706207  1170 leader_election.cc:343] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 958c729a4a664752a522116a24628314 (127.0.107.194:33033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.706380  1246 ts_tablet_manager.cc:1434] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:56:57.705345  1260 raft_consensus.cc:2804] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.707156  1260 raft_consensus.cc:697] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:56:57.707661  1244 tablet_bootstrap.cc:654] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.708127  1260 consensus_queue.cc:237] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.710031  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:57.710758  1204 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.703567  1056 raft_consensus.cc:2468] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 0.
I20260709 12:56:57.712687  1170 leader_election.cc:304] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 958c729a4a664752a522116a24628314
I20260709 12:56:57.714289  1250 raft_consensus.cc:2804] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.714830  1250 raft_consensus.cc:493] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.715301  1250 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.718056  1204 raft_consensus.cc:2468] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 1.
I20260709 12:56:57.719244  1246 tablet_bootstrap.cc:492] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
I20260709 12:56:57.719527  1256 leader_election.cc:290] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.724874  1246 tablet_bootstrap.cc:654] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.730348  1245 ts_tablet_manager.cc:1434] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.007s
I20260709 12:56:57.731876  1245 tablet_bootstrap.cc:492] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.732893   954 catalog_manager.cc:5697] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.738831  1250 raft_consensus.cc:515] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.740552  1244 tablet_bootstrap.cc:492] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.741115  1244 ts_tablet_manager.cc:1403] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.015s
I20260709 12:56:57.742002  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:57.742626  1056 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.743916  1244 raft_consensus.cc:359] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.742147  1245 tablet_bootstrap.cc:654] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.744573  1244 raft_consensus.cc:385] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.748306  1244 raft_consensus.cc:740] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.749039  1244 consensus_queue.cc:260] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.749637  1056 raft_consensus.cc:2468] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 1.
I20260709 12:56:57.750357  1250 leader_election.cc:290] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.751179  1170 leader_election.cc:304] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.752069  1250 raft_consensus.cc:2804] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.754346  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:57.755139  1130 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.751412  1244 ts_tablet_manager.cc:1434] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:56:57.766911  1244 tablet_bootstrap.cc:492] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314: Bootstrap starting.
I20260709 12:56:57.775615  1244 tablet_bootstrap.cc:654] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.777712  1130 raft_consensus.cc:2468] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 1.
I20260709 12:56:57.780956  1246 tablet_bootstrap.cc:492] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.781442  1246 ts_tablet_manager.cc:1403] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.021s
I20260709 12:56:57.779542  1250 raft_consensus.cc:697] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Becoming Leader. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:56:57.782924  1250 consensus_queue.cc:237] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.784420  1246 raft_consensus.cc:359] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.785089  1246 raft_consensus.cc:385] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.785385  1246 raft_consensus.cc:740] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.786067  1246 consensus_queue.cc:260] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.790558  1245 tablet_bootstrap.cc:492] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.791322  1245 ts_tablet_manager.cc:1403] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.019s
I20260709 12:56:57.795341  1245 raft_consensus.cc:359] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.797626  1245 raft_consensus.cc:385] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.798146  1245 raft_consensus.cc:740] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.797170  1292 raft_consensus.cc:493] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.799834  1292 raft_consensus.cc:515] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.803630  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2294da4651c49f5974373b1eca01c0b" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
I20260709 12:56:57.804144  1292 leader_election.cc:290] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.804440  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2294da4651c49f5974373b1eca01c0b" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.799175  1245 consensus_queue.cc:260] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
W20260709 12:56:57.805016  1170 leader_election.cc:343] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.805303  1130 raft_consensus.cc:2468] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 0.
I20260709 12:56:57.807193  1170 leader_election.cc:304] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:57.807675  1245 ts_tablet_manager.cc:1434] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:56:57.808557  1292 raft_consensus.cc:2804] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.808817  1245 tablet_bootstrap.cc:492] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.808959  1292 raft_consensus.cc:493] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.809455  1292 raft_consensus.cc:3060] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.818750  1245 tablet_bootstrap.cc:654] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.818548  1292 raft_consensus.cc:515] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.818907   954 catalog_manager.cc:5697] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "96149732f3624bd899cb6d2e0d241c52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:57.821676  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2294da4651c49f5974373b1eca01c0b" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:57.822449  1292 leader_election.cc:290] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.824251  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2294da4651c49f5974373b1eca01c0b" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:57.824782  1130 raft_consensus.cc:3060] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.824793  1246 ts_tablet_manager.cc:1434] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.043s	user 0.013s	sys 0.014s
I20260709 12:56:57.825701  1244 tablet_bootstrap.cc:492] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314: No bootstrap required, opened a new log
I20260709 12:56:57.825908  1246 tablet_bootstrap.cc:492] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52: Bootstrap starting.
W20260709 12:56:57.825778  1170 leader_election.cc:343] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.826191  1244 ts_tablet_manager.cc:1403] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.012s
I20260709 12:56:57.831357  1244 raft_consensus.cc:359] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.833182  1244 raft_consensus.cc:385] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.833252  1130 raft_consensus.cc:2468] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 1.
I20260709 12:56:57.833528  1244 raft_consensus.cc:740] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.834275  1244 consensus_queue.cc:260] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.834638  1170 leader_election.cc:304] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:57.837154  1244 ts_tablet_manager.cc:1434] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:56:57.837613  1292 raft_consensus.cc:2804] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.839322  1292 raft_consensus.cc:697] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Becoming Leader. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:56:57.840363  1292 consensus_queue.cc:237] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.842051  1246 tablet_bootstrap.cc:654] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.844205  1245 tablet_bootstrap.cc:492] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.844885  1245 ts_tablet_manager.cc:1403] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.006s
I20260709 12:56:57.848531  1294 raft_consensus.cc:493] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.848894  1245 raft_consensus.cc:359] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.849058  1294 raft_consensus.cc:515] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.849690  1245 raft_consensus.cc:385] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.849982  1245 raft_consensus.cc:740] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.850838  1245 consensus_queue.cc:260] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.851303  1294 leader_election.cc:290] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.853260  1245 ts_tablet_manager.cc:1434] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:56:57.853281  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.854351  1130 raft_consensus.cc:2393] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96149732f3624bd899cb6d2e0d241c52 in current term 1: Already voted for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in this term.
I20260709 12:56:57.854534  1245 tablet_bootstrap.cc:492] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.855654  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
I20260709 12:56:57.856432  1246 tablet_bootstrap.cc:492] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52: No bootstrap required, opened a new log
I20260709 12:56:57.856896  1246 ts_tablet_manager.cc:1403] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.005s
I20260709 12:56:57.857229  1170 leader_election.cc:304] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52; no voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:57.858644  1250 raft_consensus.cc:3060] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.859998  1246 raft_consensus.cc:359] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.860788  1246 raft_consensus.cc:385] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.860898  1245 tablet_bootstrap.cc:654] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.861104  1246 raft_consensus.cc:740] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.862123  1246 consensus_queue.cc:260] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.864638  1246 ts_tablet_manager.cc:1434] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:56:57.868257  1245 tablet_bootstrap.cc:492] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.868381  1250 raft_consensus.cc:2749] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.868781  1245 ts_tablet_manager.cc:1403] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 12:56:57.871533  1245 raft_consensus.cc:359] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.872265  1245 raft_consensus.cc:385] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.872550  1245 raft_consensus.cc:740] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.873224  1245 consensus_queue.cc:260] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.875770  1245 ts_tablet_manager.cc:1434] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:56:57.876785  1245 tablet_bootstrap.cc:492] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046: Bootstrap starting.
I20260709 12:56:57.876732   954 catalog_manager.cc:5697] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "96149732f3624bd899cb6d2e0d241c52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:57.883838  1245 tablet_bootstrap.cc:654] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.889433  1245 tablet_bootstrap.cc:492] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046: No bootstrap required, opened a new log
I20260709 12:56:57.889351  1252 raft_consensus.cc:493] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.890038  1245 ts_tablet_manager.cc:1403] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:56:57.890024  1252 raft_consensus.cc:515] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.892238  1252 leader_election.cc:290] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.892900  1245 raft_consensus.cc:359] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.893280  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
I20260709 12:56:57.893603  1245 raft_consensus.cc:385] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.893910  1245 raft_consensus.cc:740] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.893916  1056 raft_consensus.cc:2468] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 0.
I20260709 12:56:57.894649  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
I20260709 12:56:57.894667  1245 consensus_queue.cc:260] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.895373  1204 raft_consensus.cc:2468] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 0.
I20260709 12:56:57.896821  1245 ts_tablet_manager.cc:1434] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:56:57.896821  1096 leader_election.cc:304] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: 
I20260709 12:56:57.898321  1252 raft_consensus.cc:2804] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.898684  1252 raft_consensus.cc:493] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.899210  1252 raft_consensus.cc:3060] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.905604  1252 raft_consensus.cc:515] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.907635  1252 leader_election.cc:290] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.909027  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:57.909173  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:57.909658  1204 raft_consensus.cc:3060] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.909761  1056 raft_consensus.cc:3060] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.914168  1056 raft_consensus.cc:2468] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 1.
I20260709 12:56:57.914188  1204 raft_consensus.cc:2468] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 1.
I20260709 12:56:57.915323  1096 leader_election.cc:304] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.915954  1252 raft_consensus.cc:2804] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.916422  1252 raft_consensus.cc:697] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Becoming Leader. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:56:57.917207  1252 consensus_queue.cc:237] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.919955  1292 raft_consensus.cc:493] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.920521  1292 raft_consensus.cc:515] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.922309  1292 leader_election.cc:290] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.923297  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" is_pre_election: true
I20260709 12:56:57.923467  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.924062  1056 raft_consensus.cc:2468] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 0.
I20260709 12:56:57.924082  1130 raft_consensus.cc:2468] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 0.
I20260709 12:56:57.925273  1170 leader_election.cc:304] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.925413   954 catalog_manager.cc:5697] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 reported cstate change: term changed from 0 to 1, leader changed from <none> to 958c729a4a664752a522116a24628314 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "958c729a4a664752a522116a24628314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.926060  1292 raft_consensus.cc:2804] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.926491  1292 raft_consensus.cc:493] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.926837  1292 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.932480  1292 raft_consensus.cc:515] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.934453  1292 leader_election.cc:290] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:57.935159  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:57.935425  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:57.935647  1056 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.936096  1130 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.940927  1130 raft_consensus.cc:2468] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 1.
I20260709 12:56:57.941318  1056 raft_consensus.cc:2468] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 1.
I20260709 12:56:57.942220  1170 leader_election.cc:304] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: 
I20260709 12:56:57.942917  1292 raft_consensus.cc:2804] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.943320  1292 raft_consensus.cc:697] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Becoming Leader. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:56:57.944334  1292 consensus_queue.cc:237] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.951926   954 catalog_manager.cc:5697] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "96149732f3624bd899cb6d2e0d241c52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:57.978744  1260 raft_consensus.cc:493] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.979277  1260 raft_consensus.cc:515] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.981036  1260 leader_election.cc:290] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.982070  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314" is_pre_election: true
I20260709 12:56:57.982324  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52" is_pre_election: true
I20260709 12:56:57.982726  1130 raft_consensus.cc:2468] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 0.
I20260709 12:56:57.982961  1204 raft_consensus.cc:2468] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 0.
I20260709 12:56:57.983798  1021 leader_election.cc:304] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:57.984444  1260 raft_consensus.cc:2804] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.984787  1260 raft_consensus.cc:493] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.985105  1260 raft_consensus.cc:3060] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.989532  1260 raft_consensus.cc:515] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:57.991253  1260 leader_election.cc:290] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:57.991989  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:57.992236  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:57.992584  1130 raft_consensus.cc:3060] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.992719  1204 raft_consensus.cc:3060] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.999555  1130 raft_consensus.cc:2468] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 1.
I20260709 12:56:57.999555  1204 raft_consensus.cc:2468] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 1.
I20260709 12:56:58.000921  1021 leader_election.cc:304] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:58.001644  1260 raft_consensus.cc:2804] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.002116  1260 raft_consensus.cc:697] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:56:58.002905  1260 consensus_queue.cc:237] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.010706   954 catalog_manager.cc:5697] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.026503  1252 consensus_queue.cc:1048] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.031873  1056 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.041360  1252 consensus_queue.cc:1048] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.047118  1204 raft_consensus.cc:3060] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.054461  1256 consensus_queue.cc:1048] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.061740  1252 consensus_queue.cc:1048] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.066928  1282 consensus_queue.cc:1048] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:58.081032  1283 consensus_queue.cc:1048] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.135622  1282 consensus_queue.cc:1048] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.142022  1282 consensus_queue.cc:1048] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.147804  1256 consensus_queue.cc:1048] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.163990  1260 consensus_queue.cc:1048] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.183174  1292 consensus_queue.cc:1048] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.192243  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
mode: GRACEFUL
new_leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:46370
I20260709 12:56:58.193034  1204 raft_consensus.cc:606] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Received request to transfer leadership to TS b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:58.196519  1296 consensus_queue.cc:1048] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:58.220198  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea"
dest_uuid: "958c729a4a664752a522116a24628314"
mode: GRACEFUL
new_leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:55672
I20260709 12:56:58.220955  1130 raft_consensus.cc:606] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Received request to transfer leadership to TS b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:58.232534  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
mode: GRACEFUL
new_leader_uuid: "958c729a4a664752a522116a24628314"
 from {username='slave'} at 127.0.0.1:46370
I20260709 12:56:58.233088  1204 raft_consensus.cc:606] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Received request to transfer leadership to TS 958c729a4a664752a522116a24628314
I20260709 12:56:58.239573  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2294da4651c49f5974373b1eca01c0b"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
mode: GRACEFUL
new_leader_uuid: "958c729a4a664752a522116a24628314"
 from {username='slave'} at 127.0.0.1:46370
I20260709 12:56:58.240252  1204 raft_consensus.cc:606] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Received request to transfer leadership to TS 958c729a4a664752a522116a24628314
I20260709 12:56:58.254446  1056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
mode: GRACEFUL
new_leader_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:52322
I20260709 12:56:58.255053  1056 raft_consensus.cc:606] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Received request to transfer leadership to TS 96149732f3624bd899cb6d2e0d241c52
I20260709 12:56:58.271363  1296 consensus_queue.cc:1048] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.278282  1294 raft_consensus.cc:993] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52: : Instructing follower 958c729a4a664752a522116a24628314 to start an election
I20260709 12:56:58.278776  1250 raft_consensus.cc:1081] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Signalling peer 958c729a4a664752a522116a24628314 to start an election
I20260709 12:56:58.280527  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2294da4651c49f5974373b1eca01c0b"
dest_uuid: "958c729a4a664752a522116a24628314"
 from {username='slave'} at 127.0.0.1:55668
I20260709 12:56:58.281819  1131 raft_consensus.cc:493] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:58.282236  1131 raft_consensus.cc:3060] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.283748  1056 raft_consensus.cc:3060] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.289755  1131 raft_consensus.cc:515] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.292505  1131 leader_election.cc:290] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 2 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:58.293493  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2294da4651c49f5974373b1eca01c0b" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:58.293880  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2294da4651c49f5974373b1eca01c0b" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:58.294513  1204 raft_consensus.cc:3055] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:58.294848  1204 raft_consensus.cc:740] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:56:58.295349  1294 consensus_queue.cc:1048] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.296425  1204 consensus_queue.cc:260] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.301025  1204 raft_consensus.cc:3060] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.307694  1204 raft_consensus.cc:2468] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 2.
I20260709 12:56:58.308768  1096 leader_election.cc:304] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:56:58.309633  1283 raft_consensus.cc:2804] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:58.310117  1283 raft_consensus.cc:697] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Becoming Leader. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:56:58.310827  1283 consensus_queue.cc:237] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.317662   953 catalog_manager.cc:5697] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 reported cstate change: term changed from 1 to 2, leader changed from 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195) to 958c729a4a664752a522116a24628314 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "958c729a4a664752a522116a24628314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.360565  1283 consensus_queue.cc:1048] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.371881  1252 consensus_queue.cc:1048] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.510046  1294 consensus_queue.cc:1048] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.513654  1252 raft_consensus.cc:993] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314: : Instructing follower b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:56:58.514163  1283 raft_consensus.cc:1081] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Signalling peer b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:56:58.516130  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:52298
I20260709 12:56:58.516836  1055 raft_consensus.cc:493] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:58.518290  1250 raft_consensus.cc:993] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: : Instructing follower b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:56:58.518730  1250 raft_consensus.cc:1081] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Signalling peer b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:56:58.521588  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:56:58.522675  1053 raft_consensus.cc:493] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:58.523034  1053 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.517342  1055 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.526513  1296 consensus_queue.cc:1048] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.530339  1053 raft_consensus.cc:515] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.531718  1055 raft_consensus.cc:515] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.533803  1055 leader_election.cc:290] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 2 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:58.535408  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:58.535964  1053 leader_election.cc:290] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 2 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:58.536055  1130 raft_consensus.cc:3055] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:58.536592  1130 raft_consensus.cc:740] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:56:58.537508  1130 consensus_queue.cc:260] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.538547  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:58.538873  1130 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.539111  1204 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.542450  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:58.543104  1205 raft_consensus.cc:3055] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:58.543430  1205 raft_consensus.cc:740] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:56:58.544289  1205 consensus_queue.cc:260] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.545819  1205 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.547395  1204 raft_consensus.cc:2468] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 2.
I20260709 12:56:58.547399  1130 raft_consensus.cc:2468] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 2.
I20260709 12:56:58.544289  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:58.548851  1131 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.548712  1021 leader_election.cc:304] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:58.549544  1260 raft_consensus.cc:2804] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:58.550076  1260 raft_consensus.cc:697] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:56:58.550948  1260 consensus_queue.cc:237] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.552737  1205 raft_consensus.cc:2468] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 2.
I20260709 12:56:58.553974  1021 leader_election.cc:304] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:58.554913  1282 raft_consensus.cc:2804] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:58.555449  1282 raft_consensus.cc:697] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:56:58.556198  1282 consensus_queue.cc:237] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.556830  1131 raft_consensus.cc:2468] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 2.
I20260709 12:56:58.559697   952 catalog_manager.cc:5697] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 1 to 2, leader changed from 958c729a4a664752a522116a24628314 (127.0.107.194) to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.572154   952 catalog_manager.cc:5697] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 1 to 2, leader changed from 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195) to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.604733  1282 consensus_queue.cc:1048] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.608846  1250 raft_consensus.cc:993] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52: : Instructing follower 958c729a4a664752a522116a24628314 to start an election
I20260709 12:56:58.609427  1250 raft_consensus.cc:1081] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Signalling peer 958c729a4a664752a522116a24628314 to start an election
I20260709 12:56:58.611958  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a"
dest_uuid: "958c729a4a664752a522116a24628314"
 from {username='slave'} at 127.0.0.1:55668
I20260709 12:56:58.612560  1131 raft_consensus.cc:493] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:58.612946  1131 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.615442  1256 raft_consensus.cc:993] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046: : Instructing follower 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:56:58.615899  1256 raft_consensus.cc:1081] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Signalling peer 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:56:58.616636  1256 consensus_queue.cc:1048] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.617427  1205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:46362
I20260709 12:56:58.618026  1205 raft_consensus.cc:493] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:58.618372  1205 raft_consensus.cc:3060] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.620252  1131 raft_consensus.cc:515] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.623667  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:58.623952  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:56:58.624289  1053 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.624593  1203 raft_consensus.cc:3055] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:58.624948  1203 raft_consensus.cc:740] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:56:58.625777  1203 consensus_queue.cc:260] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.626950  1203 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.628207  1131 leader_election.cc:290] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 2 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:56:58.628424  1205 raft_consensus.cc:515] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.630069  1204 raft_consensus.cc:1240] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Rejecting Update request from peer b8617ffb4bc14b1aa8dfa02809b5c046 for earlier term 1. Current term is 2. Ops: []
I20260709 12:56:58.632447  1053 raft_consensus.cc:2468] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 2.
I20260709 12:56:58.632485  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:56:58.634243  1096 leader_election.cc:304] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:56:58.634229  1282 consensus_queue.cc:1059] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:58.635265  1283 raft_consensus.cc:2804] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:58.633493  1055 raft_consensus.cc:3055] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:58.635715  1055 raft_consensus.cc:740] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:56:58.635785  1283 raft_consensus.cc:697] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Becoming Leader. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:56:58.636559  1055 consensus_queue.cc:260] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.636663  1283 consensus_queue.cc:237] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.637035  1205 leader_election.cc:290] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 2 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:56:58.637549  1055 raft_consensus.cc:3060] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.637616  1203 raft_consensus.cc:2468] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 2.
I20260709 12:56:58.640229  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547bd2c6380460a9d5c2bce3530abd5" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:56:58.644878  1055 raft_consensus.cc:2468] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 2.
W20260709 12:56:58.645385  1282 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:56:58.646080  1170 leader_election.cc:304] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 958c729a4a664752a522116a24628314
I20260709 12:56:58.647109  1296 raft_consensus.cc:2804] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:58.647575  1296 raft_consensus.cc:697] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Becoming Leader. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:56:58.648335  1296 consensus_queue.cc:237] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:56:58.655441   952 catalog_manager.cc:5697] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 reported cstate change: term changed from 1 to 2, leader changed from 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195) to 958c729a4a664752a522116a24628314 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "958c729a4a664752a522116a24628314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.662693   953 catalog_manager.cc:5697] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 reported cstate change: term changed from 1 to 2, leader changed from b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193) to 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "96149732f3624bd899cb6d2e0d241c52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:58.821856  1205 raft_consensus.cc:1275] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Refusing update from remote peer 958c729a4a664752a522116a24628314: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:58.823084  1283 consensus_queue.cc:1048] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:58.830814  1055 raft_consensus.cc:3060] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.838464  1055 raft_consensus.cc:1275] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Refusing update from remote peer 958c729a4a664752a522116a24628314: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:58.839965  1333 consensus_queue.cc:1048] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:58.942634  1205 raft_consensus.cc:1275] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:58.944012  1282 consensus_queue.cc:1048] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:58.951543  1130 raft_consensus.cc:1275] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:58.953176  1256 consensus_queue.cc:1048] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:59.030041  1055 raft_consensus.cc:1275] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Refusing update from remote peer 958c729a4a664752a522116a24628314: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:59.031498  1333 consensus_queue.cc:1048] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:59.039155  1205 raft_consensus.cc:1275] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Refusing update from remote peer 958c729a4a664752a522116a24628314: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:59.040658  1249 consensus_queue.cc:1048] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:59.064375  1205 raft_consensus.cc:1275] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:59.065868  1256 consensus_queue.cc:1048] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:59.073781  1130 raft_consensus.cc:1275] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:59.076171  1256 consensus_queue.cc:1048] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:59.098153  1130 raft_consensus.cc:3060] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:59.103201  1130 raft_consensus.cc:1275] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:59.104465  1296 consensus_queue.cc:1048] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:59.114085  1055 raft_consensus.cc:1275] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:59.115446  1334 consensus_queue.cc:1048] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:01.331956   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:57:01.332791   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:01.353428  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
mode: GRACEFUL
new_leader_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:52336
I20260709 12:57:01.354147  1053 raft_consensus.cc:606] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Received request to transfer leadership to TS 96149732f3624bd899cb6d2e0d241c52
I20260709 12:57:01.356698  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
mode: GRACEFUL
new_leader_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:52336
I20260709 12:57:01.357195  1053 raft_consensus.cc:606] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Received request to transfer leadership to TS 96149732f3624bd899cb6d2e0d241c52
I20260709 12:57:01.358374   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:57:01.358862   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:01.687444  1335 raft_consensus.cc:993] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046: : Instructing follower 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:57:01.687909  1337 raft_consensus.cc:1081] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Signalling peer 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:57:01.689435  1205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:46362
I20260709 12:57:01.689987  1205 raft_consensus.cc:493] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:01.690310  1205 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:01.705726  1205 raft_consensus.cc:515] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:01.707489  1205 leader_election.cc:290] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 2 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:57:01.708771  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:57:01.709372  1053 raft_consensus.cc:3055] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:01.709291  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:01.709807  1053 raft_consensus.cc:740] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:01.709975  1130 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:01.710681  1053 consensus_queue.cc:260] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:01.711879  1053 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:01.762130  1335 raft_consensus.cc:993] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046: : Instructing follower 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:57:01.762598  1337 raft_consensus.cc:1081] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Signalling peer 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:57:01.764575  1205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:46362
I20260709 12:57:01.765076  1205 raft_consensus.cc:493] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:01.765390  1205 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:01.782502  1130 raft_consensus.cc:2468] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 2.
I20260709 12:57:01.782555  1205 raft_consensus.cc:515] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:01.785419  1205 leader_election.cc:290] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 3 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:57:01.785264  1170 leader_election.cc:304] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: 
I20260709 12:57:01.786334  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:57:01.786717  1296 raft_consensus.cc:2804] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:01.787045  1055 raft_consensus.cc:3055] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:01.787398  1055 raft_consensus.cc:740] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:01.788182  1055 consensus_queue.cc:260] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:01.788586  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:01.789121  1131 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:01.789412  1055 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:01.790737  1296 raft_consensus.cc:697] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Becoming Leader. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:57:01.786432  1053 raft_consensus.cc:2468] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 2.
I20260709 12:57:01.791657  1296 consensus_queue.cc:237] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:01.796911  1131 raft_consensus.cc:2468] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 3.
I20260709 12:57:01.797051  1055 raft_consensus.cc:2468] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 3.
I20260709 12:57:01.798382  1170 leader_election.cc:304] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:57:01.799407  1296 raft_consensus.cc:2804] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:01.799876  1296 raft_consensus.cc:697] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 3 LEADER]: Becoming Leader. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:57:01.800556  1296 consensus_queue.cc:237] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:01.805773   953 catalog_manager.cc:5697] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 reported cstate change: term changed from 1 to 2, leader changed from b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193) to 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "96149732f3624bd899cb6d2e0d241c52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:01.821679   953 catalog_manager.cc:5697] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 reported cstate change: term changed from 2 to 3, leader changed from b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193) to 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "96149732f3624bd899cb6d2e0d241c52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:02.177810  1077 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7c40 after lost signal to thread 434
W20260709 12:57:02.178665  1077 debug-util.cc:398] Leaking SignalData structure 0x7b08001cefa0 after lost signal to thread 988
W20260709 12:57:02.179976  1077 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa680 after lost signal to thread 1155
W20260709 12:57:02.180677  1077 debug-util.cc:398] Leaking SignalData structure 0x7b08000df300 after lost signal to thread 1229
I20260709 12:57:02.186201  1053 raft_consensus.cc:1275] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:02.187762  1296 consensus_queue.cc:1048] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:02.203970  1131 raft_consensus.cc:1275] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:02.207505  1296 consensus_queue.cc:1048] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:02.231161  1055 raft_consensus.cc:1275] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:02.232877  1296 consensus_queue.cc:1048] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:02.247394  1130 raft_consensus.cc:1275] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:02.255062  1296 consensus_queue.cc:1048] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:02.359798   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:02.380102  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
mode: GRACEFUL
new_leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:46370
I20260709 12:57:02.380697  1205 raft_consensus.cc:606] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Received request to transfer leadership to TS b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:57:02.385670  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
mode: GRACEFUL
new_leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:46370
I20260709 12:57:02.386304  1205 raft_consensus.cc:606] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 3 LEADER]: Received request to transfer leadership to TS b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:57:02.391203  1131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6"
dest_uuid: "958c729a4a664752a522116a24628314"
mode: GRACEFUL
new_leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:55672
I20260709 12:57:02.391736  1131 raft_consensus.cc:606] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Received request to transfer leadership to TS b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:57:02.396948  1131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d376b33866624bdabc27449638e8224d"
dest_uuid: "958c729a4a664752a522116a24628314"
mode: GRACEFUL
new_leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:55672
I20260709 12:57:02.397442  1131 raft_consensus.cc:606] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Received request to transfer leadership to TS b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:57:02.403085  1131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a"
dest_uuid: "958c729a4a664752a522116a24628314"
mode: GRACEFUL
new_leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:55672
I20260709 12:57:02.403541  1131 raft_consensus.cc:606] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Received request to transfer leadership to TS b8617ffb4bc14b1aa8dfa02809b5c046
I20260709 12:57:02.553025  1352 raft_consensus.cc:993] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314: : Instructing follower b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.553597  1249 raft_consensus.cc:1081] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Signalling peer b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.555905  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d376b33866624bdabc27449638e8224d"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:52298
I20260709 12:57:02.556528  1055 raft_consensus.cc:493] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:02.556934  1055 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:02.564646  1055 raft_consensus.cc:515] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.567173  1055 leader_election.cc:290] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 2 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:57:02.568508  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376b33866624bdabc27449638e8224d" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:57:02.568506  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376b33866624bdabc27449638e8224d" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:02.569353  1205 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:02.569459  1131 raft_consensus.cc:3055] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:02.570336  1131 raft_consensus.cc:740] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:57:02.571234  1131 consensus_queue.cc:260] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.572696  1131 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:02.577401  1205 raft_consensus.cc:2468] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 2.
I20260709 12:57:02.578809  1021 leader_election.cc:304] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:57:02.579530  1131 raft_consensus.cc:2468] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 2.
I20260709 12:57:02.579715  1337 raft_consensus.cc:2804] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:02.581404  1337 raft_consensus.cc:697] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:02.582273  1337 consensus_queue.cc:237] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.589257   952 catalog_manager.cc:5697] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 1 to 2, leader changed from 958c729a4a664752a522116a24628314 (127.0.107.194) to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.624943  1341 raft_consensus.cc:993] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52: : Instructing follower b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.625411  1296 raft_consensus.cc:1081] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Signalling peer b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.627120  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:57:02.627730  1055 raft_consensus.cc:493] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:02.628113  1055 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:02.636760  1055 raft_consensus.cc:515] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.639240  1055 leader_election.cc:290] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 3 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:57:02.640228  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:02.640400  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0822e9e459a4969ae81632768652ea7" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:57:02.640846  1131 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:02.640872  1205 raft_consensus.cc:3055] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:02.641459  1205 raft_consensus.cc:740] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:57:02.642324  1205 consensus_queue.cc:260] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.643518  1205 raft_consensus.cc:3060] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:02.649847  1205 raft_consensus.cc:2468] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 3.
I20260709 12:57:02.650930  1021 leader_election.cc:304] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:57:02.651170  1131 raft_consensus.cc:2468] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 3.
I20260709 12:57:02.651969  1337 raft_consensus.cc:2804] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:02.652483  1337 raft_consensus.cc:697] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:02.653335  1337 consensus_queue.cc:237] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.660741   952 catalog_manager.cc:5697] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 2 to 3, leader changed from 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195) to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.714022  1352 raft_consensus.cc:993] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314: : Instructing follower b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.714581  1352 raft_consensus.cc:1081] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Signalling peer b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.716233  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:52298
I20260709 12:57:02.716737  1055 raft_consensus.cc:493] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:02.717063  1055 raft_consensus.cc:3060] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:02.722669  1055 raft_consensus.cc:515] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.724279  1055 leader_election.cc:290] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 2 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:57:02.725248  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:02.725688  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48199149e924bbdb3cbe8083e0170f6" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:57:02.725935  1131 raft_consensus.cc:3055] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:02.726266  1131 raft_consensus.cc:740] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:57:02.726300  1205 raft_consensus.cc:3060] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:02.727130  1131 consensus_queue.cc:260] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.728322  1131 raft_consensus.cc:3060] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:02.732846  1205 raft_consensus.cc:2468] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 2.
I20260709 12:57:02.734161  1021 leader_election.cc:304] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:57:02.734794  1131 raft_consensus.cc:2468] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 2.
I20260709 12:57:02.735023  1337 raft_consensus.cc:2804] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:02.735589  1337 raft_consensus.cc:697] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:02.736502  1337 consensus_queue.cc:237] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.747786   952 catalog_manager.cc:5697] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 1 to 2, leader changed from 958c729a4a664752a522116a24628314 (127.0.107.194) to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.773763  1341 raft_consensus.cc:993] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52: : Instructing follower b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.774264  1341 raft_consensus.cc:1081] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 3 LEADER]: Signalling peer b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.776126  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:57:02.776636  1055 raft_consensus.cc:493] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:02.776954  1055 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:02.782634  1055 raft_consensus.cc:515] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.784770  1055 leader_election.cc:290] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 4 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:57:02.788038  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:02.788257  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2662eddc6d8400ea96022e1a99b0cea" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:57:02.788636  1130 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:02.788863  1205 raft_consensus.cc:3055] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:02.789233  1205 raft_consensus.cc:740] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:57:02.790004  1205 consensus_queue.cc:260] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.791095  1205 raft_consensus.cc:3060] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:02.796166  1249 raft_consensus.cc:993] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314: : Instructing follower b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.796648  1249 raft_consensus.cc:1081] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Signalling peer b8617ffb4bc14b1aa8dfa02809b5c046 to start an election
I20260709 12:57:02.796986  1130 raft_consensus.cc:2468] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 4.
I20260709 12:57:02.797766  1131 raft_consensus.cc:1240] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 4 FOLLOWER]: Rejecting Update request from peer 96149732f3624bd899cb6d2e0d241c52 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:02.798741  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
 from {username='slave'} at 127.0.0.1:52298
I20260709 12:57:02.799319  1053 raft_consensus.cc:493] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:02.799721  1053 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:02.801318  1021 leader_election.cc:304] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:57:02.805668  1337 raft_consensus.cc:2804] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:02.806957  1337 raft_consensus.cc:697] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 4 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:02.807711  1053 raft_consensus.cc:515] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.807921  1337 consensus_queue.cc:237] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.810823  1053 leader_election.cc:290] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 3 election: Requested vote from peers 958c729a4a664752a522116a24628314 (127.0.107.194:33033), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:57:02.811484  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:02.812052  1131 raft_consensus.cc:3055] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:02.811998  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7816e4acb64a79b58fd3427442510a" candidate_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:57:02.812554  1131 raft_consensus.cc:740] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:57:02.812718  1204 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:02.813249  1205 raft_consensus.cc:2468] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 4.
I20260709 12:57:02.813614  1131 consensus_queue.cc:260] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.814899  1131 raft_consensus.cc:3060] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:02.820875  1131 raft_consensus.cc:2468] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 3.
I20260709 12:57:02.820833   952 catalog_manager.cc:5697] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 3 to 4, leader changed from 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195) to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.822157  1204 raft_consensus.cc:2468] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8617ffb4bc14b1aa8dfa02809b5c046 in term 3.
I20260709 12:57:02.822309  1021 leader_election.cc:304] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:57:02.823413  1337 raft_consensus.cc:2804] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:02.829120  1337 raft_consensus.cc:697] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 LEADER]: Becoming Leader. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:02.830149  1337 consensus_queue.cc:237] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:02.838233   952 catalog_manager.cc:5697] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 reported cstate change: term changed from 2 to 3, leader changed from 958c729a4a664752a522116a24628314 (127.0.107.194) to b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:03.068543  1204 raft_consensus.cc:1275] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:03.070650  1337 consensus_queue.cc:1048] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:03.086669  1131 raft_consensus.cc:1275] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:03.088653  1365 consensus_queue.cc:1048] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:03.098517  1204 raft_consensus.cc:1275] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:03.102659  1365 consensus_queue.cc:1048] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.119073  1130 raft_consensus.cc:1275] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:03.121137  1365 consensus_queue.cc:1048] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.126554  1131 raft_consensus.cc:1275] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:03.127844  1365 consensus_queue.cc:1048] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.140818  1204 raft_consensus.cc:1275] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:03.142494  1337 consensus_queue.cc:1048] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:03.235399  1130 raft_consensus.cc:1275] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:03.236802  1337 consensus_queue.cc:1048] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:03.254730  1204 raft_consensus.cc:1275] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:03.256394  1358 consensus_queue.cc:1048] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:03.390772  1130 raft_consensus.cc:1275] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 4 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:03.392230  1358 consensus_queue.cc:1048] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:03.403739  1204 raft_consensus.cc:1275] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 4 FOLLOWER]: Refusing update from remote peer b8617ffb4bc14b1aa8dfa02809b5c046: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:03.405382  1365 consensus_queue.cc:1048] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:57:05.167174  1226 debug-util.cc:398] Leaking SignalData structure 0x7b080017cd80 after lost signal to thread 434
W20260709 12:57:05.167927  1226 debug-util.cc:398] Leaking SignalData structure 0x7b080019e7c0 after lost signal to thread 988
W20260709 12:57:05.168774  1226 debug-util.cc:398] Leaking SignalData structure 0x7b080016a660 after lost signal to thread 1080
W20260709 12:57:05.169808  1226 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6820 after lost signal to thread 1155
W20260709 12:57:05.170466  1226 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdde0 after lost signal to thread 1229
I20260709 12:57:05.548713   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:05.560830  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
mode: GRACEFUL
new_leader_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:52336
I20260709 12:57:05.561765  1053 raft_consensus.cc:606] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Received request to transfer leadership to TS 96149732f3624bd899cb6d2e0d241c52
I20260709 12:57:05.564647  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
mode: GRACEFUL
new_leader_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:52336
I20260709 12:57:05.565158  1053 raft_consensus.cc:606] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Received request to transfer leadership to TS 96149732f3624bd899cb6d2e0d241c52
I20260709 12:57:05.567700  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
mode: GRACEFUL
new_leader_uuid: "958c729a4a664752a522116a24628314"
 from {username='slave'} at 127.0.0.1:52336
I20260709 12:57:05.568282  1053 raft_consensus.cc:606] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Received request to transfer leadership to TS 958c729a4a664752a522116a24628314
I20260709 12:57:05.570624  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d376b33866624bdabc27449638e8224d"
dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
mode: GRACEFUL
new_leader_uuid: "958c729a4a664752a522116a24628314"
 from {username='slave'} at 127.0.0.1:52336
I20260709 12:57:05.571262  1053 raft_consensus.cc:606] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Received request to transfer leadership to TS 958c729a4a664752a522116a24628314
I20260709 12:57:05.572364   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:57:05.572818   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:05.603255  1381 raft_consensus.cc:993] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046: : Instructing follower 958c729a4a664752a522116a24628314 to start an election
I20260709 12:57:05.603824  1337 raft_consensus.cc:1081] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Signalling peer 958c729a4a664752a522116a24628314 to start an election
I20260709 12:57:05.606077  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750"
dest_uuid: "958c729a4a664752a522116a24628314"
 from {username='slave'} at 127.0.0.1:55662
I20260709 12:57:05.606746  1131 raft_consensus.cc:493] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.607116  1131 raft_consensus.cc:3060] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.615504  1131 raft_consensus.cc:515] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:05.617718  1131 leader_election.cc:290] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 2 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:57:05.618852  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:57:05.619247  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d21deb7ff3427a8368d88a65474750" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:57:05.619611  1053 raft_consensus.cc:3055] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:05.619755  1204 raft_consensus.cc:3060] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.619956  1053 raft_consensus.cc:740] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:05.620836  1053 consensus_queue.cc:260] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:05.622166  1053 raft_consensus.cc:3060] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.627043  1204 raft_consensus.cc:2468] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 2.
I20260709 12:57:05.628512  1096 leader_election.cc:304] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: 
I20260709 12:57:05.629508  1352 raft_consensus.cc:2804] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:05.629706  1053 raft_consensus.cc:2468] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 2.
I20260709 12:57:05.630697  1352 raft_consensus.cc:697] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Becoming Leader. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:57:05.631731  1352 consensus_queue.cc:237] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:05.643661   953 catalog_manager.cc:5697] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 reported cstate change: term changed from 1 to 2, leader changed from b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193) to 958c729a4a664752a522116a24628314 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "958c729a4a664752a522116a24628314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.837426  1381 raft_consensus.cc:993] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046: : Instructing follower 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:57:05.837989  1337 raft_consensus.cc:1081] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Signalling peer 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:57:05.839708  1204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:46362
I20260709 12:57:05.840191  1204 raft_consensus.cc:493] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.840485  1204 raft_consensus.cc:3060] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.845350  1204 raft_consensus.cc:515] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:57:05.846968  1381 raft_consensus.cc:993] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046: : Instructing follower 958c729a4a664752a522116a24628314 to start an election
I20260709 12:57:05.847481  1381 raft_consensus.cc:1081] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Signalling peer 958c729a4a664752a522116a24628314 to start an election
I20260709 12:57:05.848141  1204 leader_election.cc:290] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 2 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:57:05.848043  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:57:05.848750  1053 raft_consensus.cc:3055] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:05.849089  1053 raft_consensus.cc:740] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:05.849313  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d376b33866624bdabc27449638e8224d"
dest_uuid: "958c729a4a664752a522116a24628314"
 from {username='slave'} at 127.0.0.1:55662
I20260709 12:57:05.849673  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7406821b6f4149bf87e3e15690933ec9" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:05.849876  1131 raft_consensus.cc:493] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:05.850210  1130 raft_consensus.cc:3060] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.850235  1131 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:05.850021  1053 consensus_queue.cc:260] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:57:05.851258  1053 raft_consensus.cc:3060] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:05.857110  1131 raft_consensus.cc:515] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:05.857493  1130 raft_consensus.cc:2468] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 2.
I20260709 12:57:05.858211  1053 raft_consensus.cc:2468] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 2.
I20260709 12:57:05.859176  1170 leader_election.cc:304] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: 
I20260709 12:57:05.860067  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376b33866624bdabc27449638e8224d" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:57:05.860630  1053 raft_consensus.cc:3055] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:05.860736  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376b33866624bdabc27449638e8224d" candidate_uuid: "958c729a4a664752a522116a24628314" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
I20260709 12:57:05.860960  1364 raft_consensus.cc:2804] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:05.861192  1053 raft_consensus.cc:740] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:05.861441  1204 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:05.862257  1053 consensus_queue.cc:260] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:05.863366  1053 raft_consensus.cc:3060] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:05.868080  1204 raft_consensus.cc:2468] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 3.
I20260709 12:57:05.861192  1131 leader_election.cc:290] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 3 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195:37129)
I20260709 12:57:05.870482  1364 raft_consensus.cc:697] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Becoming Leader. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:57:05.871390  1096 leader_election.cc:304] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958c729a4a664752a522116a24628314, 96149732f3624bd899cb6d2e0d241c52; no voters: 
I20260709 12:57:05.872193  1364 consensus_queue.cc:237] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } }
I20260709 12:57:05.872815  1352 raft_consensus.cc:2804] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:05.879873  1053 raft_consensus.cc:2468] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958c729a4a664752a522116a24628314 in term 3.
I20260709 12:57:05.883113  1352 raft_consensus.cc:697] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 3 LEADER]: Becoming Leader. State: Replica: 958c729a4a664752a522116a24628314, State: Running, Role: LEADER
I20260709 12:57:05.884792  1352 consensus_queue.cc:237] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:05.887626   953 catalog_manager.cc:5697] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 reported cstate change: term changed from 1 to 2, leader changed from b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193) to 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "96149732f3624bd899cb6d2e0d241c52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.894418   952 catalog_manager.cc:5697] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 reported cstate change: term changed from 2 to 3, leader changed from b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193) to 958c729a4a664752a522116a24628314 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "958c729a4a664752a522116a24628314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:06.137033  1381 raft_consensus.cc:993] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046: : Instructing follower 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:57:06.137540  1381 raft_consensus.cc:1081] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Signalling peer 96149732f3624bd899cb6d2e0d241c52 to start an election
I20260709 12:57:06.139128  1204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a"
dest_uuid: "96149732f3624bd899cb6d2e0d241c52"
 from {username='slave'} at 127.0.0.1:46362
I20260709 12:57:06.139561  1204 raft_consensus.cc:493] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:06.139844  1204 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:06.143862  1204 raft_consensus.cc:515] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:06.145226  1204 leader_election.cc:290] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 3 election: Requested vote from peers b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429), 958c729a4a664752a522116a24628314 (127.0.107.194:33033)
I20260709 12:57:06.146194  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046"
I20260709 12:57:06.146588  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c8d358164f47d791b69272c0c0a68a" candidate_uuid: "96149732f3624bd899cb6d2e0d241c52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "958c729a4a664752a522116a24628314"
I20260709 12:57:06.146869  1053 raft_consensus.cc:3055] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:06.147209  1131 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:06.147351  1053 raft_consensus.cc:740] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8617ffb4bc14b1aa8dfa02809b5c046, State: Running, Role: LEADER
I20260709 12:57:06.148159  1053 consensus_queue.cc:260] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:06.149087  1053 raft_consensus.cc:3060] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:06.154333  1131 raft_consensus.cc:2468] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 3.
I20260709 12:57:06.154349  1053 raft_consensus.cc:2468] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96149732f3624bd899cb6d2e0d241c52 in term 3.
I20260709 12:57:06.155829  1170 leader_election.cc:304] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96149732f3624bd899cb6d2e0d241c52, b8617ffb4bc14b1aa8dfa02809b5c046; no voters: 
I20260709 12:57:06.156524  1364 raft_consensus.cc:2804] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:06.156994  1364 raft_consensus.cc:697] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 3 LEADER]: Becoming Leader. State: Replica: 96149732f3624bd899cb6d2e0d241c52, State: Running, Role: LEADER
I20260709 12:57:06.157872  1364 consensus_queue.cc:237] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } }
I20260709 12:57:06.165535   952 catalog_manager.cc:5697] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 reported cstate change: term changed from 2 to 3, leader changed from b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193) to 96149732f3624bd899cb6d2e0d241c52 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "96149732f3624bd899cb6d2e0d241c52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:06.172807  1053 raft_consensus.cc:1275] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Refusing update from remote peer 958c729a4a664752a522116a24628314: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:06.174299  1352 consensus_queue.cc:1048] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:06.192236  1205 raft_consensus.cc:1275] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Refusing update from remote peer 958c729a4a664752a522116a24628314: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:06.195351  1382 consensus_queue.cc:1048] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:06.398530  1203 raft_consensus.cc:1275] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Refusing update from remote peer 958c729a4a664752a522116a24628314: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:06.400287  1395 consensus_queue.cc:1048] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96149732f3624bd899cb6d2e0d241c52" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:06.412637  1053 raft_consensus.cc:1275] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Refusing update from remote peer 958c729a4a664752a522116a24628314: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:06.414935  1352 consensus_queue.cc:1048] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:06.430124  1131 raft_consensus.cc:1275] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:06.431448  1364 consensus_queue.cc:1048] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:06.443007  1053 raft_consensus.cc:1275] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:06.445254  1388 consensus_queue.cc:1048] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8617ffb4bc14b1aa8dfa02809b5c046" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:06.574512   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:06.582422   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 12:57:06.587466  1170 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:57:06.591773  1170 consensus_peers.cc:597] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 -> Peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Couldn't send request to peer b8617ffb4bc14b1aa8dfa02809b5c046. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:06.619721   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:06.620592   431 tablet_replica.cc:333] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.621690   431 raft_consensus.cc:2243] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.622232   431 raft_consensus.cc:2272] T e2294da4651c49f5974373b1eca01c0b P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.624233   431 tablet_replica.cc:333] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.624770   431 raft_consensus.cc:2243] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.625500   431 raft_consensus.cc:2272] T a0822e9e459a4969ae81632768652ea7 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.627199   431 tablet_replica.cc:333] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.627668   431 raft_consensus.cc:2243] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.628046   431 raft_consensus.cc:2272] T 36c8d358164f47d791b69272c0c0a68a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.629851   431 tablet_replica.cc:333] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.630443   431 raft_consensus.cc:2243] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.631175   431 raft_consensus.cc:2272] T cb7816e4acb64a79b58fd3427442510a P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.633134   431 tablet_replica.cc:333] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.633701   431 raft_consensus.cc:2243] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.634189   431 raft_consensus.cc:2272] T d376b33866624bdabc27449638e8224d P b8617ffb4bc14b1aa8dfa02809b5c046 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.637079   431 tablet_replica.cc:333] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.637897   431 raft_consensus.cc:2243] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.638474   431 raft_consensus.cc:2272] T 7406821b6f4149bf87e3e15690933ec9 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.641795   431 tablet_replica.cc:333] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.642603   431 raft_consensus.cc:2243] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.643565   431 raft_consensus.cc:2272] T e2662eddc6d8400ea96022e1a99b0cea P b8617ffb4bc14b1aa8dfa02809b5c046 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.645939   431 tablet_replica.cc:333] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.646494   431 raft_consensus.cc:2243] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.647286   431 raft_consensus.cc:2272] T a48199149e924bbdb3cbe8083e0170f6 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.649652   431 tablet_replica.cc:333] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.650178   431 raft_consensus.cc:2243] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.650705   431 raft_consensus.cc:2272] T 3547bd2c6380460a9d5c2bce3530abd5 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.652616   431 tablet_replica.cc:333] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046: stopping tablet replica
I20260709 12:57:06.653081   431 raft_consensus.cc:2243] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.653494   431 raft_consensus.cc:2272] T a1d21deb7ff3427a8368d88a65474750 P b8617ffb4bc14b1aa8dfa02809b5c046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.694212   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:57:06.718924   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:57:06.719063  1131 raft_consensus.cc:1275] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Refusing update from remote peer 96149732f3624bd899cb6d2e0d241c52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:06.720932  1388 consensus_queue.cc:1048] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958c729a4a664752a522116a24628314" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:57:06.726451  1170 consensus_peers.cc:597] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 -> Peer 958c729a4a664752a522116a24628314 (127.0.107.194:33033): Couldn't send request to peer 958c729a4a664752a522116a24628314. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:06.755090  1170 consensus_peers.cc:597] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 -> Peer b8617ffb4bc14b1aa8dfa02809b5c046 (127.0.107.193:39429): Couldn't send request to peer b8617ffb4bc14b1aa8dfa02809b5c046. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:06.757918   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:06.758625   431 tablet_replica.cc:333] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.759428   431 raft_consensus.cc:2243] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.759904   431 raft_consensus.cc:2272] T cb7816e4acb64a79b58fd3427442510a P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.761832   431 tablet_replica.cc:333] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.762382   431 raft_consensus.cc:2243] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.762823   431 raft_consensus.cc:2272] T 36c8d358164f47d791b69272c0c0a68a P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.764564   431 tablet_replica.cc:333] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.765075   431 raft_consensus.cc:2243] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.765878   431 raft_consensus.cc:2272] T e2294da4651c49f5974373b1eca01c0b P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.767566   431 tablet_replica.cc:333] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.768062   431 raft_consensus.cc:2243] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.768759   431 raft_consensus.cc:2272] T d376b33866624bdabc27449638e8224d P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.771193   431 tablet_replica.cc:333] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.771723   431 raft_consensus.cc:2243] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.772131   431 raft_consensus.cc:2272] T a48199149e924bbdb3cbe8083e0170f6 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.773836   431 tablet_replica.cc:333] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.774324   431 raft_consensus.cc:2243] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.775030   431 raft_consensus.cc:2272] T a1d21deb7ff3427a8368d88a65474750 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.777398   431 tablet_replica.cc:333] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.777978   431 raft_consensus.cc:2243] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.778409   431 raft_consensus.cc:2272] T e2662eddc6d8400ea96022e1a99b0cea P 958c729a4a664752a522116a24628314 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.780138   431 tablet_replica.cc:333] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.780606   431 raft_consensus.cc:2243] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.780999   431 raft_consensus.cc:2272] T 3547bd2c6380460a9d5c2bce3530abd5 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.782749   431 tablet_replica.cc:333] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.783202   431 raft_consensus.cc:2243] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.783638   431 raft_consensus.cc:2272] T a0822e9e459a4969ae81632768652ea7 P 958c729a4a664752a522116a24628314 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.785142   431 tablet_replica.cc:333] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314: stopping tablet replica
I20260709 12:57:06.785665   431 raft_consensus.cc:2243] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.786195   431 raft_consensus.cc:2272] T 7406821b6f4149bf87e3e15690933ec9 P 958c729a4a664752a522116a24628314 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.819181   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:57:06.850310   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:57:06.893854   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:06.894769   431 tablet_replica.cc:333] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.895690   431 raft_consensus.cc:2243] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.897212   431 raft_consensus.cc:2272] T 7406821b6f4149bf87e3e15690933ec9 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.900256   431 tablet_replica.cc:333] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.900936   431 raft_consensus.cc:2243] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.901409   431 raft_consensus.cc:2272] T d376b33866624bdabc27449638e8224d P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.904501   431 tablet_replica.cc:333] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.905186   431 raft_consensus.cc:2243] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.906141   431 pending_rounds.cc:70] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: Trying to abort 1 pending ops.
I20260709 12:57:06.906420   431 pending_rounds.cc:77] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305633079949774848 op_type: NO_OP noop_request { }
I20260709 12:57:06.906844   431 raft_consensus.cc:2889] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:57:06.907171   431 raft_consensus.cc:2272] T 36c8d358164f47d791b69272c0c0a68a P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.909739   431 tablet_replica.cc:333] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.910360   431 raft_consensus.cc:2243] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.910861   431 raft_consensus.cc:2272] T cb7816e4acb64a79b58fd3427442510a P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.912931   431 tablet_replica.cc:333] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.913667   431 raft_consensus.cc:2243] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:06.914988   431 raft_consensus.cc:2272] T 3547bd2c6380460a9d5c2bce3530abd5 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.916968   431 tablet_replica.cc:333] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.917541   431 raft_consensus.cc:2243] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.918048   431 raft_consensus.cc:2272] T a1d21deb7ff3427a8368d88a65474750 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.920388   431 tablet_replica.cc:333] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.920910   431 raft_consensus.cc:2243] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.921446   431 raft_consensus.cc:2272] T e2662eddc6d8400ea96022e1a99b0cea P 96149732f3624bd899cb6d2e0d241c52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.923346   431 tablet_replica.cc:333] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.923799   431 raft_consensus.cc:2243] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.924217   431 raft_consensus.cc:2272] T a48199149e924bbdb3cbe8083e0170f6 P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.926018   431 tablet_replica.cc:333] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.926471   431 raft_consensus.cc:2243] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.927033   431 raft_consensus.cc:2272] T e2294da4651c49f5974373b1eca01c0b P 96149732f3624bd899cb6d2e0d241c52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.928936   431 tablet_replica.cc:333] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52: stopping tablet replica
I20260709 12:57:06.929524   431 raft_consensus.cc:2243] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.930078   431 raft_consensus.cc:2272] T a0822e9e459a4969ae81632768652ea7 P 96149732f3624bd899cb6d2e0d241c52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:07.836323   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:57:07.856359   431 master.cc:562] Master@127.0.107.254:40733 shutting down...
I20260709 12:57:07.879325   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:57:07.880002   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:07.880316   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6a2cc91c2e07410da63ad16dd40dcc8c: stopping tablet replica
I20260709 12:57:07.900775   431 master.cc:584] Master@127.0.107.254:40733 shutdown complete.
958c729a4a664752a522116a24628314  4
96149732f3624bd899cb6d2e0d241c52  1
b8617ffb4bc14b1aa8dfa02809b5c046  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11682 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:57:07.944629   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38115
I20260709 12:57:07.946134   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:07.952314  1407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:07.953254  1408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:07.953475  1410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:07.955255   431 server_base.cc:1061] running on GCE node
I20260709 12:57:07.956202   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:07.956414   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:07.956570   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601827956553 us; error 0 us; skew 500 ppm
I20260709 12:57:07.957237   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:07.960268   431 webserver.cc:533] Webserver started at http://127.0.107.254:37241/ using document root <none> and password file <none>
I20260709 12:57:07.960752   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:07.960942   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:07.961207   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:07.962409   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/master-0-root/instance:
uuid: "d61986b01a0f484cbe47a3797e9dc27f"
format_stamp: "Formatted at 2026-07-09 12:57:07 on dist-test-slave-qv7r"
I20260709 12:57:07.967137   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:57:07.970826  1415 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:07.971863   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:57:07.972136   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/master-0-root
uuid: "d61986b01a0f484cbe47a3797e9dc27f"
format_stamp: "Formatted at 2026-07-09 12:57:07 on dist-test-slave-qv7r"
I20260709 12:57:07.972401   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:08.025764   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:08.027052   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:08.068114   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38115
I20260709 12:57:08.068212  1466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38115 every 8 connection(s)
I20260709 12:57:08.072077  1467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.082522  1467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Bootstrap starting.
I20260709 12:57:08.087144  1467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:08.091722  1467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: No bootstrap required, opened a new log
I20260709 12:57:08.094074  1467 raft_consensus.cc:359] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d61986b01a0f484cbe47a3797e9dc27f" member_type: VOTER }
I20260709 12:57:08.094463  1467 raft_consensus.cc:385] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:08.094712  1467 raft_consensus.cc:740] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d61986b01a0f484cbe47a3797e9dc27f, State: Initialized, Role: FOLLOWER
I20260709 12:57:08.095963  1467 consensus_queue.cc:260] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d61986b01a0f484cbe47a3797e9dc27f" member_type: VOTER }
I20260709 12:57:08.096414  1467 raft_consensus.cc:399] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:08.096640  1467 raft_consensus.cc:493] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:08.096961  1467 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:08.107161  1467 raft_consensus.cc:515] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d61986b01a0f484cbe47a3797e9dc27f" member_type: VOTER }
I20260709 12:57:08.107977  1467 leader_election.cc:304] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d61986b01a0f484cbe47a3797e9dc27f; no voters: 
I20260709 12:57:08.109649  1467 leader_election.cc:290] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:08.109946  1470 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:08.111408  1470 raft_consensus.cc:697] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 1 LEADER]: Becoming Leader. State: Replica: d61986b01a0f484cbe47a3797e9dc27f, State: Running, Role: LEADER
I20260709 12:57:08.112175  1470 consensus_queue.cc:237] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d61986b01a0f484cbe47a3797e9dc27f" member_type: VOTER }
I20260709 12:57:08.113417  1467 sys_catalog.cc:565] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:08.116660  1472 sys_catalog.cc:455] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d61986b01a0f484cbe47a3797e9dc27f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d61986b01a0f484cbe47a3797e9dc27f" member_type: VOTER } }
I20260709 12:57:08.116871  1471 sys_catalog.cc:455] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d61986b01a0f484cbe47a3797e9dc27f. Latest consensus state: current_term: 1 leader_uuid: "d61986b01a0f484cbe47a3797e9dc27f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d61986b01a0f484cbe47a3797e9dc27f" member_type: VOTER } }
I20260709 12:57:08.117368  1472 sys_catalog.cc:458] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:08.117604  1471 sys_catalog.cc:458] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:08.120599  1476 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:08.125864  1476 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:08.130419   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:08.134954  1476 catalog_manager.cc:1383] Generated new cluster ID: 592b49047c1544a499a2bb65b353f095
I20260709 12:57:08.135236  1476 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:08.159190  1476 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:08.160686  1476 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:08.185086  1476 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Generated new TSK 0
I20260709 12:57:08.185696  1476 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:08.198683   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:08.205466  1488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:08.207105  1489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:08.209000  1491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:08.211455   431 server_base.cc:1061] running on GCE node
I20260709 12:57:08.212863   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:08.213184   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:08.213416   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601828213396 us; error 0 us; skew 500 ppm
I20260709 12:57:08.214375   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:08.217549   431 webserver.cc:533] Webserver started at http://127.0.107.193:46777/ using document root <none> and password file <none>
I20260709 12:57:08.218124   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:08.218302   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:08.218528   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:08.219666   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/instance:
uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
format_stamp: "Formatted at 2026-07-09 12:57:08 on dist-test-slave-qv7r"
I20260709 12:57:08.224614   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:57:08.227967  1496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.229385   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:57:08.229732   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
format_stamp: "Formatted at 2026-07-09 12:57:08 on dist-test-slave-qv7r"
I20260709 12:57:08.230160   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:08.253954   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:08.255784   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:08.257923   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:08.262346   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:08.262650   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.263003   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:08.263159   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.308602   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40197
I20260709 12:57:08.308710  1558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40197 every 8 connection(s)
I20260709 12:57:08.313664   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:08.322892  1563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:08.323915  1564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:08.329959  1559 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38115
I20260709 12:57:08.330614  1559 heartbeater.cc:461] Registering TS with master...
W20260709 12:57:08.331875  1566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:08.331919  1559 heartbeater.cc:507] Master 127.0.107.254:38115 requested a full tablet report, sending...
I20260709 12:57:08.333086   431 server_base.cc:1061] running on GCE node
I20260709 12:57:08.334455   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:08.334684   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:08.334823  1432 ts_manager.cc:194] Registered new tserver with Master: 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:08.335085   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601828335066 us; error 0 us; skew 500 ppm
I20260709 12:57:08.335850   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:08.336819  1432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40874
I20260709 12:57:08.339663   431 webserver.cc:533] Webserver started at http://127.0.107.194:37329/ using document root <none> and password file <none>
I20260709 12:57:08.340185   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:08.340402   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:08.340670   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:08.341842   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/instance:
uuid: "fc6fbca2eb8d4bec997c51003e277180"
format_stamp: "Formatted at 2026-07-09 12:57:08 on dist-test-slave-qv7r"
I20260709 12:57:08.346283   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:57:08.349920  1571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.350740   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:57:08.351033   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root
uuid: "fc6fbca2eb8d4bec997c51003e277180"
format_stamp: "Formatted at 2026-07-09 12:57:08 on dist-test-slave-qv7r"
I20260709 12:57:08.351325   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:08.367039   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:08.368235   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:08.369797   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:08.371995   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:08.372231   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.372469   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:08.372635   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.416985   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:35057
I20260709 12:57:08.417099  1633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:35057 every 8 connection(s)
I20260709 12:57:08.421798   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:08.429617  1637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:08.430536  1638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:08.439435  1634 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38115
I20260709 12:57:08.440033  1634 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:08.441023  1634 heartbeater.cc:507] Master 127.0.107.254:38115 requested a full tablet report, sending...
I20260709 12:57:08.443156   431 server_base.cc:1061] running on GCE node
W20260709 12:57:08.443517  1640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:08.443490  1432 ts_manager.cc:194] Registered new tserver with Master: fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:08.444715   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:08.445082   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:08.445170  1432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40888
I20260709 12:57:08.445297   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601828445274 us; error 0 us; skew 500 ppm
I20260709 12:57:08.446019   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:08.448797   431 webserver.cc:533] Webserver started at http://127.0.107.195:36113/ using document root <none> and password file <none>
I20260709 12:57:08.449286   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:08.449468   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:08.449787   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:08.450978   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/instance:
uuid: "3cabc5110903443ba3beb5cbb14afa91"
format_stamp: "Formatted at 2026-07-09 12:57:08 on dist-test-slave-qv7r"
I20260709 12:57:08.455945   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:57:08.459311  1645 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.460083   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:57:08.460330   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root
uuid: "3cabc5110903443ba3beb5cbb14afa91"
format_stamp: "Formatted at 2026-07-09 12:57:08 on dist-test-slave-qv7r"
I20260709 12:57:08.460579   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:08.474287   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:08.475476   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:08.476644   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:08.478924   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:08.479125   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.479423   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:08.479583   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:08.524452   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35399
I20260709 12:57:08.524744  1707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35399 every 8 connection(s)
I20260709 12:57:08.539151  1708 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38115
I20260709 12:57:08.539641  1708 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:08.540691  1708 heartbeater.cc:507] Master 127.0.107.254:38115 requested a full tablet report, sending...
I20260709 12:57:08.543292  1432 ts_manager.cc:194] Registered new tserver with Master: 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:08.543821   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016172529s
I20260709 12:57:08.545193  1432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40900
I20260709 12:57:08.574179  1432 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40916:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:08.580395  1432 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:08.785327  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 954aeabfbeda41f39cf0433b861851fc (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:08.786408  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 77f1e53da9e94a8e8859328c4a06b68a (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:08.787063  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954aeabfbeda41f39cf0433b861851fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.787777  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f1e53da9e94a8e8859328c4a06b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.790581  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 5a253835287048b3b4ce5ffeb6a4dd1f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:08.791901  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 525f0b170c13486a8942f69d40971d8f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:08.793172  1672 tablet_service.cc:1511] Processing CreateTablet for tablet a61da57488ec46278703e8204e8ab905 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:08.796466  1668 tablet_service.cc:1511] Processing CreateTablet for tablet f32dbc3da8894f6cbbf52b501c537a5b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:08.791926  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a253835287048b3b4ce5ffeb6a4dd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.801925  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61da57488ec46278703e8204e8ab905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.802932  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32dbc3da8894f6cbbf52b501c537a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.809181  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 77f1e53da9e94a8e8859328c4a06b68a (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:08.809926  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525f0b170c13486a8942f69d40971d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.810791  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f1e53da9e94a8e8859328c4a06b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.814942  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 525f0b170c13486a8942f69d40971d8f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:08.816531  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525f0b170c13486a8942f69d40971d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.818897  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:08.820443  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.822867  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5fb2214fbb40f0a702dbf5aa32966f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:08.824438  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5fb2214fbb40f0a702dbf5aa32966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.825799  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 74265c5d23584d47a1a5cca905a68876 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:08.826355  1519 tablet_service.cc:1511] Processing CreateTablet for tablet f32dbc3da8894f6cbbf52b501c537a5b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:08.826643  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 5741b07c783e4193be39d19fba6c5cec (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:08.827623  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74265c5d23584d47a1a5cca905a68876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.827754  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 74265c5d23584d47a1a5cca905a68876 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:08.829188  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:08.805152  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 5741b07c783e4193be39d19fba6c5cec (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:08.831009  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5741b07c783e4193be39d19fba6c5cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.831548  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5fb2214fbb40f0a702dbf5aa32966f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:08.805296  1523 tablet_service.cc:1511] Processing CreateTablet for tablet a61da57488ec46278703e8204e8ab905 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:08.807241  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 5a253835287048b3b4ce5ffeb6a4dd1f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:08.803418  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 954aeabfbeda41f39cf0433b861851fc (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:08.858079  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32dbc3da8894f6cbbf52b501c537a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.858935  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5fb2214fbb40f0a702dbf5aa32966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.861965  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5741b07c783e4193be39d19fba6c5cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.862800  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.865592  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74265c5d23584d47a1a5cca905a68876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.867661  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a253835287048b3b4ce5ffeb6a4dd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.869866  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61da57488ec46278703e8204e8ab905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.873979  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954aeabfbeda41f39cf0433b861851fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.999518  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 954aeabfbeda41f39cf0433b861851fc (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:09.000974  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954aeabfbeda41f39cf0433b861851fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.006273  1598 tablet_service.cc:1511] Processing CreateTablet for tablet a61da57488ec46278703e8204e8ab905 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:09.007874  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61da57488ec46278703e8204e8ab905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.015491  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 5a253835287048b3b4ce5ffeb6a4dd1f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:09.017038  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a253835287048b3b4ce5ffeb6a4dd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.024013  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 77f1e53da9e94a8e8859328c4a06b68a (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:09.025820  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f1e53da9e94a8e8859328c4a06b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.025966  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 1805a53fe3fc412094cd75832a6e1208 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:09.030539  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 525f0b170c13486a8942f69d40971d8f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:09.033345  1594 tablet_service.cc:1511] Processing CreateTablet for tablet f32dbc3da8894f6cbbf52b501c537a5b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:09.035830  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 5741b07c783e4193be39d19fba6c5cec (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:09.040023  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525f0b170c13486a8942f69d40971d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.042639  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:09.046247  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 74265c5d23584d47a1a5cca905a68876 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:09.050678  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5741b07c783e4193be39d19fba6c5cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.054072  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32dbc3da8894f6cbbf52b501c537a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.058120  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.059031  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5fb2214fbb40f0a702dbf5aa32966f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:09.059360  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 32b6ee54d0d6479194b8ac687bbb1754 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:09.060417  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5fb2214fbb40f0a702dbf5aa32966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.061640  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74265c5d23584d47a1a5cca905a68876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.069080  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 1805a53fe3fc412094cd75832a6e1208 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:09.070501  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1805a53fe3fc412094cd75832a6e1208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.070454  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 831f9b0847f7413f9c00a2e4c5101ba5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:09.071501  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 172d54128ab740c980d9c27aa0ff1761 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:09.071934  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831f9b0847f7413f9c00a2e4c5101ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.073540  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1b737426124612a1ea1599be6115a0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:09.074577  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1805a53fe3fc412094cd75832a6e1208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.025399  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 831f9b0847f7413f9c00a2e4c5101ba5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:09.076926  1667 tablet_service.cc:1511] Processing CreateTablet for tablet a2b55a7fa2a04544a73c2fa785686919 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:09.086949  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 71c02c60c1a5490183c0690cd8c98176 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:09.097530  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 10aca507e378431ea54a6cce71c236fc (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:09.107908  1723 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:09.120353  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1b737426124612a1ea1599be6115a0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:09.121919  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1b737426124612a1ea1599be6115a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.124979  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10aca507e378431ea54a6cce71c236fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:09.126102  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:09.127115  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1b737426124612a1ea1599be6115a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.130365  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 9e38d8589e334785b807e494aae5aea4 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:09.134138  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 71c02c60c1a5490183c0690cd8c98176 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:09.134141  1524 tablet_service.cc:1511] Processing CreateTablet for tablet a2b55a7fa2a04544a73c2fa785686919 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:09.140053  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b55a7fa2a04544a73c2fa785686919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.141615  1724 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:09.142800  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 10aca507e378431ea54a6cce71c236fc (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:09.144210  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10aca507e378431ea54a6cce71c236fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.144642  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 172d54128ab740c980d9c27aa0ff1761 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:09.148249  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 049eb4ac8c3a4cb896b8b236a384b04d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:09.185895  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c02c60c1a5490183c0690cd8c98176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.186458  1725 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:09.190811  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 172d54128ab740c980d9c27aa0ff1761 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:09.191836  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049eb4ac8c3a4cb896b8b236a384b04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.192147  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172d54128ab740c980d9c27aa0ff1761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.192018  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 555751dc108841d481db7da6ccbf13d5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:09.190843  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa902e4626a464fabe120fcad834ad0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:09.193387  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 555751dc108841d481db7da6ccbf13d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.195327  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172d54128ab740c980d9c27aa0ff1761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.206755  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 32b6ee54d0d6479194b8ac687bbb1754 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:09.151885  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 1805a53fe3fc412094cd75832a6e1208 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:09.132390  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b55a7fa2a04544a73c2fa785686919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.152635  1724 tablet_bootstrap.cc:654] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:09.208283  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b6ee54d0d6479194b8ac687bbb1754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.121711  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 049eb4ac8c3a4cb896b8b236a384b04d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:09.210973  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049eb4ac8c3a4cb896b8b236a384b04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.213119  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c02c60c1a5490183c0690cd8c98176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.161233  1723 tablet_bootstrap.cc:654] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:09.099627  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 32b6ee54d0d6479194b8ac687bbb1754 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:09.169355  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 831f9b0847f7413f9c00a2e4c5101ba5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:09.213635  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1b737426124612a1ea1599be6115a0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:09.215308  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b6ee54d0d6479194b8ac687bbb1754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.218371  1725 tablet_bootstrap.cc:654] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:09.219393  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831f9b0847f7413f9c00a2e4c5101ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.218961  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831f9b0847f7413f9c00a2e4c5101ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.225932  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172d54128ab740c980d9c27aa0ff1761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.229902  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e38d8589e334785b807e494aae5aea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.233081  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa902e4626a464fabe120fcad834ad0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:09.233855  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa902e4626a464fabe120fcad834ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.234447  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa902e4626a464fabe120fcad834ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.237179  1593 tablet_service.cc:1511] Processing CreateTablet for tablet a2b55a7fa2a04544a73c2fa785686919 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:09.238020  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1b737426124612a1ea1599be6115a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.245301  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 049eb4ac8c3a4cb896b8b236a384b04d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:09.250231  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 24b6b7dd0e6c4ab2911c8b5fffbdf68c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:09.266726  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b6b7dd0e6c4ab2911c8b5fffbdf68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.264564  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b6ee54d0d6479194b8ac687bbb1754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.271003  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 16be7685d9b14fe8a557b6d7572c0296 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:09.272711  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16be7685d9b14fe8a557b6d7572c0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.169296  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 9e38d8589e334785b807e494aae5aea4 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:09.280401  1724 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:09.280917  1724 ts_tablet_manager.cc:1403] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.140s	user 0.009s	sys 0.012s
I20260709 12:57:09.284456  1724 raft_consensus.cc:359] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.285311  1724 raft_consensus.cc:385] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:09.277882  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1805a53fe3fc412094cd75832a6e1208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.292936  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e38d8589e334785b807e494aae5aea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.303841  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 24b6b7dd0e6c4ab2911c8b5fffbdf68c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:09.285714  1724 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:09.305281  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b6b7dd0e6c4ab2911c8b5fffbdf68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.305392  1724 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.305737  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 16be7685d9b14fe8a557b6d7572c0296 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:09.307081  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16be7685d9b14fe8a557b6d7572c0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.314080  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 71c02c60c1a5490183c0690cd8c98176 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:09.315155  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 10aca507e378431ea54a6cce71c236fc (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:09.317463  1723 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:09.318048  1723 ts_tablet_manager.cc:1403] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.210s	user 0.028s	sys 0.012s
I20260709 12:57:09.325469  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049eb4ac8c3a4cb896b8b236a384b04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.335126  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 33c0ebcbabe4464da9ad5ec0e0bffd73 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:09.336112  1725 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:09.335856  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 9e38d8589e334785b807e494aae5aea4 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:09.336557  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c0ebcbabe4464da9ad5ec0e0bffd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.336724  1725 ts_tablet_manager.cc:1403] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.151s	user 0.009s	sys 0.007s
I20260709 12:57:09.337747  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c02c60c1a5490183c0690cd8c98176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.339682  1559 heartbeater.cc:499] Master 127.0.107.254:38115 was elected leader, sending a full tablet report...
I20260709 12:57:09.344581  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10aca507e378431ea54a6cce71c236fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.339722  1725 raft_consensus.cc:359] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.348475  1725 raft_consensus.cc:385] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:09.351397  1725 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:09.351661  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 24b6b7dd0e6c4ab2911c8b5fffbdf68c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:09.352931  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b6b7dd0e6c4ab2911c8b5fffbdf68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.353332  1725 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.350654  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 555751dc108841d481db7da6ccbf13d5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:09.359120  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 555751dc108841d481db7da6ccbf13d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.368598  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 16be7685d9b14fe8a557b6d7572c0296 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:09.378265  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa902e4626a464fabe120fcad834ad0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:09.380009  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa902e4626a464fabe120fcad834ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.346812  1723 raft_consensus.cc:359] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.382100  1723 raft_consensus.cc:385] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:09.382498  1723 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:09.371500  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b55a7fa2a04544a73c2fa785686919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.385926  1518 tablet_service.cc:1511] Processing CreateTablet for tablet fd192848be4940efa1406c590f3d2e31 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:09.387830  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 33c0ebcbabe4464da9ad5ec0e0bffd73 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:09.389211  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c0ebcbabe4464da9ad5ec0e0bffd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.383286  1723 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.389724  1670 tablet_service.cc:1511] Processing CreateTablet for tablet fd192848be4940efa1406c590f3d2e31 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:09.393008  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16be7685d9b14fe8a557b6d7572c0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.394671  1724 ts_tablet_manager.cc:1434] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.113s	user 0.015s	sys 0.002s
I20260709 12:57:09.397310  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e38d8589e334785b807e494aae5aea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.405898  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd192848be4940efa1406c590f3d2e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.408517  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 8085a85190ed479aa2fc71cd75382085 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:09.412262  1664 tablet_service.cc:1511] Processing CreateTablet for tablet d2805f2fabf7471abe8442f6cbb32668 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:09.417520  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 95ab1b1d42384792aa38ad0afd616616 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:09.427313  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 8085a85190ed479aa2fc71cd75382085 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:09.428951  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8085a85190ed479aa2fc71cd75382085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.442696  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd192848be4940efa1406c590f3d2e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.443231  1724 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:09.446161  1725 ts_tablet_manager.cc:1434] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.109s	user 0.010s	sys 0.006s
I20260709 12:57:09.447082  1634 heartbeater.cc:499] Master 127.0.107.254:38115 was elected leader, sending a full tablet report...
I20260709 12:57:09.450197  1725 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:09.451098  1673 tablet_service.cc:1511] Processing CreateTablet for tablet cd2184d3b5e64d249be4c7045975f9a8 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:09.458859  1520 tablet_service.cc:1511] Processing CreateTablet for tablet d2805f2fabf7471abe8442f6cbb32668 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:09.459667  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcbd7c7333145a3836ea9b6def4d286 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:09.461380  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 95ab1b1d42384792aa38ad0afd616616 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:09.473454  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ab1b1d42384792aa38ad0afd616616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.476541  1516 tablet_service.cc:1511] Processing CreateTablet for tablet cd0b30c9de3e4d5d8160a5cc3d2e1a9c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:09.466816  1519 tablet_service.cc:1511] Processing CreateTablet for tablet cd2184d3b5e64d249be4c7045975f9a8 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:09.481513  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ab1b1d42384792aa38ad0afd616616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.485877  1708 heartbeater.cc:499] Master 127.0.107.254:38115 was elected leader, sending a full tablet report...
I20260709 12:57:09.496706  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8085a85190ed479aa2fc71cd75382085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.482695  1730 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:09.497639  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcbd7c7333145a3836ea9b6def4d286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.506542  1668 tablet_service.cc:1511] Processing CreateTablet for tablet cd0b30c9de3e4d5d8160a5cc3d2e1a9c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:09.491922  1724 tablet_bootstrap.cc:654] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:09.507875  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0b30c9de3e4d5d8160a5cc3d2e1a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.488828  1725 tablet_bootstrap.cc:654] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:09.510077  1731 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:09.492688  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0b30c9de3e4d5d8160a5cc3d2e1a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.497468  1730 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.510617  1731 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.492899  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6bb2550d6a4cceaf445ac56633cf86 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:09.509289  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 22d7b940a3774b7fbb80a3a69355356b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:09.547605  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2184d3b5e64d249be4c7045975f9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.585045  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2805f2fabf7471abe8442f6cbb32668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.539376  1730 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:09.542543  1731 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:09.610891  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d7b940a3774b7fbb80a3a69355356b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.626909  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6bb2550d6a4cceaf445ac56633cf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.627790  1597 tablet_service.cc:1511] Processing CreateTablet for tablet d2805f2fabf7471abe8442f6cbb32668 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:09.628190  1592 tablet_service.cc:1511] Processing CreateTablet for tablet fd192848be4940efa1406c590f3d2e31 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:09.629074  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2805f2fabf7471abe8442f6cbb32668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.634737  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 8085a85190ed479aa2fc71cd75382085 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:09.634996  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7a515ee1ef4faca822cc4e1083ab3a (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:09.636089  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8085a85190ed479aa2fc71cd75382085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.636478  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 33c0ebcbabe4464da9ad5ec0e0bffd73 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:09.639235  1724 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:09.639781  1724 ts_tablet_manager.cc:1403] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.204s	user 0.017s	sys 0.002s
I20260709 12:57:09.642001  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 95ab1b1d42384792aa38ad0afd616616 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:09.643886  1665 tablet_service.cc:1511] Processing CreateTablet for tablet d859537ee3eb49969dd821b3f75dd33e (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:09.645242  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2805f2fabf7471abe8442f6cbb32668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.646270  1597 tablet_service.cc:1511] Processing CreateTablet for tablet cd2184d3b5e64d249be4c7045975f9a8 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:09.647639  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c0ebcbabe4464da9ad5ec0e0bffd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.649241  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd192848be4940efa1406c590f3d2e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.650974  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ab1b1d42384792aa38ad0afd616616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.650779  1724 raft_consensus.cc:359] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.651521  1724 raft_consensus.cc:385] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:09.651816  1724 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:09.653757  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcbd7c7333145a3836ea9b6def4d286 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:09.655419  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6bb2550d6a4cceaf445ac56633cf86 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:09.658191  1724 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.658777  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 22d7b940a3774b7fbb80a3a69355356b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:09.676110  1723 ts_tablet_manager.cc:1434] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.358s	user 0.027s	sys 0.016s
I20260709 12:57:09.626415  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2184d3b5e64d249be4c7045975f9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.653088  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 22d7b940a3774b7fbb80a3a69355356b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:09.687132  1723 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:09.701957  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d859537ee3eb49969dd821b3f75dd33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.703749  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6bb2550d6a4cceaf445ac56633cf86 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:09.688439  1522 tablet_service.cc:1511] Processing CreateTablet for tablet a349b676466f492aac774f89c8e55e48 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:09.690080  1729 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:09.705933  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d7b940a3774b7fbb80a3a69355356b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.706614  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a349b676466f492aac774f89c8e55e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.690824  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5c791dce8144e7886b1312c2b6200b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:57:09.691843  1518 tablet_service.cc:1511] Processing CreateTablet for tablet d859537ee3eb49969dd821b3f75dd33e (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:09.705971  1729 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.710402  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5c791dce8144e7886b1312c2b6200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.693866  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5c791dce8144e7886b1312c2b6200b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:57:09.629351  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 555751dc108841d481db7da6ccbf13d5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:09.683207  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2184d3b5e64d249be4c7045975f9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.718621  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d859537ee3eb49969dd821b3f75dd33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.730840  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6bb2550d6a4cceaf445ac56633cf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.724085  1723 tablet_bootstrap.cc:654] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:09.743901  1595 tablet_service.cc:1511] Processing CreateTablet for tablet cd0b30c9de3e4d5d8160a5cc3d2e1a9c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:09.744820  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5c791dce8144e7886b1312c2b6200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.746232  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7a515ee1ef4faca822cc4e1083ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:09.748914  1417 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 61724.5us
I20260709 12:57:09.749702  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcbd7c7333145a3836ea9b6def4d286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.753773  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d7b940a3774b7fbb80a3a69355356b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.760099  1724 ts_tablet_manager.cc:1434] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.004s
I20260709 12:57:09.761225  1724 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:09.762785  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcbd7c7333145a3836ea9b6def4d286 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:09.771708  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:09.772220  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:57:09.782228  1575 leader_election.cc:343] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:09.786659  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 00631bb4062844edb73eb9b0810cc59c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:57:09.788411  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00631bb4062844edb73eb9b0810cc59c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.796454  1516 tablet_service.cc:1511] Processing CreateTablet for tablet b3a9e9cba0fe4487a6b7c88de6410770 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:09.797689  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0b30c9de3e4d5d8160a5cc3d2e1a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.798285  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a9e9cba0fe4487a6b7c88de6410770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.798440  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 555751dc108841d481db7da6ccbf13d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.800529  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6bb2550d6a4cceaf445ac56633cf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.804332  1729 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:09.836002  1724 tablet_bootstrap.cc:654] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:09.855201  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7a515ee1ef4faca822cc4e1083ab3a (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:09.856671  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7a515ee1ef4faca822cc4e1083ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.824753  1725 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:09.862071  1725 ts_tablet_manager.cc:1403] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.412s	user 0.014s	sys 0.004s
I20260709 12:57:09.870395  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:09.830353  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcbd7c7333145a3836ea9b6def4d286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.841168  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3ea752cffa4a138dd2984b56316ae5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:09.882706  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3ea752cffa4a138dd2984b56316ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.883015  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7a515ee1ef4faca822cc4e1083ab3a (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:09.885113  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7a515ee1ef4faca822cc4e1083ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.874209  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1466701b8a43e09c464cd804cf55c6 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:09.865172  1725 raft_consensus.cc:359] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.900224  1725 raft_consensus.cc:385] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:09.916330  1522 tablet_service.cc:1511] Processing CreateTablet for tablet d08227f27afa422683d506a582939c6d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:09.917090  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:09.930207  1670 tablet_service.cc:1511] Processing CreateTablet for tablet a349b676466f492aac774f89c8e55e48 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:09.931658  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a349b676466f492aac774f89c8e55e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.936105  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 00631bb4062844edb73eb9b0810cc59c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:57:09.944005  1572 leader_election.cc:343] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:09.944509  1572 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:09.945766  1730 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:09.949400  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3ea752cffa4a138dd2984b56316ae5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:09.951092  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1466701b8a43e09c464cd804cf55c6 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:09.923360  1672 tablet_service.cc:1511] Processing CreateTablet for tablet b3a9e9cba0fe4487a6b7c88de6410770 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:09.956190  1723 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:09.956702  1723 ts_tablet_manager.cc:1403] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.270s	user 0.019s	sys 0.024s
I20260709 12:57:09.960215  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1466701b8a43e09c464cd804cf55c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.937431  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00631bb4062844edb73eb9b0810cc59c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.965869  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3ea752cffa4a138dd2984b56316ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.918215  1725 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
W20260709 12:57:09.971918  1649 leader_election.cc:343] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:09.972908  1725 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.974654  1609 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:09.974934  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a9e9cba0fe4487a6b7c88de6410770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.974747  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3ea752cffa4a138dd2984b56316ae5 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:09.976153  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3ea752cffa4a138dd2984b56316ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.965353  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5c791dce8144e7886b1312c2b6200b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:57:09.977856  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:09.981357  1731 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:09.983270  1731 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:09.983659  1731 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:09.983496  1598 tablet_service.cc:1511] Processing CreateTablet for tablet a349b676466f492aac774f89c8e55e48 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:09.985987  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5c791dce8144e7886b1312c2b6200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.987722  1723 raft_consensus.cc:359] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.988433  1723 raft_consensus.cc:385] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:09.988731  1723 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:09.983856  1599 tablet_service.cc:1511] Processing CreateTablet for tablet d859537ee3eb49969dd821b3f75dd33e (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:09.989626  1723 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:09.990451  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d859537ee3eb49969dd821b3f75dd33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.990922  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 00631bb4062844edb73eb9b0810cc59c (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:57:09.994285  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08227f27afa422683d506a582939c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:09.994510  1594 tablet_service.cc:1511] Processing CreateTablet for tablet b3a9e9cba0fe4487a6b7c88de6410770 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:09.998775  1725 ts_tablet_manager.cc:1434] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.000s
I20260709 12:57:09.999780  1725 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:10.000829  1731 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.005769  1515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 34) took 1018 ms. Trace:
I20260709 12:57:10.006232  1515 rpcz_store.cc:276] 0709 12:57:08.986999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.634105 (+647106us) service_pool.cc:224] Handling call
0709 12:57:09.688438 (+ 54333us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69cc84c 00007f25d69a9ac3 00007f25d6958400 00007f25cfdddaf4 00007f25cfddda82 00007f25cfddd9b1
0709 12:57:09.732515 (+ 44077us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.732655 (+   140us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:09.930060 (+197405us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:09.961315 (+ 31255us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.005706 (+ 44391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14980864}
I20260709 12:57:10.008718  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 9b381ac61d4149f096c7f58d4c53f925 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:09.982415  1523 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 33) took 1001 ms. Trace:
I20260709 12:57:09.980813  1517 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 32) took 1006 ms. Trace:
I20260709 12:57:10.010406  1517 rpcz_store.cc:276] 0709 12:57:08.973757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.508376 (+534619us) service_pool.cc:224] Handling call
0709 12:57:09.519437 (+ 11061us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.519531 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:09.937864 (+418333us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:09.965234 (+ 27370us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:09.980145 (+ 14911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.012768  1523 rpcz_store.cc:276] 0709 12:57:08.980573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.520799 (+540226us) service_pool.cc:224] Handling call
0709 12:57:09.728365 (+207566us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.732255 (+  3890us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:09.792550 (+ 60295us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:09.943381 (+150831us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:09.981493 (+ 38112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8073}
I20260709 12:57:10.014930  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:10.017584  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1466701b8a43e09c464cd804cf55c6 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:10.018777  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1466701b8a43e09c464cd804cf55c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.019909  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 9b381ac61d4149f096c7f58d4c53f925 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:10.021142  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b381ac61d4149f096c7f58d4c53f925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.021241  1724 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:10.021803  1724 ts_tablet_manager.cc:1403] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.261s	user 0.009s	sys 0.008s
I20260709 12:57:10.024670  1724 raft_consensus.cc:359] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.024986  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9ed6ddb0bc46ec944198e737aa5f57 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:10.025452  1724 raft_consensus.cc:385] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.027077  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:10.028625  1498 leader_election.cc:343] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.029505  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00631bb4062844edb73eb9b0810cc59c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.030113  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a349b676466f492aac774f89c8e55e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.030907  1731 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:10.031500  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:10.031889  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a9e9cba0fe4487a6b7c88de6410770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.032091  1609 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.034008  1729 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:10.034492  1729 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.036531  1729 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:10.037380  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:10.038882  1498 leader_election.cc:343] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.047643  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:10.049068  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.052845  1668 tablet_service.cc:1511] Processing CreateTablet for tablet ae1773d932be4bf48dbb9a17cd28bad4 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:10.055909  1596 tablet_service.cc:1511] Processing CreateTablet for tablet d08227f27afa422683d506a582939c6d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:10.063153  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1773d932be4bf48dbb9a17cd28bad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.066490  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:10.067193  1683 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:10.068527  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:10.068642  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 7340b50d876f414287d4fe7df22e3248 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:57:10.070475  1497 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:57:10.071691  1497 leader_election.cc:343] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.072109  1497 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:10.073031  1729 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:10.076188  1729 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:10.076578  1729 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.077121  1723 ts_tablet_manager.cc:1434] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.120s	user 0.011s	sys 0.006s
I20260709 12:57:10.080756  1723 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:10.080420  1669 tablet_service.cc:1511] Processing CreateTablet for tablet d08227f27afa422683d506a582939c6d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:10.081755  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08227f27afa422683d506a582939c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.066843  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9ed6ddb0bc46ec944198e737aa5f57 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:10.083292  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9ed6ddb0bc46ec944198e737aa5f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.094063  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1466701b8a43e09c464cd804cf55c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.084473  1664 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38972 (request call id 27) took 1123 ms. Trace:
I20260709 12:57:10.084730  1729 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.086027  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:10.026224  1724 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.099902  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 9df8036dd002479a8e558d2ce8e13e9b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:10.103883  1590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 34) took 1003 ms. Trace:
I20260709 12:57:10.104321  1590 rpcz_store.cc:276] 0709 12:57:09.100120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.816722 (+716602us) service_pool.cc:224] Handling call
0709 12:57:09.884382 (+ 67660us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.884564 (+   182us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:09.968934 (+ 84370us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.103354 (+134420us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.103819 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.088024  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 9b381ac61d4149f096c7f58d4c53f925 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:10.089932  1519 tablet_service.cc:1511] Processing CreateTablet for tablet ae1773d932be4bf48dbb9a17cd28bad4 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:10.091192  1521 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 37) took 1079 ms. Trace:
I20260709 12:57:10.106240  1521 rpcz_store.cc:276] 0709 12:57:09.012129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.692930 (+680801us) service_pool.cc:224] Handling call
0709 12:57:09.732671 (+ 39741us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.732760 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:09.946722 (+213962us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.063761 (+117039us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.091137 (+ 27376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.109242  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 9df8036dd002479a8e558d2ce8e13e9b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:10.109815  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08227f27afa422683d506a582939c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.110986  1724 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.111994  1533 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.112068  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b381ac61d4149f096c7f58d4c53f925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.113685  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7340b50d876f414287d4fe7df22e3248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.087821  1518 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 36) took 1088 ms. Trace:
I20260709 12:57:10.114063  1518 rpcz_store.cc:276] 0709 12:57:08.999626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.690946 (+691320us) service_pool.cc:224] Handling call
0709 12:57:09.710566 (+ 19620us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.710682 (+   116us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:09.905077 (+194395us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.035074 (+129997us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.087694 (+ 52620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.116077  1518 tablet_service.cc:1511] Processing CreateTablet for tablet cdb1450b85664ac0a6fa149c1f105679 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:10.093216  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 7340b50d876f414287d4fe7df22e3248 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:57:10.111020  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b381ac61d4149f096c7f58d4c53f925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.124384  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:10.128616  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:10.130362  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:10.130900  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:10.131174  1723 tablet_bootstrap.cc:654] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.131628  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:10.132408  1498 leader_election.cc:343] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.133772  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1773d932be4bf48dbb9a17cd28bad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.135190  1592 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 37) took 1018 ms. Trace:
I20260709 12:57:10.137833  1672 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38972 (request call id 38) took 1037 ms. Trace:
I20260709 12:57:10.139510  1672 rpcz_store.cc:276] 0709 12:57:09.100544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.917028 (+816484us) service_pool.cc:224] Handling call
0709 12:57:09.954352 (+ 37324us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.954442 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.077793 (+123351us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.133881 (+ 56088us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.137746 (+  3865us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.142985  1672 tablet_service.cc:1511] Processing CreateTablet for tablet cdb1450b85664ac0a6fa149c1f105679 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:10.133378  1729 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:10.145998  1729 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:10.146759  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df8036dd002479a8e558d2ce8e13e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.147141  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb1450b85664ac0a6fa149c1f105679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.166916  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9ed6ddb0bc46ec944198e737aa5f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.169857  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7340b50d876f414287d4fe7df22e3248. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:10.169678  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 98010.8us
I20260709 12:57:10.137482  1516 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 38) took 1117 ms. Trace:
I20260709 12:57:10.172274  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:10.175038  1683 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.178843  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:10.180162  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.181690  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb1450b85664ac0a6fa149c1f105679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.181638  1516 rpcz_store.cc:276] 0709 12:57:09.018702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.718890 (+700188us) service_pool.cc:224] Handling call
0709 12:57:09.797643 (+ 78753us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.797770 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:09.992842 (+195072us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.082075 (+ 89233us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.136357 (+ 54282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.183652  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 10ddaea2d1d945b78d8286cc74a41ff9 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:10.184911  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ddaea2d1d945b78d8286cc74a41ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.187671  1683 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:10.188966  1497 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:10.096084  1664 rpcz_store.cc:276] 0709 12:57:08.961365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.411321 (+449956us) service_pool.cc:224] Handling call
0709 12:57:09.413063 (+  1742us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.413150 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.006355 (+593205us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.083966 (+ 77611us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.084402 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.190047  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df8036dd002479a8e558d2ce8e13e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.190819  1729 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:10.191339  1729 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:10.191123  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:10.192165  1729 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.192377  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.196442  1725 tablet_bootstrap.cc:654] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.137197  1609 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:10.202376  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:10.203496  1749 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:10.204514  1749 raft_consensus.cc:697] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:10.207203  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9ed6ddb0bc46ec944198e737aa5f57 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:10.206853  1749 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.208498  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9ed6ddb0bc46ec944198e737aa5f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.135576  1592 rpcz_store.cc:276] 0709 12:57:09.158330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.964405 (+806075us) service_pool.cc:224] Handling call
0709 12:57:09.978267 (+ 13862us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.978375 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.071056 (+ 92681us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.134730 (+ 63674us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.135133 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.210361  1533 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:10.207072  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 10ddaea2d1d945b78d8286cc74a41ff9 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:10.224958  1593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 39) took 1065 ms. Trace:
I20260709 12:57:10.227406  1591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 40) took 1067 ms. Trace:
I20260709 12:57:10.230556  1431 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:10.219556  1522 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 42) took 1039 ms. Trace:
I20260709 12:57:10.249493  1598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 35) took 1149 ms. Trace:
I20260709 12:57:10.249972  1598 rpcz_store.cc:276] 0709 12:57:09.100548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.970989 (+870441us) service_pool.cc:224] Handling call
0709 12:57:09.984687 (+ 13698us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.984782 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.143462 (+158680us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.239542 (+ 96080us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.249430 (+  9888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.255458  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:10.211081  1592 tablet_service.cc:1511] Processing CreateTablet for tablet ae1773d932be4bf48dbb9a17cd28bad4 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:10.257308  1724 ts_tablet_manager.cc:1434] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.235s	user 0.008s	sys 0.000s
I20260709 12:57:10.257916  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ddaea2d1d945b78d8286cc74a41ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.262773  1673 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38972 (request call id 40) took 1104 ms. Trace:
I20260709 12:57:10.257527  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1773d932be4bf48dbb9a17cd28bad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.289551  1724 tablet_bootstrap.cc:492] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:10.289814  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.235478  1591 rpcz_store.cc:276] 0709 12:57:09.159652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.973804 (+814152us) service_pool.cc:224] Handling call
0709 12:57:09.975678 (+  1874us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.975781 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.077489 (+101708us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.226913 (+149424us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.227348 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.290455  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 7340b50d876f414287d4fe7df22e3248 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:57:10.291821  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7340b50d876f414287d4fe7df22e3248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.292378  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 9df8036dd002479a8e558d2ce8e13e9b (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:10.293677  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df8036dd002479a8e558d2ce8e13e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.242300  1522 rpcz_store.cc:276] 0709 12:57:09.180041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.915323 (+735282us) service_pool.cc:224] Handling call
0709 12:57:09.953354 (+ 38031us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.953483 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.107860 (+154377us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.200835 (+ 92975us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.218311 (+ 17476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.262691  1430 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:10.299109  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:10.300491  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.277915  1599 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 36) took 1164 ms. Trace:
I20260709 12:57:10.301002  1599 rpcz_store.cc:276] 0709 12:57:09.113721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.978536 (+864815us) service_pool.cc:224] Handling call
0709 12:57:09.989935 (+ 11399us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.990026 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.052100 (+ 62074us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.220896 (+168796us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.277814 (+ 56918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.302928  1599 tablet_service.cc:1511] Processing CreateTablet for tablet cdb1450b85664ac0a6fa149c1f105679 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:10.304297  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb1450b85664ac0a6fa149c1f105679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.305224  1723 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:10.267992  1725 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:10.305855  1723 ts_tablet_manager.cc:1403] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.225s	user 0.037s	sys 0.037s
I20260709 12:57:10.305927  1725 ts_tablet_manager.cc:1403] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.306s	user 0.014s	sys 0.001s
I20260709 12:57:10.234107  1593 rpcz_store.cc:276] 0709 12:57:09.159148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.989967 (+830819us) service_pool.cc:224] Handling call
0709 12:57:09.991706 (+  1739us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.991783 (+    77us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.141481 (+149698us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.224435 (+ 82954us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.224891 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.309451  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:10.310936  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.308997  1725 raft_consensus.cc:359] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.315748  1725 raft_consensus.cc:385] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.314559  1594 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 38) took 1155 ms. Trace:
I20260709 12:57:10.288962  1673 rpcz_store.cc:276] 0709 12:57:09.158530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.948429 (+789899us) service_pool.cc:224] Handling call
0709 12:57:09.950258 (+  1829us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.950349 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.071380 (+121031us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.262187 (+190807us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.262715 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.325490  1594 rpcz_store.cc:276] 0709 12:57:09.158817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.981611 (+822794us) service_pool.cc:224] Handling call
0709 12:57:09.995293 (+ 13682us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:09.995392 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.165329 (+169937us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.303575 (+138246us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.314490 (+ 10915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.329759  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 10ddaea2d1d945b78d8286cc74a41ff9 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:10.330358  1673 tablet_service.cc:1511] Processing CreateTablet for tablet e050081dd8c146df92c3ba8d2500e7f0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:57:10.335685  1667 tablet_service.cc:1511] Processing CreateTablet for tablet e1760e23cca344b0a0ed3ed897bae95f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:57:10.336872  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e050081dd8c146df92c3ba8d2500e7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.338164  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1760e23cca344b0a0ed3ed897bae95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.344412  1518 tablet_service.cc:1511] Processing CreateTablet for tablet e1760e23cca344b0a0ed3ed897bae95f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:57:10.325068  1725 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.333745  1517 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 45) took 1063 ms. Trace:
I20260709 12:57:10.331058  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ddaea2d1d945b78d8286cc74a41ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.356299  1517 rpcz_store.cc:276] 0709 12:57:09.270807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.021792 (+750985us) service_pool.cc:224] Handling call
0709 12:57:10.090610 (+ 68818us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.090722 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.309601 (+218879us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.333203 (+ 23602us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.333683 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.359822  1595 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 43) took 1142 ms. Trace:
I20260709 12:57:10.360199  1595 rpcz_store.cc:276] 0709 12:57:09.217044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.087060 (+870016us) service_pool.cc:224] Handling call
0709 12:57:10.107531 (+ 20471us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.108365 (+   834us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.228554 (+120189us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.359269 (+130715us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.359760 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.360886  1517 tablet_service.cc:1511] Processing CreateTablet for tablet bf4ba581fa344d64b772795f456096bf (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:10.347335  1590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 44) took 1118 ms. Trace:
I20260709 12:57:10.361883  1590 rpcz_store.cc:276] 0709 12:57:09.228832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.105405 (+876573us) service_pool.cc:224] Handling call
0709 12:57:10.131173 (+ 25768us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.131270 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.251522 (+120252us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.346837 (+ 95315us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.347276 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.345042  1520 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 47) took 1010 ms. Trace:
I20260709 12:57:10.362578  1667 tablet_service.cc:1511] Processing CreateTablet for tablet bf4ba581fa344d64b772795f456096bf (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:10.365607  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4ba581fa344d64b772795f456096bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.367455  1590 tablet_service.cc:1511] Processing CreateTablet for tablet e050081dd8c146df92c3ba8d2500e7f0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:57:10.350208  1597 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 41) took 1174 ms. Trace:
I20260709 12:57:10.392618  1597 rpcz_store.cc:276] 0709 12:57:09.176175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.016652 (+840477us) service_pool.cc:224] Handling call
0709 12:57:10.018405 (+  1753us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.018498 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.249125 (+230627us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.349707 (+100582us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.350146 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.351790  1515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 43) took 1148 ms. Trace:
I20260709 12:57:10.369915  1725 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.378265  1669 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38972 (request call id 42) took 1193 ms. Trace:
I20260709 12:57:10.394903  1669 rpcz_store.cc:276] 0709 12:57:09.185149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:09.969391 (+784242us) service_pool.cc:224] Handling call
0709 12:57:10.081290 (+111899us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.081371 (+    81us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.227802 (+146431us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.377754 (+149952us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.378205 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.382447  1520 rpcz_store.cc:276] 0709 12:57:09.334316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.092338 (+758022us) service_pool.cc:224] Handling call
0709 12:57:10.138108 (+ 45770us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.138315 (+   207us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.330855 (+192540us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.344529 (+ 13674us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.344981 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.397120  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 57ee981b108d48998c03e57930745dce (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:10.378681  1519 tablet_service.cc:1511] Processing CreateTablet for tablet e050081dd8c146df92c3ba8d2500e7f0 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:57:10.398960  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e050081dd8c146df92c3ba8d2500e7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.399008  1725 ts_tablet_manager.cc:1434] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.000s
I20260709 12:57:10.400115  1725 tablet_bootstrap.cc:492] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:10.364866  1668 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38972 (request call id 46) took 1029 ms. Trace:
I20260709 12:57:10.400522  1668 rpcz_store.cc:276] 0709 12:57:09.333652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.051908 (+718256us) service_pool.cc:224] Handling call
0709 12:57:10.062687 (+ 10779us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.062784 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.135611 (+ 72827us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.332125 (+196514us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.363385 (+ 31260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.402683  1668 tablet_service.cc:1511] Processing CreateTablet for tablet b00f4dc45e904f49a3231fc0c487b88d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:10.384022  1666 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38972 (request call id 44) took 1153 ms. Trace:
I20260709 12:57:10.403928  1666 rpcz_store.cc:276] 0709 12:57:09.230486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.044210 (+813724us) service_pool.cc:224] Handling call
0709 12:57:10.048580 (+  4370us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.048675 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.126124 (+ 77449us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.357524 (+231400us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.383961 (+ 26437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.386688  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4ba581fa344d64b772795f456096bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.394663  1597 tablet_service.cc:1511] Processing CreateTablet for tablet e1760e23cca344b0a0ed3ed897bae95f (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:57:10.406035  1672 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38972 (request call id 49) took 1026 ms. Trace:
I20260709 12:57:10.384069  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:10.350279  1723 raft_consensus.cc:359] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.406459  1672 rpcz_store.cc:276] 0709 12:57:09.379785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.142065 (+762280us) service_pool.cc:224] Handling call
0709 12:57:10.143997 (+  1932us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.144199 (+   202us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.342543 (+198344us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.381526 (+ 38983us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.405978 (+ 24452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.407121  1723 raft_consensus.cc:385] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.407514  1723 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.408507  1724 tablet_bootstrap.cc:654] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.408433  1723 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.410825  1723 ts_tablet_manager.cc:1434] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.002s
I20260709 12:57:10.411820  1723 tablet_bootstrap.cc:492] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:10.393174  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e050081dd8c146df92c3ba8d2500e7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.413946  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00f4dc45e904f49a3231fc0c487b88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.416419  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.416828  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 57ee981b108d48998c03e57930745dce (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:10.418167  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ee981b108d48998c03e57930745dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.406802  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 390bda9334de482bb1f2274e10fe5743 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:10.421903  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1760e23cca344b0a0ed3ed897bae95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.422279  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390bda9334de482bb1f2274e10fe5743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.394642  1515 rpcz_store.cc:276] 0709 12:57:09.202946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.007777 (+804831us) service_pool.cc:224] Handling call
0709 12:57:10.009550 (+  1773us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.045406 (+ 35856us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.302138 (+256732us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.351222 (+ 49084us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.351733 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.387332  1670 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38972 (request call id 48) took 1024 ms. Trace:
I20260709 12:57:10.435678  1725 tablet_bootstrap.cc:654] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.438712  1522 tablet_service.cc:1511] Processing CreateTablet for tablet b00f4dc45e904f49a3231fc0c487b88d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:10.446831  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 390bda9334de482bb1f2274e10fe5743 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:10.449317  1596 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 45) took 1169 ms. Trace:
I20260709 12:57:10.449680  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1760e23cca344b0a0ed3ed897bae95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.450521  1749 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:10.450906  1598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 47) took 1108 ms. Trace:
I20260709 12:57:10.450982  1749 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.443055  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ee981b108d48998c03e57930745dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.454857  1598 rpcz_store.cc:276] 0709 12:57:09.342021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.284298 (+942277us) service_pool.cc:224] Handling call
0709 12:57:10.291328 (+  7030us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.291427 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.386603 (+ 95176us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.450256 (+ 63653us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.450785 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.461838  1749 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:10.463135  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:10.464000  1598 tablet_service.cc:1511] Processing CreateTablet for tablet bf4ba581fa344d64b772795f456096bf (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:10.464464  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:10.465399  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4ba581fa344d64b772795f456096bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:10.465898  1649 leader_election.cc:343] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:10.467104  1647 leader_election.cc:343] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.467568  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:10.456198  1599 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 49) took 1082 ms. Trace:
I20260709 12:57:10.468391  1599 rpcz_store.cc:276] 0709 12:57:09.373350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.302014 (+928664us) service_pool.cc:224] Handling call
0709 12:57:10.303708 (+  1694us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.303944 (+   236us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.382346 (+ 78402us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.437261 (+ 54915us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.455327 (+ 18066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.467700  1523 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 44) took 1241 ms. Trace:
I20260709 12:57:10.471782  1749 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:10.470482  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00f4dc45e904f49a3231fc0c487b88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.475220  1592 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 46) took 1170 ms. Trace:
I20260709 12:57:10.475836  1592 rpcz_store.cc:276] 0709 12:57:09.304733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.210070 (+905337us) service_pool.cc:224] Handling call
0709 12:57:10.257046 (+ 46976us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.257142 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.371350 (+114208us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.474525 (+103175us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.475142 (+   617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.482738  1592 tablet_service.cc:1511] Processing CreateTablet for tablet b00f4dc45e904f49a3231fc0c487b88d (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:10.483704  1591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 48) took 1121 ms. Trace:
I20260709 12:57:10.484113  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 57ee981b108d48998c03e57930745dce (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:10.487973  1724 tablet_bootstrap.cc:492] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:10.488757  1724 ts_tablet_manager.cc:1403] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.199s	user 0.009s	sys 0.006s
I20260709 12:57:10.489343  1591 rpcz_store.cc:276] 0709 12:57:09.361976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.291316 (+929340us) service_pool.cc:224] Handling call
0709 12:57:10.293236 (+  1920us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.293330 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.393311 (+ 99981us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.483225 (+ 89914us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.483646 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.489985  1524 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 50) took 1081 ms. Trace:
I20260709 12:57:10.490365  1524 rpcz_store.cc:276] 0709 12:57:09.408122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.163955 (+755833us) service_pool.cc:224] Handling call
0709 12:57:10.179702 (+ 15747us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.179796 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.375203 (+195407us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.470406 (+ 95203us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.489915 (+ 19509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.489099  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ee981b108d48998c03e57930745dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.492803  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00f4dc45e904f49a3231fc0c487b88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.472106  1523 rpcz_store.cc:276] 0709 12:57:09.226460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.013908 (+787448us) service_pool.cc:224] Handling call
0709 12:57:10.051598 (+ 37690us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873e9c 00007f25ce873a5b 00007f25d778cc09 00007f25d68e6ee0 00007f25d69cc831 00007f25d69a9ac3 00007f25d6958400 00007f25cfdddaf4 00007f25cfddda82 00007f25cfddd9b1
0709 12:57:10.086437 (+ 34839us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.086544 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.397865 (+311321us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.467193 (+ 69328us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.467639 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11760512}
I20260709 12:57:10.502611  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 390bda9334de482bb1f2274e10fe5743 (DEFAULT_TABLE table=test-workload [id=6db8cd385acd4c179f73a367faaa61c1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:10.503892  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390bda9334de482bb1f2274e10fe5743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.505303  1730 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:10.449759  1596 rpcz_store.cc:276] 0709 12:57:09.280329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.170990 (+890661us) service_pool.cc:224] Handling call
0709 12:57:10.208020 (+ 37030us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.208122 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.375180 (+167058us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.445718 (+ 70538us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.449259 (+  3541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.505805  1730 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.507912  1730 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:10.508713  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:10.511408  1593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 50) took 1085 ms. Trace:
I20260709 12:57:10.511807  1593 rpcz_store.cc:276] 0709 12:57:09.426368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.308412 (+882044us) service_pool.cc:224] Handling call
0709 12:57:10.310460 (+  2048us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.310561 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.428798 (+118237us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.510929 (+ 82131us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.511347 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.514349  1516 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 51) took 1027 ms. Trace:
I20260709 12:57:10.515503  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:10.516316  1683 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:10.517659  1572 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:10.518852  1730 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.427472  1670 rpcz_store.cc:276] 0709 12:57:09.362734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.098911 (+736177us) service_pool.cc:224] Handling call
0709 12:57:10.100813 (+  1902us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.100910 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.305748 (+204838us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.386819 (+ 81071us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.387273 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.514765  1516 rpcz_store.cc:276] 0709 12:57:09.486563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.182711 (+696148us) service_pool.cc:224] Handling call
0709 12:57:10.184475 (+  1764us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.184564 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.403671 (+219107us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.513870 (+110199us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.514291 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.521467  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390bda9334de482bb1f2274e10fe5743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:10.523670  1724 raft_consensus.cc:359] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.515838  1521 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60874 (request call id 48) took 1170 ms. Trace:
I20260709 12:57:10.531323  1724 raft_consensus.cc:385] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.542577  1724 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.546177  1730 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:10.547077  1723 tablet_bootstrap.cc:654] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.550593  1724 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.557021  1725 tablet_bootstrap.cc:492] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:10.557786  1725 ts_tablet_manager.cc:1403] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.158s	user 0.003s	sys 0.023s
I20260709 12:57:10.558610  1724 ts_tablet_manager.cc:1434] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.001s
I20260709 12:57:10.534068  1521 rpcz_store.cc:276] 0709 12:57:09.345471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.108188 (+762717us) service_pool.cc:224] Handling call
0709 12:57:10.110146 (+  1958us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.110239 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.353499 (+243260us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.515167 (+161668us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.515758 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.587260  1724 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:10.596535  1729 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:10.597258  1723 tablet_bootstrap.cc:492] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:10.597090  1729 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.597836  1723 ts_tablet_manager.cc:1403] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.186s	user 0.010s	sys 0.009s
I20260709 12:57:10.599434  1729 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:10.601323  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:10.603560  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:10.601014  1723 raft_consensus.cc:359] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:10.605022  1498 leader_election.cc:343] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.605084  1723 raft_consensus.cc:385] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.605854  1724 tablet_bootstrap.cc:654] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.605723  1723 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
W20260709 12:57:10.605648  1497 leader_election.cc:343] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.606810  1497 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:10.607187  1723 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.608204  1729 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:10.612425  1724 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:10.613149  1724 ts_tablet_manager.cc:1403] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 12:57:10.615271  1723 ts_tablet_manager.cc:1434] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:57:10.616781  1723 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:10.631191  1724 raft_consensus.cc:359] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.632011  1724 raft_consensus.cc:385] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.632301  1724 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.632789  1723 tablet_bootstrap.cc:654] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.633618  1724 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.639391  1724 ts_tablet_manager.cc:1434] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 12:57:10.640635  1724 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:10.647151  1725 raft_consensus.cc:359] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.648074  1725 raft_consensus.cc:385] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.648944  1725 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.650187  1725 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.650858  1724 tablet_bootstrap.cc:654] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.652427  1594 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60652 (request call id 51) took 1141 ms. Trace:
I20260709 12:57:10.652815  1725 ts_tablet_manager.cc:1434] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 12:57:10.652928  1594 rpcz_store.cc:276] 0709 12:57:09.511146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.328770 (+817624us) service_pool.cc:224] Handling call
0709 12:57:10.330583 (+  1813us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.330669 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.412640 (+ 81971us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.606618 (+193978us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.652360 (+ 45742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:10.657785  1725 tablet_bootstrap.cc:492] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:10.663712  1723 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:10.664503  1723 ts_tablet_manager.cc:1403] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.014s
I20260709 12:57:10.664911  1724 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:10.665447  1724 ts_tablet_manager.cc:1403] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 12:57:10.666790  1725 tablet_bootstrap.cc:654] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.668520  1723 raft_consensus.cc:359] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.669414  1723 raft_consensus.cc:385] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.669914  1723 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.669189  1724 raft_consensus.cc:359] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:10.670588  1724 raft_consensus.cc:385] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.670670  1723 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.671231  1724 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.672415  1724 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:10.675379  1723 ts_tablet_manager.cc:1434] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:57:10.676482  1723 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:10.683909  1723 tablet_bootstrap.cc:654] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.686815  1724 ts_tablet_manager.cc:1434] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:57:10.690940  1723 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:10.691483  1723 ts_tablet_manager.cc:1403] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:57:10.692144  1724 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:10.695495  1723 raft_consensus.cc:359] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.696476  1723 raft_consensus.cc:385] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.696798  1723 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.697755  1723 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.700130  1723 ts_tablet_manager.cc:1434] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:10.701476  1724 tablet_bootstrap.cc:654] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.701494  1725 tablet_bootstrap.cc:492] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:10.702219  1725 ts_tablet_manager.cc:1403] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.021s
I20260709 12:57:10.702695  1723 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:10.705531  1725 raft_consensus.cc:359] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.706388  1725 raft_consensus.cc:385] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.706738  1725 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.707875  1725 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.710069  1725 ts_tablet_manager.cc:1434] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:57:10.710400  1723 tablet_bootstrap.cc:654] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.711197  1725 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:10.720285  1725 tablet_bootstrap.cc:654] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.735967  1749 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:10.756402  1729 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:10.761076  1725 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:10.761895  1729 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:10.761780  1725 ts_tablet_manager.cc:1403] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.017s
I20260709 12:57:10.780718  1725 raft_consensus.cc:359] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:10.781809  1725 raft_consensus.cc:385] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.782194  1725 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.789837  1725 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:10.820649  1725 ts_tablet_manager.cc:1434] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260709 12:57:10.826836  1749 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:10.833856  1724 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:10.834481  1724 ts_tablet_manager.cc:1403] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.143s	user 0.049s	sys 0.043s
I20260709 12:57:10.835209  1723 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:10.835690  1723 ts_tablet_manager.cc:1403] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.133s	user 0.048s	sys 0.064s
I20260709 12:57:10.838099  1724 raft_consensus.cc:359] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.838743  1724 raft_consensus.cc:385] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.839035  1724 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.840132  1724 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.841524  1723 raft_consensus.cc:359] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.842218  1723 raft_consensus.cc:385] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.842326  1724 ts_tablet_manager.cc:1434] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:57:10.842536  1723 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.844192  1725 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:10.843438  1723 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.844728  1724 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:10.855898  1723 ts_tablet_manager.cc:1434] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.006s
I20260709 12:57:10.856366  1725 tablet_bootstrap.cc:654] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.857178  1773 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:10.857667  1773 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.859728  1773 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:10.860972  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:10.861651  1533 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:10.861795  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:10.862509  1723 tablet_bootstrap.cc:492] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:10.862973  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:57:10.863797  1647 leader_election.cc:343] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.863797  1773 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:10.871912  1773 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:10.872053  1723 tablet_bootstrap.cc:654] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.872133  1724 tablet_bootstrap.cc:654] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.874145  1773 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.881228  1725 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:10.881917  1725 ts_tablet_manager.cc:1403] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.017s
I20260709 12:57:10.884893  1773 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.885672  1725 raft_consensus.cc:359] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.886662  1725 raft_consensus.cc:385] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.886904  1773 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:10.887065  1725 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.887776  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:10.888353  1533 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.887981  1725 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.888777  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:57:10.890321  1647 leader_election.cc:343] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.891520  1773 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:10.894083  1724 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:10.892354  1730 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:10.893854  1773 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.894707  1724 ts_tablet_manager.cc:1403] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.003s
I20260709 12:57:10.894590  1730 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:10.896620  1730 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:10.897189  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:10.897840  1534 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:10.898491  1725 ts_tablet_manager.cc:1434] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.006s
I20260709 12:57:10.899183  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:10.899802  1725 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:10.900931  1773 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:10.901470  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:10.902305  1773 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:57:10.902503  1572 leader_election.cc:343] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.902805  1773 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:10.903307  1773 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.903559  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:10.904203  1534 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:10.905507  1575 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:10.906705  1730 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:10.907107  1730 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:10.907490  1730 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.908279  1533 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:10.909508  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:10.910320  1749 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:10.915047  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:10.917196  1647 leader_election.cc:343] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.919571  1724 raft_consensus.cc:359] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.920269  1724 raft_consensus.cc:385] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.920588  1724 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.921365  1724 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.923020  1773 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.925796  1773 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:10.922322  1725 tablet_bootstrap.cc:654] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.927155  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:10.927918  1534 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.930732  1723 tablet_bootstrap.cc:492] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:10.931350  1723 ts_tablet_manager.cc:1403] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.075s	user 0.028s	sys 0.035s
I20260709 12:57:10.935056  1723 raft_consensus.cc:359] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.935729  1773 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:10.935881  1723 raft_consensus.cc:385] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.936292  1749 raft_consensus.cc:697] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:10.936226  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:10.937479  1749 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:10.938336  1647 leader_election.cc:343] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.936213  1723 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.936267  1773 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.941247  1534 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:10.941709  1773 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:10.942728  1723 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.943214  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:57:10.946640  1649 leader_election.cc:343] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.915385  1730 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:10.943886  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:10.947393  1723 ts_tablet_manager.cc:1434] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:57:10.947474  1608 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:10.948900  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:10.949223  1723 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:10.950102  1773 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:10.950874  1773 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:10.951195  1773 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.954025  1429 catalog_manager.cc:5697] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:10.956820  1723 tablet_bootstrap.cc:654] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.943833  1724 ts_tablet_manager.cc:1434] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.002s
I20260709 12:57:10.959076  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:10.959492  1773 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.967729  1725 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:10.968186  1725 ts_tablet_manager.cc:1403] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.036s
I20260709 12:57:10.968423  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:10.969014  1773 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:10.969120  1723 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:10.968484  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:10.969726  1723 ts_tablet_manager.cc:1403] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
W20260709 12:57:10.969777  1649 leader_election.cc:343] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.969894  1608 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.971138  1725 raft_consensus.cc:359] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.971774  1725 raft_consensus.cc:385] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.972038  1725 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.972702  1723 raft_consensus.cc:359] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.972656  1725 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.973335  1723 raft_consensus.cc:385] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:10.961777  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:10.964459  1730 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:10.962707  1724 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:10.964226  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:10.975471  1534 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:10.975840  1608 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:10.977193  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:57:10.979310  1572 leader_election.cc:343] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:10.980201  1773 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:10.980729  1773 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:10.981231  1724 tablet_bootstrap.cc:654] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.981760  1725 ts_tablet_manager.cc:1434] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.004s
I20260709 12:57:10.981659  1773 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.983006  1725 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:10.960546  1749 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:10.983541  1749 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:10.973707  1723 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:10.984995  1749 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.986003  1723 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:10.988729  1725 tablet_bootstrap.cc:654] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.990134  1723 ts_tablet_manager.cc:1434] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:57:10.990989  1723 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:10.998368  1534 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:10.999831  1723 tablet_bootstrap.cc:654] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:10.999984  1575 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:11.001187  1730 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:11.005035  1725 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:11.005443  1725 ts_tablet_manager.cc:1403] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 12:57:11.006167  1730 raft_consensus.cc:697] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:11.007067  1730 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:11.008356  1725 raft_consensus.cc:359] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.009027  1725 raft_consensus.cc:385] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.009315  1725 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.009968  1725 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.021109  1724 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:11.022073  1724 ts_tablet_manager.cc:1403] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.013s
I20260709 12:57:11.024833  1724 raft_consensus.cc:359] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.025767  1724 raft_consensus.cc:385] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.026147  1724 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.029332  1724 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.035781  1723 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.035351  1432 catalog_manager.cc:5697] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:11.036409  1723 ts_tablet_manager.cc:1403] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.002s
I20260709 12:57:11.040124  1723 raft_consensus.cc:359] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:11.041013  1723 raft_consensus.cc:385] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.041330  1723 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.041877  1724 ts_tablet_manager.cc:1434] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:57:11.042840  1724 tablet_bootstrap.cc:492] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:11.043045  1723 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:11.043776  1725 ts_tablet_manager.cc:1434] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.020s
I20260709 12:57:11.045310  1725 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:11.046397  1749 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.046835  1749 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.046938  1431 catalog_manager.cc:5697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:11.049655  1749 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.045930  1723 ts_tablet_manager.cc:1434] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:57:11.050264  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.050805  1723 tablet_bootstrap.cc:492] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:11.050894  1534 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:11.051098  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.052457  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:57:11.053103  1647 leader_election.cc:343] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.053282  1749 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:11.053676  1749 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:11.054045  1749 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.057438  1723 tablet_bootstrap.cc:654] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.054708  1431 catalog_manager.cc:5697] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:11.059885  1724 tablet_bootstrap.cc:654] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.062987  1749 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.066838  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:11.067602  1534 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.080042  1725 tablet_bootstrap.cc:654] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.084523  1534 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:11.086018  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:11.088893  1749 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.089619  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:57:11.091917  1647 leader_election.cc:343] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.094128  1725 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:11.094713  1725 ts_tablet_manager.cc:1403] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.003s
I20260709 12:57:11.098320  1725 raft_consensus.cc:359] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.099236  1725 raft_consensus.cc:385] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.099581  1725 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.100666  1725 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.089653  1749 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:11.107550  1749 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:11.109140  1725 ts_tablet_manager.cc:1434] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:57:11.110136  1725 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:11.110437  1724 tablet_bootstrap.cc:492] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:11.110497  1723 tablet_bootstrap.cc:492] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.111011  1724 ts_tablet_manager.cc:1403] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.027s
I20260709 12:57:11.111053  1723 ts_tablet_manager.cc:1403] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.033s
I20260709 12:57:11.108636  1749 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.114291  1723 raft_consensus.cc:359] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.114522  1724 raft_consensus.cc:359] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.115000  1723 raft_consensus.cc:385] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.115337  1724 raft_consensus.cc:385] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.115556  1723 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.115710  1724 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.116710  1725 tablet_bootstrap.cc:654] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.116576  1723 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.116700  1724 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.119170  1723 ts_tablet_manager.cc:1434] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:57:11.120342  1723 tablet_bootstrap.cc:492] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:11.122046  1724 ts_tablet_manager.cc:1434] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:57:11.123193  1724 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:11.127856  1723 tablet_bootstrap.cc:654] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.128247  1773 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.128481  1725 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:11.128980  1725 ts_tablet_manager.cc:1403] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.013s
I20260709 12:57:11.128726  1773 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:11.131091  1773 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.129184  1724 tablet_bootstrap.cc:654] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.132064  1725 raft_consensus.cc:359] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.132988  1725 raft_consensus.cc:385] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.133319  1725 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.134492  1725 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:11.135226  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:11.136955  1796 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.137614  1796 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.142736  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.143800  1534 raft_consensus.cc:2393] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:11.143929  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.144598  1533 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:11.144529  1773 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.144946  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.143929  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.146752  1796 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.145785  1683 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:11.148718  1725 ts_tablet_manager.cc:1434] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.006s
I20260709 12:57:11.149504  1771 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.150085  1771 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.150676  1725 tablet_bootstrap.cc:492] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:11.145226  1773 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.152269  1771 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.154371  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.155161  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.155903  1608 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:11.146095  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:11.156855  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.156937  1773 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.158049  1533 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:11.158193  1796 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:11.158540  1796 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:11.158855  1796 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.159356  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:11.156980  1498 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.161598  1647 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.161952  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.162953  1608 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:11.163260  1773 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:11.163605  1773 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:11.163944  1773 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.164031  1771 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.165004  1796 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.167514  1723 tablet_bootstrap.cc:492] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.167475  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:11.168004  1723 ts_tablet_manager.cc:1403] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.023s
I20260709 12:57:11.168085  1533 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.169945  1749 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.170749  1723 raft_consensus.cc:359] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.171242  1771 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.171411  1723 raft_consensus.cc:385] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.171737  1723 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.173662  1725 tablet_bootstrap.cc:654] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.174948  1533 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:11.176155  1730 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.176602  1730 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.176582  1723 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.178735  1723 ts_tablet_manager.cc:1434] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:57:11.179090  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:11.179647  1723 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:11.179934  1791 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:11.178551  1773 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.178763  1730 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.179936  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.182236  1683 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:11.185446  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.186307  1572 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:11.186534  1534 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:11.187124  1730 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:11.187494  1730 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:11.187832  1730 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.189126  1723 tablet_bootstrap.cc:654] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.193199  1796 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.193457  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:11.181304  1724 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:11.195534  1724 ts_tablet_manager.cc:1403] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.013s
I20260709 12:57:11.196242  1683 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.200853  1724 raft_consensus.cc:359] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.200927  1432 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:11.203271  1724 raft_consensus.cc:385] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.203658  1724 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.204209  1683 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:11.206311  1724 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.210654  1724 ts_tablet_manager.cc:1434] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:57:11.211794  1724 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:11.211935  1749 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.214499  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:11.215183  1533 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.218286  1796 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.219180  1773 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.219419  1796 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.223492  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:11.224267  1608 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.224918  1533 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:11.225685  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.226554  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:11.227159  1534 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:11.228060  1773 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:11.228919  1773 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:11.230075  1796 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.230598  1791 raft_consensus.cc:697] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:11.231230  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.231451  1791 consensus_queue.cc:237] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.232787  1572 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:11.233932  1796 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.209221  1730 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.240391  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:11.241024  1534 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.241645  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:11.242250  1682 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.244033  1724 tablet_bootstrap.cc:654] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.248522  1431 catalog_manager.cc:5697] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:11.252821  1608 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:11.249855  1682 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:11.250674  1771 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.229799  1773 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.252969  1730 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.255213  1723 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.255707  1723 ts_tablet_manager.cc:1403] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.026s
I20260709 12:57:11.254302  1771 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.260270  1771 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.262279  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:11.265829  1498 leader_election.cc:343] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.265906  1572 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:11.266990  1730 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:11.267511  1730 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:11.270098  1534 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:11.269656  1730 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.270120  1796 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.272133  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.272307  1723 raft_consensus.cc:359] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.272930  1723 raft_consensus.cc:385] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.273164  1723 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
W20260709 12:57:11.274278  1497 leader_election.cc:343] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.274673  1497 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.275293  1771 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.277987  1725 tablet_bootstrap.cc:492] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:11.298098  1725 ts_tablet_manager.cc:1403] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.148s	user 0.040s	sys 0.030s
I20260709 12:57:11.297834  1723 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.280978  1430 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:11.300019  1723 ts_tablet_manager.cc:1434] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.044s	user 0.000s	sys 0.005s
I20260709 12:57:11.300876  1723 tablet_bootstrap.cc:492] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:11.301129  1725 raft_consensus.cc:359] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.301875  1725 raft_consensus.cc:385] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.302206  1725 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.302974  1725 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.303819  1724 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:11.304279  1724 ts_tablet_manager.cc:1403] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.006s
I20260709 12:57:11.306226  1725 ts_tablet_manager.cc:1434] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:57:11.306751  1724 raft_consensus.cc:359] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.307509  1724 raft_consensus.cc:385] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.307595  1725 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:11.307786  1724 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.308622  1724 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.314540  1724 ts_tablet_manager.cc:1434] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:57:11.315390  1724 tablet_bootstrap.cc:492] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:11.316370  1725 tablet_bootstrap.cc:654] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.321144  1724 tablet_bootstrap.cc:654] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.321921  1723 tablet_bootstrap.cc:654] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.328977  1725 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:11.329733  1725 ts_tablet_manager.cc:1403] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 12:57:11.332890  1725 raft_consensus.cc:359] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.333725  1725 raft_consensus.cc:385] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.334044  1723 tablet_bootstrap.cc:492] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.334062  1725 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.334508  1723 ts_tablet_manager.cc:1403] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.009s
I20260709 12:57:11.335695  1725 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.337291  1723 raft_consensus.cc:359] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.337994  1723 raft_consensus.cc:385] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.338284  1723 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.338104  1725 ts_tablet_manager.cc:1434] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:11.339555  1723 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.340035  1725 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:11.340255  1724 tablet_bootstrap.cc:492] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:11.340752  1724 ts_tablet_manager.cc:1403] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 12:57:11.341838  1723 ts_tablet_manager.cc:1434] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:11.342788  1723 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:11.343737  1724 raft_consensus.cc:359] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.344568  1724 raft_consensus.cc:385] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.344872  1724 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.346534  1724 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.347131  1725 tablet_bootstrap.cc:654] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.349676  1723 tablet_bootstrap.cc:654] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.353004  1724 ts_tablet_manager.cc:1434] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:57:11.354101  1724 tablet_bootstrap.cc:492] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:11.359071  1725 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:11.359563  1725 ts_tablet_manager.cc:1403] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:57:11.360210  1724 tablet_bootstrap.cc:654] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.361126  1723 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.362088  1723 ts_tablet_manager.cc:1403] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 12:57:11.362953  1725 raft_consensus.cc:359] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.363637  1725 raft_consensus.cc:385] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.363897  1725 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.364548  1725 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.364912  1723 raft_consensus.cc:359] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.365543  1723 raft_consensus.cc:385] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.365849  1723 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.366832  1725 ts_tablet_manager.cc:1434] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 12:57:11.366683  1723 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.367734  1725 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:11.368880  1723 ts_tablet_manager.cc:1434] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:57:11.369729  1723 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:11.373262  1773 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.373767  1773 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.374923  1725 tablet_bootstrap.cc:654] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.375756  1773 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.376817  1723 tablet_bootstrap.cc:654] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.376947  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.377271  1771 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.377784  1771 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:11.378368  1649 leader_election.cc:343] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.379827  1771 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.379980  1429 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:11.382752  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.384243  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.384879  1682 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
W20260709 12:57:11.385825  1647 leader_election.cc:343] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.386140  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:11.386309  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.387305  1723 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.387933  1786 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.387907  1723 ts_tablet_manager.cc:1403] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:57:11.390690  1771 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:11.390949  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.391286  1771 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:11.391649  1771 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.391870  1730 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.391947  1773 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:11.392397  1730 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.395483  1730 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.395910  1723 raft_consensus.cc:359] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.396528  1723 raft_consensus.cc:385] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.396783  1723 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.397213  1723 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.397336  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.399120  1723 ts_tablet_manager.cc:1434] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:57:11.403223  1723 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
W20260709 12:57:11.405787  1498 leader_election.cc:343] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:11.408964  1572 leader_election.cc:343] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.410283  1724 tablet_bootstrap.cc:492] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:11.410807  1724 ts_tablet_manager.cc:1403] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.002s
I20260709 12:57:11.411275  1725 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:11.411779  1725 ts_tablet_manager.cc:1403] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.004s
I20260709 12:57:11.415786  1723 tablet_bootstrap.cc:654] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.403044  1730 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.416718  1730 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.418745  1730 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.419275  1771 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.420516  1608 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.421377  1771 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.423380  1725 raft_consensus.cc:359] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.424118  1725 raft_consensus.cc:385] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.424381  1725 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.428587  1773 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.429090  1773 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.431017  1725 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.433270  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:11.433580  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.434058  1725 ts_tablet_manager.cc:1434] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.006s
I20260709 12:57:11.433905  1683 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.435034  1725 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:11.434755  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:57:11.437098  1575 leader_election.cc:343] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.437157  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:11.434751  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.438444  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.431278  1773 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.439643  1724 raft_consensus.cc:359] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:11.440088  1572 leader_election.cc:343] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.440307  1724 raft_consensus.cc:385] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.440601  1724 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.440546  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:11.440874  1786 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:11.441076  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:11.442574  1575 leader_election.cc:343] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.440557  1773 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:57:11.444275  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:11.445116  1796 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.445698  1796 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:11.442755  1649 leader_election.cc:343] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.441372  1724 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.446415  1730 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.446126  1796 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:11.448508  1498 leader_election.cc:343] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.450745  1796 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.459506  1724 ts_tablet_manager.cc:1434] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:57:11.460827  1724 tablet_bootstrap.cc:492] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:11.465655  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.466295  1533 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:11.470142  1773 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:11.471864  1575 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:57:11.466518  1647 leader_election.cc:343] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.472743  1647 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.477906  1723 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.478411  1723 ts_tablet_manager.cc:1403] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.013s
I20260709 12:57:11.478729  1773 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.480017  1683 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:11.478225  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.483934  1796 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.484146  1730 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.484686  1730 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.486009  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.487582  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.488373  1822 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:11.488826  1822 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:11.493212  1725 tablet_bootstrap.cc:654] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:11.489500  1575 leader_election.cc:343] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.494505  1822 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.497207  1796 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:11.509867  1773 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.510344  1791 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.510370  1773 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.503008  1796 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.510844  1791 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.512630  1773 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.512915  1791 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.517606  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.518448  1532 raft_consensus.cc:2393] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:11.518286  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.519745  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.520394  1723 raft_consensus.cc:359] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.521454  1723 raft_consensus.cc:385] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.521739  1723 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.522449  1723 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.522703  1773 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:11.527182  1723 ts_tablet_manager.cc:1434] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:57:11.524506  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.528400  1723 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:11.524751  1572 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:57:11.530620  1649 leader_election.cc:343] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.532938  1791 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.530277  1786 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.544713  1786 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:11.549527  1826 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:57:11.552510  1807 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:57:11.553339  1647 leader_election.cc:343] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.553791  1647 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.554522  1749 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.558007  1791 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.557420  1786 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.571936  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:11.573572  1572 leader_election.cc:343] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.573824  1749 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.570353  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.574195  1572 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:11.574560  1531 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:11.574329  1749 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.575078  1791 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.569835  1730 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.577971  1724 tablet_bootstrap.cc:654] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.576483  1749 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.578651  1831 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:57:11.581048  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:11.587877  1749 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:11.588234  1749 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:11.588546  1749 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.588954  1773 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:11.581473  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.583069  1796 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.584244  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.595443  1796 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:11.595484  1649 leader_election.cc:343] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.598011  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:11.598727  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:11.599313  1533 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.616571  1533 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:11.617532  1531 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:11.618084  1575 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:11.619292  1796 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:11.619741  1796 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:11.620529  1796 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.620656  1749 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:11.653005  1647 leader_election.cc:343] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.650771  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.653503  1647 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.662560  1723 tablet_bootstrap.cc:654] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.667120  1606 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:11.666590  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:11.672839  1533 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.674391  1830 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:11.675532  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:57:11.677413  1647 leader_election.cc:343] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:11.678572  1647 leader_election.cc:343] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.680083  1796 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:11.670104  1786 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.673859  1749 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.694661  1725 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:11.700652  1725 ts_tablet_manager.cc:1403] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.266s	user 0.057s	sys 0.059s
I20260709 12:57:11.701033  1822 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.723328  1831 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.720311  1822 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.760699  1725 raft_consensus.cc:359] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.764691  1725 raft_consensus.cc:385] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.765007  1725 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.767274  1723 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:11.767616  1724 tablet_bootstrap.cc:492] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:11.767881  1723 ts_tablet_manager.cc:1403] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.240s	user 0.018s	sys 0.028s
I20260709 12:57:11.768023  1724 ts_tablet_manager.cc:1403] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.307s	user 0.034s	sys 0.033s
I20260709 12:57:11.770516  1723 raft_consensus.cc:359] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.771193  1723 raft_consensus.cc:385] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.771472  1723 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.771955  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.770614  1724 raft_consensus.cc:359] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.773344  1724 raft_consensus.cc:385] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:11.746306  1831 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.773721  1724 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:11.774729  1724 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.775776  1831 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.777107  1724 ts_tablet_manager.cc:1434] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:57:11.778405  1724 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:11.778893  1725 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.761655  1830 consensus_queue.cc:1243] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:57:11.790393  1725 ts_tablet_manager.cc:1434] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
W20260709 12:57:11.778570  1498 leader_election.cc:343] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.790274  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.780591  1723 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.761013  1749 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:57:11.791595  1725 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:11.791136  1796 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:57:11.799352  1723 ts_tablet_manager.cc:1434] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:57:11.793437  1822 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:11.802131  1786 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:11.802595  1786 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:11.792042  1773 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:57:11.790982  1830 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.825399  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.846169  1723 tablet_bootstrap.cc:492] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:11.798427  1831 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 12:57:11.845634  1830 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.861666  1533 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:11.863462  1724 tablet_bootstrap.cc:654] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.864244  1844 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:11.865674  1831 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.866408  1831 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.855737  1840 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.071s
I20260709 12:57:11.878003  1842 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 12:57:11.884644  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 108529us
I20260709 12:57:11.888574  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:11.877987  1786 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.900543  1786 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.905160  1831 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:11.908149  1575 leader_election.cc:343] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.909770  1796 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:11.913435  1497 leader_election.cc:343] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.913364  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:57:11.916958  1572 leader_election.cc:343] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.916546  1534 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:11.914927  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.936309  1843 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.936841  1843 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.937280  1830 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.935053  1822 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.924829  1572 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:11.942386  1831 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:11.942232  1430 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:11.944172  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:11.944984  1791 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:11.945315  1791 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:11.945681  1791 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:11.949730  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:11.949779  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:11.962680  1830 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:11.961803  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:11.966236  1682 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:11.966449  1830 raft_consensus.cc:697] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:11.972693  1830 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:11.980865  1723 tablet_bootstrap.cc:654] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.994689  1724 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:11.995139  1724 ts_tablet_manager.cc:1403] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.217s	user 0.011s	sys 0.025s
I20260709 12:57:11.989077  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:11.999146  1647 leader_election.cc:343] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:11.999306  1725 tablet_bootstrap.cc:654] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:11.986333  1843 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:11.992254  1429 catalog_manager.cc:5697] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.002285  1807 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:11.984941  1791 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.003762  1807 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.012370  1607 raft_consensus.cc:2393] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:12.014139  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:12.015007  1531 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.022048  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.033674  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.035032  1791 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.042099  1807 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.043143  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:12.043793  1681 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.044430  1724 raft_consensus.cc:359] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.046849  1724 raft_consensus.cc:385] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.047118  1724 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.047648  1724 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.049845  1724 ts_tablet_manager.cc:1434] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:57:12.050652  1724 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.054201  1647 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.085841  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.087320  1533 raft_consensus.cc:2393] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:12.090596  1531 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:12.090142  1771 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:12.092259  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:12.089073  1649 leader_election.cc:343] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.096087  1724 tablet_bootstrap.cc:654] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.096549  1649 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.098765  1840 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:12.100065  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.100883  1807 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.102036  1807 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:12.102349  1572 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:12.103245  1723 tablet_bootstrap.cc:492] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:12.103696  1730 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.103426  1807 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.105955  1723 ts_tablet_manager.cc:1403] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.306s	user 0.010s	sys 0.009s
I20260709 12:57:12.114794  1534 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:12.122412  1723 raft_consensus.cc:359] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.123162  1723 raft_consensus.cc:385] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.123431  1723 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.124953  1723 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.132550  1724 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.132948  1725 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:12.133401  1725 ts_tablet_manager.cc:1403] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.342s	user 0.008s	sys 0.008s
I20260709 12:57:12.135234  1730 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:12.166028  1724 ts_tablet_manager.cc:1403] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.116s	user 0.006s	sys 0.008s
I20260709 12:57:12.157361  1851 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.167519  1725 raft_consensus.cc:359] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.177008  1725 raft_consensus.cc:385] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.155762  1431 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:12.176959  1851 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.177404  1725 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.178103  1725 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:12.175941  1498 consensus_peers.cc:597] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:12.180269  1725 ts_tablet_manager.cc:1434] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.047s	user 0.015s	sys 0.020s
I20260709 12:57:12.179194  1724 raft_consensus.cc:359] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.156092  1681 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:12.181797  1724 raft_consensus.cc:385] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.182062  1786 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:12.182112  1724 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
W20260709 12:57:12.182209  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 54793.1us
I20260709 12:57:12.182962  1724 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.166164  1723 ts_tablet_manager.cc:1434] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260709 12:57:12.185123  1725 tablet_bootstrap.cc:492] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:12.185144  1724 ts_tablet_manager.cc:1434] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:57:12.185753  1723 tablet_bootstrap.cc:492] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:12.187932  1851 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.186105  1724 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.190554  1796 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:12.192123  1725 tablet_bootstrap.cc:654] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.194337  1851 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.194806  1851 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.195538  1724 tablet_bootstrap.cc:654] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.197583  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.202679  1682 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:12.198194  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.202932  1607 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:12.199159  1851 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.211884  1725 tablet_bootstrap.cc:492] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:12.212719  1725 ts_tablet_manager.cc:1403] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 12:57:12.213296  1796 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:12.199616  1723 tablet_bootstrap.cc:654] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.200712  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:12.212244  1498 leader_election.cc:343] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.215098  1680 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:12.215476  1498 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.201951  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.212118  1724 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.216456  1822 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.216151  1725 raft_consensus.cc:359] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.216902  1822 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.217051  1725 raft_consensus.cc:385] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.217319  1822 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.216624  1681 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:12.217554  1725 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.226656  1724 ts_tablet_manager.cc:1403] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.009s
I20260709 12:57:12.226866  1725 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.229506  1725 ts_tablet_manager.cc:1434] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.004s
I20260709 12:57:12.229676  1724 raft_consensus.cc:359] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.229707  1822 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.230664  1725 tablet_bootstrap.cc:492] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:12.231971  1822 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.230702  1724 raft_consensus.cc:385] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.232510  1724 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.232879  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:12.233165  1724 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.233660  1607 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.235713  1724 ts_tablet_manager.cc:1434] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:57:12.232076  1497 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.237978  1822 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.238348  1822 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.238685  1822 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.239320  1725 tablet_bootstrap.cc:654] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.239573  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:12.240355  1681 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.237079  1724 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.248086  1607 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:12.249882  1681 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:12.250770  1498 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.254387  1869 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.256942  1869 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:12.259078  1869 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.258123  1822 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.280771  1822 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.282893  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:57:12.284586  1498 leader_election.cc:343] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.292982  1724 tablet_bootstrap.cc:654] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.295696  1725 tablet_bootstrap.cc:492] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:12.296345  1725 ts_tablet_manager.cc:1403] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.000s
I20260709 12:57:12.298826  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:12.299052  1725 raft_consensus.cc:359] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.299733  1725 raft_consensus.cc:385] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.299849  1681 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.300007  1725 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.300833  1725 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.303102  1725 ts_tablet_manager.cc:1434] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:57:12.303941  1725 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:12.305011  1681 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:12.306794  1497 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.307992  1822 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.309796  1430 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.311177  1822 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:12.312130  1822 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.312824  1723 tablet_bootstrap.cc:492] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:12.313259  1723 ts_tablet_manager.cc:1403] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.030s
I20260709 12:57:12.310484  1725 tablet_bootstrap.cc:654] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.317341  1723 raft_consensus.cc:359] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.318274  1723 raft_consensus.cc:385] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.318662  1723 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.319494  1723 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.322551  1723 ts_tablet_manager.cc:1434] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:57:12.324126  1723 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:12.332700  1723 tablet_bootstrap.cc:654] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.374661  1724 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.375137  1724 ts_tablet_manager.cc:1403] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.138s	user 0.020s	sys 0.020s
I20260709 12:57:12.375236  1869 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.375690  1869 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.377794  1724 raft_consensus.cc:359] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.378472  1724 raft_consensus.cc:385] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.378587  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.378767  1724 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.379503  1724 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:12.380108  1498 leader_election.cc:343] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.381796  1724 ts_tablet_manager.cc:1434] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:57:12.381965  1869 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.382736  1724 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.383167  1831 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.383628  1831 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.384441  1725 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:12.384871  1725 ts_tablet_manager.cc:1403] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.026s
I20260709 12:57:12.384894  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.385577  1831 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.385737  1681 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:12.387449  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.387662  1725 raft_consensus.cc:359] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.388329  1725 raft_consensus.cc:385] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.388291  1786 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:12.388762  1725 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
W20260709 12:57:12.388857  1575 leader_election.cc:343] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.389459  1725 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.389685  1497 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.390604  1869 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.390961  1869 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.391265  1869 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.391984  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.393280  1681 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:12.397643  1725 ts_tablet_manager.cc:1434] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:57:12.397483  1572 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:57:12.398115  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:12.398648  1725 tablet_bootstrap.cc:492] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:12.398862  1831 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.401479  1831 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.401981  1831 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.402953  1869 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.400445  1724 tablet_bootstrap.cc:654] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.408103  1723 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:12.408586  1723 ts_tablet_manager.cc:1403] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.033s
I20260709 12:57:12.418298  1831 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.430377  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:12.431281  1723 raft_consensus.cc:359] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.431557  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:12.432004  1723 raft_consensus.cc:385] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.432279  1723 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.433063  1796 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:12.433223  1575 leader_election.cc:343] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.433545  1796 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.434966  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:12.436760  1681 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.437518  1796 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.439512  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.440310  1680 raft_consensus.cc:2393] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:12.432860  1723 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.443943  1681 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:12.433840  1725 tablet_bootstrap.cc:654] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.445575  1723 ts_tablet_manager.cc:1434] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:57:12.446846  1723 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
W20260709 12:57:12.448267  1498 leader_election.cc:343] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.448688  1869 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.449222  1572 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:12.449930  1831 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.450667  1831 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.451082  1831 raft_consensus.cc:697] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:12.452036  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.451849  1831 consensus_queue.cc:237] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.457525  1843 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:12.459682  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:12.461023  1796 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.462831  1723 tablet_bootstrap.cc:654] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.468447  1796 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:12.469784  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:12.470937  1724 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.472700  1724 ts_tablet_manager.cc:1403] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.002s
I20260709 12:57:12.473172  1725 tablet_bootstrap.cc:492] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:12.473706  1725 ts_tablet_manager.cc:1403] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.004s
I20260709 12:57:12.476166  1724 raft_consensus.cc:359] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.476768  1725 raft_consensus.cc:359] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.477138  1724 raft_consensus.cc:385] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.477435  1725 raft_consensus.cc:385] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.477828  1725 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.477547  1724 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.478762  1725 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.479355  1724 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.481185  1725 ts_tablet_manager.cc:1434] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:57:12.482095  1725 tablet_bootstrap.cc:492] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:12.482661  1429 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.488631  1725 tablet_bootstrap.cc:654] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.477823  1681 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.488797  1429 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.497833  1796 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:12.499924  1681 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:12.501430  1497 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.502508  1869 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.502979  1869 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:12.504022  1869 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.516331  1724 ts_tablet_manager.cc:1434] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:57:12.517608  1724 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.521418  1725 tablet_bootstrap.cc:492] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:12.521924  1725 ts_tablet_manager.cc:1403] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.008s
I20260709 12:57:12.525283  1609 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.526537  1840 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.526285  1725 raft_consensus.cc:359] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.527221  1725 raft_consensus.cc:385] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.527704  1725 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.529086  1822 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.528620  1725 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.529690  1822 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.531973  1725 ts_tablet_manager.cc:1434] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:57:12.532243  1822 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.533859  1725 tablet_bootstrap.cc:492] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:12.527139  1840 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.538498  1840 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:12.540468  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.534148  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:12.542315  1498 leader_election.cc:343] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:12.543151  1497 leader_election.cc:343] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.543586  1497 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.544731  1869 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:12.546538  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.547513  1608 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:12.566287  1807 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:12.568300  1647 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.569528  1843 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.570058  1843 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.570495  1843 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.570999  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.571972  1533 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:12.565320  1429 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.596424  1724 tablet_bootstrap.cc:654] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.598338  1430 catalog_manager.cc:5697] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.625125  1725 tablet_bootstrap.cc:654] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.628779  1831 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.629499  1831 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.640118  1843 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.648002  1843 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:12.649325  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:12.650028  1533 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.650627  1796 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:12.651041  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:12.651110  1796 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.651659  1608 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.655786  1724 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.656719  1724 ts_tablet_manager.cc:1403] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.019s
I20260709 12:57:12.657370  1608 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:12.660064  1533 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:12.661586  1647 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.662345  1843 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.662632  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.662955  1843 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:12.663045  1724 raft_consensus.cc:359] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.663893  1724 raft_consensus.cc:385] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.664189  1724 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
W20260709 12:57:12.664629  1575 leader_election.cc:343] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.664563  1843 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.664885  1724 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.667412  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.668133  1680 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:12.669719  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:12.670939  1724 ts_tablet_manager.cc:1434] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:57:12.670845  1807 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.671461  1807 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.671921  1807 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.672042  1724 tablet_bootstrap.cc:492] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.681752  1831 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.684725  1807 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.686916  1869 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.687589  1869 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.688681  1724 tablet_bootstrap.cc:654] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.691221  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:12.692008  1680 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.692960  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.693892  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.698776  1796 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.700106  1724 tablet_bootstrap.cc:492] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.699939  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.700582  1724 ts_tablet_manager.cc:1403] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.010s
I20260709 12:57:12.703575  1724 raft_consensus.cc:359] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.703697  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.704491  1724 raft_consensus.cc:385] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.704790  1724 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.704946  1681 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:12.705513  1724 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.706472  1497 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.707588  1822 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.710505  1724 ts_tablet_manager.cc:1434] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:57:12.711439  1724 tablet_bootstrap.cc:492] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.701071  1869 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.717449  1724 tablet_bootstrap.cc:654] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.726368  1575 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:12.727525  1796 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.728464  1724 tablet_bootstrap.cc:492] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.728441  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:12.729027  1724 ts_tablet_manager.cc:1403] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:57:12.729097  1533 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.730048  1851 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:12.731757  1724 raft_consensus.cc:359] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.732590  1724 raft_consensus.cc:385] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.732853  1724 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.733470  1724 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.735967  1724 ts_tablet_manager.cc:1434] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:57:12.737288  1724 tablet_bootstrap.cc:492] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.738281  1851 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:12.740959  1723 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:12.741436  1723 ts_tablet_manager.cc:1403] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.295s	user 0.050s	sys 0.052s
I20260709 12:57:12.743400  1724 tablet_bootstrap.cc:654] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.764185  1723 raft_consensus.cc:359] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.765460  1723 raft_consensus.cc:385] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.766050  1723 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.776198  1822 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:12.778537  1680 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:12.779672  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.780627  1730 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.781355  1730 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:12.782182  1730 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.784641  1533 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:12.770357  1807 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.787137  1822 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.789754  1723 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.790890  1725 tablet_bootstrap.cc:492] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:12.791472  1725 ts_tablet_manager.cc:1403] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.258s	user 0.019s	sys 0.009s
I20260709 12:57:12.795545  1723 ts_tablet_manager.cc:1434] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 12:57:12.797104  1723 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:12.787648  1822 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.804610  1847 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.811466  1725 raft_consensus.cc:359] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.815631  1430 catalog_manager.cc:5697] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.819691  1725 raft_consensus.cc:385] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.820223  1725 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.819655  1847 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.821026  1725 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.826222  1771 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.826720  1771 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.830999  1725 ts_tablet_manager.cc:1434] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 12:57:12.831725  1725 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:12.832578  1771 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.833806  1847 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:12.834537  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.834582  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.835273  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.835942  1608 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:12.837260  1647 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.838526  1847 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.838939  1847 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.839251  1847 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.838577  1429 catalog_manager.cc:5697] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:12.828822  1807 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.841960  1807 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.844357  1807 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:12.845839  1497 leader_election.cc:343] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.845616  1533 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:12.847535  1822 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.851137  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.849889  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:12.853770  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:12.854936  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.855561  1607 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:12.856580  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:12.857250  1608 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:12.859308  1847 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:12.860662  1572 leader_election.cc:343] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.860637  1680 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:57:12.864135  1575 leader_election.cc:343] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.864933  1575 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:12.865927  1724 tablet_bootstrap.cc:492] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.866361  1724 ts_tablet_manager.cc:1403] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.015s
I20260709 12:57:12.866814  1498 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.866688  1822 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:12.867744  1498 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:12.868420  1822 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.868518  1851 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:12.868842  1822 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.868958  1851 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:12.869258  1822 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.869282  1847 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:12.869055  1724 raft_consensus.cc:359] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.869590  1851 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.870311  1724 raft_consensus.cc:385] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.870656  1724 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.871290  1724 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.874038  1724 ts_tablet_manager.cc:1434] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:12.872089  1807 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:12.875377  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:12.875921  1608 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.877015  1724 tablet_bootstrap.cc:492] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.885927  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:12.891422  1851 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.891848  1822 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.890132  1608 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:12.893347  1647 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.891621  1725 tablet_bootstrap.cc:654] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.894214  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:12.891069  1723 tablet_bootstrap.cc:654] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.894793  1609 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:12.893492  1851 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.895217  1771 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:12.898577  1533 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 1: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:12.899457  1840 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.900022  1840 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:12.900853  1840 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.902383  1730 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:12.915963  1609 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:12.918151  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:12.917598  1498 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:12.920913  1771 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:12.921427  1771 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:12.923000  1771 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:12.927210  1497 leader_election.cc:343] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:12.945956  1822 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:12.947103  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:12.948067  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:12.948844  1609 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:12.950052  1498 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:12.950416  1724 tablet_bootstrap.cc:654] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.954037  1851 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:12.959430  1430 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:12.969485  1831 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:12.974723  1432 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.982353  1724 tablet_bootstrap.cc:492] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:12.982860  1724 ts_tablet_manager.cc:1403] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.000s
I20260709 12:57:12.985750  1724 raft_consensus.cc:359] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.986399  1724 raft_consensus.cc:385] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.986639  1724 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.987259  1724 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.989272  1724 ts_tablet_manager.cc:1434] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:57:12.991920  1724 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:12.992710  1723 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:12.993039  1723 ts_tablet_manager.cc:1403] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.196s	user 0.024s	sys 0.002s
I20260709 12:57:12.994930  1723 raft_consensus.cc:359] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.995378  1723 raft_consensus.cc:385] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:12.995618  1723 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:12.996285  1723 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:12.997856  1724 tablet_bootstrap.cc:654] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:12.998183  1723 ts_tablet_manager.cc:1434] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:57:12.999032  1723 tablet_bootstrap.cc:492] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:12.999466  1831 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.999922  1831 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.001911  1725 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:13.002345  1725 ts_tablet_manager.cc:1403] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.171s	user 0.010s	sys 0.017s
I20260709 12:57:13.003331  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:57:13.004663  1575 leader_election.cc:343] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:13.005055  1723 tablet_bootstrap.cc:654] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.005779  1831 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.008164  1724 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:13.008594  1724 ts_tablet_manager.cc:1403] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:57:13.007128  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:13.010681  1681 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:13.011040  1724 raft_consensus.cc:359] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.011704  1724 raft_consensus.cc:385] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.011987  1724 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.011794  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:13.012650  1724 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.005007  1725 raft_consensus.cc:359] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.013929  1725 raft_consensus.cc:385] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.014202  1725 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.014930  1725 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.015193  1831 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:13.015760  1831 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:13.016196  1831 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.016686  1725 ts_tablet_manager.cc:1434] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:57:13.017522  1725 tablet_bootstrap.cc:492] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:13.023813  1725 tablet_bootstrap.cc:654] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.032119  1724 ts_tablet_manager.cc:1434] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:57:13.033157  1724 tablet_bootstrap.cc:492] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:13.038841  1723 tablet_bootstrap.cc:492] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:13.039019  1724 tablet_bootstrap.cc:654] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.039278  1723 ts_tablet_manager.cc:1403] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.010s
I20260709 12:57:13.041316  1723 raft_consensus.cc:359] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.042001  1723 raft_consensus.cc:385] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.042305  1723 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.042938  1723 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.044869  1723 ts_tablet_manager.cc:1434] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:57:13.037410  1831 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.048188  1831 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.049245  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:13.049296  1723 tablet_bootstrap.cc:492] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:13.049908  1531 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.052390  1831 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.052667  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:13.052870  1831 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.053234  1681 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.059517  1831 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.061496  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:13.062183  1680 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:13.062880  1531 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:13.064073  1575 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:13.067677  1681 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:13.069090  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:13.069748  1531 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:13.071002  1575 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:13.073988  1807 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:13.074410  1807 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:13.074759  1807 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.072621  1831 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:13.080065  1851 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:13.080379  1831 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:13.081207  1831 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.091730  1807 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.105228  1723 tablet_bootstrap.cc:654] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.107220  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:13.107843  1683 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.106146  1807 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.115473  1683 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:13.116618  1724 tablet_bootstrap.cc:492] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:13.117110  1724 ts_tablet_manager.cc:1403] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.019s
I20260709 12:57:13.120718  1724 raft_consensus.cc:359] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.121783  1724 raft_consensus.cc:385] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.122869  1724 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.123136  1725 tablet_bootstrap.cc:492] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:13.123557  1725 ts_tablet_manager.cc:1403] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.106s	user 0.025s	sys 0.014s
I20260709 12:57:13.123503  1724 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.125103  1724 ts_tablet_manager.cc:1434] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:57:13.126214  1724 tablet_bootstrap.cc:492] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:13.126282  1725 raft_consensus.cc:359] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.127015  1725 raft_consensus.cc:385] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.127321  1725 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.162014  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:13.164191  1531 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.167088  1723 tablet_bootstrap.cc:492] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:13.127913  1725 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.169548  1723 ts_tablet_manager.cc:1403] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.015s
I20260709 12:57:13.167709  1572 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:13.187531  1831 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:13.189822  1725 ts_tablet_manager.cc:1434] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.004s
I20260709 12:57:13.195842  1723 raft_consensus.cc:359] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.196995  1723 raft_consensus.cc:385] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.197396  1723 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.197675  1847 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:13.198387  1429 catalog_manager.cc:5697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:13.199147  1723 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.206346  1723 ts_tablet_manager.cc:1434] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:57:13.218104  1607 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.219774  1531 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:13.221429  1723 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:13.202907  1831 raft_consensus.cc:697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:13.224995  1831 consensus_queue.cc:237] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.230922  1843 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:13.241415  1725 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:13.242383  1822 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:13.245503  1843 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.246295  1843 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.256754  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:13.258008  1724 tablet_bootstrap.cc:654] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.258286  1531 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:13.268643  1649 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:13.270367  1843 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:13.271008  1843 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:13.271445  1843 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:13.272130  1843 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.279923  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:13.282336  1647 leader_election.cc:343] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:13.284950  1791 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:13.289816  1807 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:13.298403  1723 tablet_bootstrap.cc:654] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.303584  1725 tablet_bootstrap.cc:654] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.318924  1843 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.325841  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:13.326519  1534 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.336331  1822 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.337016  1822 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.339494  1822 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.340798  1534 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:13.341827  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:13.342172  1649 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:13.342775  1683 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:13.343262  1840 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:13.343792  1840 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:13.348716  1843 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:13.348935  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:13.350782  1771 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:13.351307  1771 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:13.351814  1771 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.344806  1822 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:57:13.358940  1429 catalog_manager.cc:5697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:13.360412  1840 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.362140  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:13.372617  1724 tablet_bootstrap.cc:492] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
W20260709 12:57:13.365581  1647 leader_election.cc:343] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:13.375548  1724 ts_tablet_manager.cc:1403] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.250s	user 0.009s	sys 0.012s
I20260709 12:57:13.363027  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:13.377097  1608 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:13.378569  1724 raft_consensus.cc:359] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.379464  1724 raft_consensus.cc:385] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.379796  1724 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.380740  1724 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.383777  1724 ts_tablet_manager.cc:1434] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:13.385282  1724 tablet_bootstrap.cc:492] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:13.401983  1847 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:57:13.412776  1723 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:13.413228  1723 ts_tablet_manager.cc:1403] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.192s	user 0.025s	sys 0.005s
I20260709 12:57:13.395464  1771 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.424389  1724 tablet_bootstrap.cc:654] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.426664  1843 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:57:13.436596  1723 raft_consensus.cc:359] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.470363  1723 raft_consensus.cc:385] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.470606  1723 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.478914  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:13.478962  1725 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:13.480674  1725 ts_tablet_manager.cc:1403] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.240s	user 0.051s	sys 0.021s
I20260709 12:57:13.479691  1607 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.482170  1771 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.482856  1723 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.538733  1680 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.539450  1723 ts_tablet_manager.cc:1434] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.011s
I20260709 12:57:13.485308  1822 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.483565  1431 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:13.555414  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:13.556496  1681 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.570586  1822 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.572839  1725 raft_consensus.cc:359] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.574790  1725 raft_consensus.cc:385] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.575160  1725 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.576732  1725 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.545936  1771 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.579998  1723 tablet_bootstrap.cc:492] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:13.579876  1771 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.625113  1822 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.669131  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:13.680279  1730 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:13.694535  1498 leader_election.cc:343] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:13.694832  1771 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.698428  1840 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.699041  1840 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.692584  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:13.703109  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:13.701159  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:13.706993  1724 tablet_bootstrap.cc:492] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:13.707520  1724 ts_tablet_manager.cc:1403] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.323s	user 0.012s	sys 0.047s
I20260709 12:57:13.708346  1723 tablet_bootstrap.cc:654] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.698717  1681 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:13.709767  1831 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:13.716885  1682 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:13.718003  1840 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:13.712453  1724 raft_consensus.cc:359] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.719790  1724 raft_consensus.cc:385] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.719951  1725 ts_tablet_manager.cc:1434] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.239s	user 0.010s	sys 0.001s
I20260709 12:57:13.720177  1724 raft_consensus.cc:740] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.720911  1724 consensus_queue.cc:260] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.723963  1724 ts_tablet_manager.cc:1434] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
W20260709 12:57:13.725934  1497 leader_election.cc:343] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:13.726380  1724 tablet_bootstrap.cc:492] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:13.726989  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:57:13.726809  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 47769.2us
I20260709 12:57:13.728065  1851 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:13.728649  1851 raft_consensus.cc:697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:13.729686  1851 consensus_queue.cc:237] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.734370  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:13.735036  1533 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:13.737339  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:13.738634  1843 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:13.739159  1843 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:13.740031  1843 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:13.742120  1791 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.743322  1791 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.747767  1791 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.751293  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:13.753368  1572 leader_election.cc:343] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:13.780812  1843 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:13.811626  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 80021.2us
I20260709 12:57:13.825162  1725 tablet_bootstrap.cc:492] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:13.773167  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:13.849817  1869 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.850596  1869 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.825783  1771 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.853223  1869 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.886157  1771 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.862407  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:57:13.896831  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 62736.7us
I20260709 12:57:13.897822  1771 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.898322  1771 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:13.898703  1771 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:13.899020  1771 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:13.902319  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:13.903095  1843 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:13.904349  1723 tablet_bootstrap.cc:492] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:13.904831  1723 ts_tablet_manager.cc:1403] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.326s	user 0.012s	sys 0.016s
I20260709 12:57:13.906474  1822 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:57:13.888700  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 54248.3us
I20260709 12:57:13.909432  1607 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:13.910400  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:13.919651  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:13.921496  1771 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.926595  1531 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 1: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:13.926419  1928 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.927392  1928 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.928736  1725 tablet_bootstrap.cc:654] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.933619  1723 raft_consensus.cc:359] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.935427  1723 raft_consensus.cc:385] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:13.935737  1723 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:13.923857  1771 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:13.937117  1723 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:13.932046  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:13.948225  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:13.948192  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:13.954725  1724 tablet_bootstrap.cc:654] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:13.958045  1723 ts_tablet_manager.cc:1434] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:57:13.941951  1683 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:13.972281  1723 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:13.979465  1796 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:57:13.979990  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:13.980818  1677 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:57:13.982772  1498 leader_election.cc:343] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:13.984104  1498 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:13.974318  1928 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:13.986979  1935 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:13.990166  1647 leader_election.cc:343] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:13.992540  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:14.001719  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.003969  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:57:14.004576  1936 log.cc:927] Time spent T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:57:14.009721  1575 leader_election.cc:343] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.010362  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:57:14.011080  1647 leader_election.cc:343] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.011544  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.012941  1928 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.011637  1796 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.023073  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:14.027029  1647 consensus_peers.cc:597] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:14.031735  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:14.034729  1723 tablet_bootstrap.cc:654] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.035809  1725 tablet_bootstrap.cc:492] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
W20260709 12:57:14.036223  1498 leader_election.cc:343] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.036504  1725 ts_tablet_manager.cc:1403] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.224s	user 0.017s	sys 0.022s
W20260709 12:57:14.042635  1498 leader_election.cc:343] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:14.043579  1498 leader_election.cc:343] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.046692  1725 raft_consensus.cc:359] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.047979  1791 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:14.049976  1429 catalog_manager.cc:5697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:14.059123  1724 tablet_bootstrap.cc:492] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.056705  1725 raft_consensus.cc:385] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.061995  1725 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
W20260709 12:57:14.059580  1497 leader_election.cc:343] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.059827  1724 ts_tablet_manager.cc:1403] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.334s	user 0.019s	sys 0.014s
I20260709 12:57:14.063212  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.064162  1771 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.062991  1725 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.066298  1724 raft_consensus.cc:359] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.067756  1724 raft_consensus.cc:385] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.068153  1724 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.065085  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.069017  1724 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.069998  1851 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.070329  1851 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.070669  1851 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.070787  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.073853  1771 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.074084  1724 ts_tablet_manager.cc:1434] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:57:14.075534  1724 tablet_bootstrap.cc:492] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.076186  1840 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:14.078047  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.087057  1928 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.089780  1725 ts_tablet_manager.cc:1434] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:57:14.095369  1851 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.098714  1935 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.099238  1935 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.099952  1725 tablet_bootstrap.cc:492] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:14.101730  1935 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.101970  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:14.102574  1678 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.098694  1851 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.103660  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:14.109699  1497 leader_election.cc:343] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.112985  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:14.114286  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.118362  1678 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:14.119760  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:57:14.125465  1498 leader_election.cc:343] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.127378  1851 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:57:14.127621  1498 leader_election.cc:343] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.127969  1851 raft_consensus.cc:697] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:14.129385  1851 consensus_queue.cc:237] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.132020  1498 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.132959  1869 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.139706  1723 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:14.143978  1723 ts_tablet_manager.cc:1403] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.021s
I20260709 12:57:14.142342  1725 tablet_bootstrap.cc:654] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.149290  1724 tablet_bootstrap.cc:654] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.152680  1723 raft_consensus.cc:359] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.162460  1723 raft_consensus.cc:385] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.163000  1723 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.163757  1723 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.167843  1723 ts_tablet_manager.cc:1434] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:57:14.168895  1723 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:14.169348  1724 tablet_bootstrap.cc:492] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.169713  1725 tablet_bootstrap.cc:492] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:14.169847  1724 ts_tablet_manager.cc:1403] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.011s
I20260709 12:57:14.170125  1725 ts_tablet_manager.cc:1403] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.018s
I20260709 12:57:14.173717  1724 raft_consensus.cc:359] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.174446  1724 raft_consensus.cc:385] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.174705  1724 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.175470  1723 tablet_bootstrap.cc:654] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.175261  1725 raft_consensus.cc:359] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.175356  1724 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.176000  1725 raft_consensus.cc:385] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.176296  1725 raft_consensus.cc:740] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.177013  1725 consensus_queue.cc:260] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.177718  1724 ts_tablet_manager.cc:1434] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:14.162436  1431 catalog_manager.cc:5697] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:14.178709  1724 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.185003  1724 tablet_bootstrap.cc:654] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.189625  1730 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.190270  1730 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.194605  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.195397  1532 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:14.198002  1730 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.199245  1724 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.199693  1724 ts_tablet_manager.cc:1403] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.001s
I20260709 12:57:14.200402  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.201423  1725 ts_tablet_manager.cc:1434] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:57:14.201519  1680 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:14.202342  1724 raft_consensus.cc:359] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.202988  1724 raft_consensus.cc:385] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.203224  1724 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.203739  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:14.203851  1724 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.205462  1730 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.206502  1724 ts_tablet_manager.cc:1434] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:57:14.209331  1725 tablet_bootstrap.cc:492] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:14.212790  1730 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.214560  1724 tablet_bootstrap.cc:492] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.219156  1725 tablet_bootstrap.cc:654] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.221608  1724 tablet_bootstrap.cc:654] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.223775  1723 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:14.224254  1723 ts_tablet_manager.cc:1403] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.021s
I20260709 12:57:14.227042  1724 tablet_bootstrap.cc:492] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.226871  1723 raft_consensus.cc:359] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.227671  1724 ts_tablet_manager.cc:1403] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 12:57:14.227705  1723 raft_consensus.cc:385] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.228363  1723 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.229146  1723 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.231233  1724 raft_consensus.cc:359] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.232148  1724 raft_consensus.cc:385] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.232487  1724 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.233464  1724 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.235220  1723 ts_tablet_manager.cc:1434] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:57:14.236318  1723 tablet_bootstrap.cc:492] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:14.236523  1724 ts_tablet_manager.cc:1434] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:57:14.237987  1724 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.246759  1723 tablet_bootstrap.cc:654] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.248538  1724 tablet_bootstrap.cc:654] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.249974  1725 tablet_bootstrap.cc:492] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:14.251386  1725 ts_tablet_manager.cc:1403] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.017s
I20260709 12:57:14.254787  1725 raft_consensus.cc:359] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.255666  1725 raft_consensus.cc:385] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.255992  1725 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.256789  1725 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.262971  1724 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.263067  1725 ts_tablet_manager.cc:1434] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:57:14.263542  1724 ts_tablet_manager.cc:1403] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 12:57:14.264104  1725 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:14.266290  1724 raft_consensus.cc:359] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.266963  1724 raft_consensus.cc:385] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.267298  1724 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.268045  1724 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.270418  1724 ts_tablet_manager.cc:1434] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:14.270587  1725 tablet_bootstrap.cc:654] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.271255  1851 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.271665  1851 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.272528  1724 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.274783  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.275403  1606 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:14.279382  1724 tablet_bootstrap.cc:654] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.281138  1498 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:14.282023  1869 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.282439  1869 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.282861  1869 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.284060  1730 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.284543  1730 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.285616  1851 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.286748  1730 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.287071  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.287650  1680 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:14.289044  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.289637  1532 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:14.290969  1723 tablet_bootstrap.cc:492] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:14.291082  1575 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:14.291643  1723 ts_tablet_manager.cc:1403] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.005s
I20260709 12:57:14.289598  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.292733  1831 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.293118  1831 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.293468  1831 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:14.298725  1572 leader_election.cc:343] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.300843  1724 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.301349  1724 ts_tablet_manager.cc:1403] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.009s
I20260709 12:57:14.303977  1724 raft_consensus.cc:359] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.304747  1724 raft_consensus.cc:385] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.305361  1724 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.304738  1723 raft_consensus.cc:359] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.306392  1723 raft_consensus.cc:385] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.307684  1723 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.306999  1724 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.308463  1723 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.310742  1724 ts_tablet_manager.cc:1434] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:57:14.312278  1724 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.313680  1851 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.314131  1851 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.317272  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:14.318667  1497 leader_election.cc:343] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.319582  1851 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.320425  1724 tablet_bootstrap.cc:654] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.320601  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.325838  1831 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:14.327978  1498 leader_election.cc:343] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.328368  1498 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.329890  1869 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.330447  1771 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.332125  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:14.332806  1532 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.333551  1724 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.334179  1724 ts_tablet_manager.cc:1403] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 12:57:14.332027  1869 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.336400  1831 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.336941  1724 raft_consensus.cc:359] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.337711  1724 raft_consensus.cc:385] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.338043  1724 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.338749  1724 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.339514  1725 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:14.339980  1725 ts_tablet_manager.cc:1403] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.038s
I20260709 12:57:14.341032  1724 ts_tablet_manager.cc:1434] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:57:14.340969  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:14.339694  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:14.341775  1606 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.342308  1724 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.342554  1725 raft_consensus.cc:359] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.343217  1725 raft_consensus.cc:385] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.343479  1725 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.343355  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:14.344075  1680 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.344439  1725 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:14.349002  1572 leader_election.cc:343] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.349531  1724 tablet_bootstrap.cc:654] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.350099  1725 ts_tablet_manager.cc:1434] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:57:14.350996  1725 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:14.356544  1725 tablet_bootstrap.cc:654] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.359869  1680 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:14.389931  1843 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.396656  1843 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.389539  1932 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:14.400288  1771 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.400969  1771 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.403540  1771 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.409791  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.399725  1843 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:14.392019  1723 ts_tablet_manager.cc:1434] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.005s
I20260709 12:57:14.413990  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.414835  1607 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
W20260709 12:57:14.418711  1647 leader_election.cc:343] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.422809  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.423731  1533 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:14.428325  1723 tablet_bootstrap.cc:492] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:14.431528  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.395721  1532 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:14.435009  1847 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.435550  1847 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.435916  1847 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.439342  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.440879  1497 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:14.441733  1869 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.442332  1869 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.444919  1869 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.452903  1498 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:14.453112  1575 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:14.474426  1724 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.474661  1730 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:57:14.474786  1497 leader_election.cc:343] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.474896  1724 ts_tablet_manager.cc:1403] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.133s	user 0.048s	sys 0.074s
I20260709 12:57:14.457755  1851 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:14.460132  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.455350  1922 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.473289  1847 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.475207  1730 raft_consensus.cc:697] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:14.476133  1935 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.490234  1935 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.481793  1606 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:14.490636  1935 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.489919  1922 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.490607  1730 consensus_queue.cc:237] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.495698  1723 tablet_bootstrap.cc:654] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.498246  1831 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.498571  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:14.498802  1831 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:14.502561  1647 leader_election.cc:343] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.499508  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:14.504462  1647 leader_election.cc:343] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.499751  1851 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:57:14.505605  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47072.4us
I20260709 12:57:14.504522  1831 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.505851  1851 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:14.507781  1498 leader_election.cc:343] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.509884  1847 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:14.501091  1725 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:14.513718  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.514880  1725 ts_tablet_manager.cc:1403] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.164s	user 0.056s	sys 0.062s
I20260709 12:57:14.515578  1724 raft_consensus.cc:359] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.518601  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:57:14.518836  1572 leader_election.cc:343] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.523166  1724 raft_consensus.cc:385] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.523172  1533 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:14.523654  1724 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.524345  1575 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:14.524266  1724 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.525192  1831 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.525609  1831 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.525949  1831 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.510797  1922 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:14.531719  1725 raft_consensus.cc:359] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.533824  1831 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.534497  1724 ts_tablet_manager.cc:1434] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.004s
I20260709 12:57:14.535442  1724 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.536847  1935 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.538223  1725 raft_consensus.cc:385] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.538553  1725 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.539309  1725 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.540405  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:14.544269  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:14.544806  1935 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.537637  1831 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.545095  1534 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.546530  1725 ts_tablet_manager.cc:1434] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:57:14.547601  1725 tablet_bootstrap.cc:492] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
W20260709 12:57:14.545253  1572 leader_election.cc:343] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.550302  1724 tablet_bootstrap.cc:654] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.553529  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:14.554214  1606 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.559212  1723 tablet_bootstrap.cc:492] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:14.559825  1723 ts_tablet_manager.cc:1403] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.011s
I20260709 12:57:14.561985  1606 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:14.563750  1723 raft_consensus.cc:359] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.564656  1723 raft_consensus.cc:385] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.564764  1831 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.565042  1723 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.565279  1831 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.566795  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:14.567531  1531 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.569980  1723 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.572350  1723 ts_tablet_manager.cc:1434] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:57:14.572769  1428 catalog_manager.cc:5697] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:14.574085  1725 tablet_bootstrap.cc:654] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.579469  1498 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:14.580364  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.581039  1532 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:14.585086  1869 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:14.585666  1869 raft_consensus.cc:697] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:14.586011  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.586496  1869 consensus_queue.cc:237] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.588937  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:14.591370  1831 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.592507  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.596664  1534 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:14.585250  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.597929  1843 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.598369  1843 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.598814  1843 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.603850  1531 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:14.608827  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.612522  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.613593  1840 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:14.614112  1840 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:14.614522  1572 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:14.614912  1840 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.613519  1575 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:14.616940  1944 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.617638  1944 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:14.617128  1431 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:14.618110  1944 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:14.618889  1944 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:14.622262  1497 leader_election.cc:343] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.622993  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.624079  1869 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.627446  1723 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:14.632645  1606 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.636477  1843 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.642383  1725 tablet_bootstrap.cc:492] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:14.643158  1725 ts_tablet_manager.cc:1403] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.001s
I20260709 12:57:14.646059  1869 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:14.647338  1497 leader_election.cc:343] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.647490  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:14.646179  1431 catalog_manager.cc:5697] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:14.649919  1647 leader_election.cc:343] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.657114  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:14.658159  1534 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.664438  1843 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:14.669137  1724 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.669646  1723 tablet_bootstrap.cc:654] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.669700  1724 ts_tablet_manager.cc:1403] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.134s	user 0.042s	sys 0.070s
I20260709 12:57:14.672878  1724 raft_consensus.cc:359] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.673851  1724 raft_consensus.cc:385] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.674345  1724 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.674793  1831 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.674908  1822 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.675036  1724 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.675376  1831 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.675567  1822 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.677417  1724 ts_tablet_manager.cc:1434] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:14.677649  1831 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.678495  1724 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.678503  1822 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.681749  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.680447  1428 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:14.684065  1725 raft_consensus.cc:359] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.682451  1679 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:14.685958  1725 raft_consensus.cc:385] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.686420  1725 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.687493  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.692996  1572 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:14.693529  1724 tablet_bootstrap.cc:654] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.687386  1725 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.694298  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.696676  1725 ts_tablet_manager.cc:1434] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.006s
I20260709 12:57:14.698073  1725 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:14.689983  1534 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:14.657171  1869 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:57:14.699628  1851 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:14.700865  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.686725  1429 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:14.712491  1498 leader_election.cc:343] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.706116  1843 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:14.713846  1843 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:14.713958  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.715191  1843 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.705427  1730 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:14.721091  1497 leader_election.cc:343] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.723788  1497 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.724931  1869 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.731832  1730 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:14.732781  1730 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.731207  1869 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.738374  1869 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.740763  1831 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.741274  1831 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.744663  1730 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.755429  1429 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:14.774060  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:14.776051  1607 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.781394  1851 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.782570  1822 consensus_queue.cc:1059] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:14.783457  1822 raft_consensus.cc:3055] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.783798  1822 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:14.784202  1725 tablet_bootstrap.cc:654] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.787813  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.784628  1822 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.789215  1822 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.791206  1723 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:14.795148  1723 ts_tablet_manager.cc:1403] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.168s	user 0.023s	sys 0.010s
I20260709 12:57:14.794114  1831 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.794982  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.795858  1678 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:14.793220  1724 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.796697  1730 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:14.795231  1497 leader_election.cc:343] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.797847  1724 ts_tablet_manager.cc:1403] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.120s	user 0.009s	sys 0.012s
I20260709 12:57:14.798447  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.798923  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.799292  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:14.797988  1723 raft_consensus.cc:359] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.800117  1723 raft_consensus.cc:385] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.781980  1851 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.800300  1723 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.799543  1534 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:14.798455  1572 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:14.801039  1723 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.801548  1724 raft_consensus.cc:359] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.802194  1724 raft_consensus.cc:385] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.802446  1724 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.803196  1723 ts_tablet_manager.cc:1434] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:57:14.803926  1730 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.803746  1724 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.803947  1572 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:14.804360  1730 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.803758  1725 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:14.804775  1730 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.805408  1831 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.805438  1725 ts_tablet_manager.cc:1403] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.108s	user 0.005s	sys 0.008s
I20260709 12:57:14.806696  1724 ts_tablet_manager.cc:1434] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:57:14.807691  1723 tablet_bootstrap.cc:492] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:14.809257  1725 raft_consensus.cc:359] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.809979  1725 raft_consensus.cc:385] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.810277  1725 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.811712  1725 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.811892  1730 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.814525  1723 tablet_bootstrap.cc:654] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.815083  1730 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.819209  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:14.820279  1678 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.825519  1723 tablet_bootstrap.cc:492] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:14.826009  1723 ts_tablet_manager.cc:1403] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 12:57:14.828001  1724 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.829595  1725 ts_tablet_manager.cc:1434] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:57:14.831001  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:14.835111  1534 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.835770  1725 tablet_bootstrap.cc:492] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:14.785315  1869 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:14.833489  1498 leader_election.cc:343] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.840780  1498 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.841944  1869 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.837600  1724 tablet_bootstrap.cc:654] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.834416  1678 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:14.851312  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:14.853544  1497 leader_election.cc:343] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.848516  1572 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:14.854288  1851 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.852567  1723 raft_consensus.cc:359] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.855587  1723 raft_consensus.cc:385] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.855868  1723 raft_consensus.cc:740] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.845286  1534 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:14.856925  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.858742  1723 consensus_queue.cc:260] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.856945  1730 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:14.859735  1730 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:57:14.859750  1498 leader_election.cc:343] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.860366  1498 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.860860  1723 ts_tablet_manager.cc:1434] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.001s
I20260709 12:57:14.860625  1730 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.861845  1822 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.862628  1723 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:14.871482  1723 tablet_bootstrap.cc:654] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.871819  1725 tablet_bootstrap.cc:654] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.876225  1724 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:14.876984  1724 ts_tablet_manager.cc:1403] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.005s
I20260709 12:57:14.883641  1724 raft_consensus.cc:359] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.885198  1724 raft_consensus.cc:385] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.885695  1724 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.886694  1724 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.889503  1724 ts_tablet_manager.cc:1434] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:57:14.891294  1725 tablet_bootstrap.cc:492] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:14.891858  1725 ts_tablet_manager.cc:1403] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.008s
I20260709 12:57:14.894770  1725 raft_consensus.cc:359] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.896581  1725 raft_consensus.cc:385] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.896912  1725 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.897632  1723 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:14.897919  1725 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.898604  1851 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.898140  1723 ts_tablet_manager.cc:1403] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.009s
I20260709 12:57:14.898319  1429 catalog_manager.cc:5697] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:14.899328  1724 tablet_bootstrap.cc:492] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:14.899052  1851 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.900913  1725 ts_tablet_manager.cc:1434] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:57:14.902624  1725 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:14.911650  1869 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.912228  1869 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.913512  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.916071  1843 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.916530  1843 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.917042  1723 raft_consensus.cc:359] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.918200  1723 raft_consensus.cc:385] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:14.918668  1723 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:14.919605  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.924818  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.925576  1534 raft_consensus.cc:2393] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:14.927033  1649 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.927928  1847 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:14.938148  1851 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:14.942087  1498 leader_election.cc:343] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.943491  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.944271  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.945120  1723 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:14.946763  1498 leader_election.cc:343] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.950526  1869 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:14.952679  1723 ts_tablet_manager.cc:1434] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.054s	user 0.025s	sys 0.015s
W20260709 12:57:14.955232  1497 leader_election.cc:343] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.956269  1497 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.949189  1843 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:14.961086  1725 tablet_bootstrap.cc:654] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.954996  1847 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.961719  1869 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.963657  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:14.963691  1723 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:14.967103  1840 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.967402  1724 tablet_bootstrap.cc:654] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.967625  1840 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:14.969151  1497 leader_election.cc:343] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.969722  1497 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.971076  1869 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:14.970077  1840 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:14.973266  1723 tablet_bootstrap.cc:654] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:14.972886  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:14.973872  1534 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:14.974675  1840 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.974828  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:14.976814  1647 leader_election.cc:343] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:14.975155  1840 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:14.979429  1840 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:14.980906  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:14.985098  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:14.986611  1847 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:14.987061  1847 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.987434  1847 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:14.993665  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:15.000590  1725 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:15.002454  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:15.004611  1725 ts_tablet_manager.cc:1403] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.007s
I20260709 12:57:15.004997  1534 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:14.997536  1847 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.004655  1723 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:15.006896  1723 ts_tablet_manager.cc:1403] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.016s
I20260709 12:57:15.007387  1725 raft_consensus.cc:359] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.008060  1725 raft_consensus.cc:385] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.008306  1725 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.008661  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:15.008939  1725 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:15.009830  1647 leader_election.cc:343] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.009703  1723 raft_consensus.cc:359] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.010454  1723 raft_consensus.cc:385] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.002553  1724 tablet_bootstrap.cc:492] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:15.010805  1723 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.010982  1725 ts_tablet_manager.cc:1434] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:57:15.011102  1724 ts_tablet_manager.cc:1403] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.049s
I20260709 12:57:15.011580  1723 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.012424  1725 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:15.013618  1724 raft_consensus.cc:359] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.013873  1723 ts_tablet_manager.cc:1434] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:57:15.014222  1724 raft_consensus.cc:385] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.014529  1724 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.010812  1847 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:15.016518  1724 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.018488  1724 ts_tablet_manager.cc:1434] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:15.003084  1606 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.019333  1678 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.020921  1723 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:15.028051  1831 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.028739  1724 tablet_bootstrap.cc:492] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:15.031867  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:15.032811  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:15.033442  1534 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.035502  1724 tablet_bootstrap.cc:654] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.041283  1534 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:15.045710  1851 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.046701  1831 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:15.049276  1851 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:15.050318  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:15.052256  1723 tablet_bootstrap.cc:654] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.055415  1843 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.056149  1725 tablet_bootstrap.cc:654] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.055968  1843 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:15.057235  1843 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.061137  1831 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.069000  1831 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.073246  1725 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:15.075517  1725 ts_tablet_manager.cc:1403] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.001s
I20260709 12:57:15.079034  1725 raft_consensus.cc:359] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.079938  1725 raft_consensus.cc:385] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.080273  1725 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.082497  1730 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.082737  1944 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.081183  1725 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.089282  1725 ts_tablet_manager.cc:1434] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:57:15.098042  1725 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:15.109882  1725 tablet_bootstrap.cc:654] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.127779  1725 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:15.127615  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:15.126961  1831 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.128480  1725 ts_tablet_manager.cc:1403] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.007s
I20260709 12:57:15.128500  1532 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:15.129959  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:15.132665  1725 raft_consensus.cc:359] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.133932  1725 raft_consensus.cc:385] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.134341  1725 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.135285  1725 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.136696  1730 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.137182  1730 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.137635  1730 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.145833  1730 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.146569  1822 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:15.149523  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:15.150053  1730 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.150169  1533 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.149394  1725 ts_tablet_manager.cc:1434] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:57:15.151979  1725 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:15.159997  1725 tablet_bootstrap.cc:654] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.170348  1533 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:15.171116  1822 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.173750  1822 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.176733  1822 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.177035  1725 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:15.178079  1725 ts_tablet_manager.cc:1403] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 12:57:15.181137  1725 raft_consensus.cc:359] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.183634  1725 raft_consensus.cc:385] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.184798  1725 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.186345  1725 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.189383  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:15.184172  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:15.191713  1944 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.192243  1944 raft_consensus.cc:697] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:15.192557  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.193451  1725 ts_tablet_manager.cc:1434] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:57:15.193733  1680 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:15.193655  1944 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.194463  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:15.195662  1681 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.196691  1725 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
W20260709 12:57:15.198957  1498 leader_election.cc:343] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.222710  1840 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.227592  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.229506  1922 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.231771  1725 tablet_bootstrap.cc:654] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.235749  1847 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.240801  1730 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.241389  1730 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.254597  1730 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:15.260624  1497 leader_election.cc:343] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.261183  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:57:15.266570  1497 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:15.266942  1723 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:15.267334  1723 ts_tablet_manager.cc:1403] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.247s	user 0.044s	sys 0.091s
I20260709 12:57:15.269156  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.270812  1723 raft_consensus.cc:359] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.271505  1723 raft_consensus.cc:385] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.271770  1723 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.255717  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:15.273721  1963 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.284389  1723 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.286204  1575 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:15.287631  1730 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.290817  1723 ts_tablet_manager.cc:1434] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:57:15.293136  1723 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:15.296161  1724 tablet_bootstrap.cc:492] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:15.296684  1724 ts_tablet_manager.cc:1403] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.268s	user 0.037s	sys 0.082s
I20260709 12:57:15.278446  1681 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:15.315685  1996 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.316689  1604 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.317006  1996 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.319509  1996 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.330896  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:15.341876  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.344985  1723 tablet_bootstrap.cc:654] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.347433  1606 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.348232  1724 raft_consensus.cc:359] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.350099  1572 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:15.355075  1724 raft_consensus.cc:385] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.356889  1724 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.358299  1724 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.360126  1724 ts_tablet_manager.cc:1434] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.001s
I20260709 12:57:15.361212  1724 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:15.363586  1843 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:15.363610  1996 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:57:15.382524  1730 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.383246  1730 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.390666  1725 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:15.391444  1725 ts_tablet_manager.cc:1403] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.196s	user 0.029s	sys 0.026s
I20260709 12:57:15.392645  1730 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.396086  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:15.380137  1831 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:57:15.397842  1534 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:15.399109  1723 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:15.402264  1723 ts_tablet_manager.cc:1403] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.109s	user 0.007s	sys 0.009s
I20260709 12:57:15.399097  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.402182  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:15.390342  1843 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.410089  1843 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.412125  1843 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:15.414134  1831 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.414541  1831 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.415491  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:15.408808  1572 leader_election.cc:343] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.416121  1607 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:15.416972  1831 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.417690  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:15.419508  1533 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:15.427006  1647 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:15.433413  1922 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.445497  1723 raft_consensus.cc:359] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.442421  1922 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.446261  1723 raft_consensus.cc:385] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.446593  1723 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.447628  1723 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.433926  1944 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:15.450271  1723 ts_tablet_manager.cc:1434] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.003s
I20260709 12:57:15.447752  1922 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.452491  1840 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:15.463982  1724 tablet_bootstrap.cc:654] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.466922  1922 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.472368  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:15.472970  1534 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.474176  1922 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:15.479892  1723 tablet_bootstrap.cc:492] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:15.487753  1725 raft_consensus.cc:359] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.488660  1725 raft_consensus.cc:385] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.488967  1725 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.498325  1725 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.515079  1725 ts_tablet_manager.cc:1434] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.123s	user 0.005s	sys 0.003s
W20260709 12:57:15.510601  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 60652.4us
I20260709 12:57:15.520799  1831 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.526544  1724 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:15.527164  1724 ts_tablet_manager.cc:1403] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.016s
I20260709 12:57:15.529534  1831 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.530268  1725 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:15.502826  1534 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:15.532944  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:15.533706  1533 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.539888  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:15.540587  1607 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.544116  1429 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:15.546553  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:15.552698  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:15.553329  1677 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.549436  1843 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.556501  1843 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:15.558552  1843 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.560989  1723 tablet_bootstrap.cc:654] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.563301  1607 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:15.563241  1724 raft_consensus.cc:359] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.567593  1724 raft_consensus.cc:385] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.567984  1724 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.569538  2012 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.578245  1533 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:15.579281  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:15.581104  1831 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.581506  1831 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:15.582403  1831 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.568903  1724 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.597975  1724 ts_tablet_manager.cc:1434] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.003s
I20260709 12:57:15.599484  1724 tablet_bootstrap.cc:492] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
W20260709 12:57:15.600801  1647 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:15.601531  1730 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.602059  1730 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.604055  1730 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.604475  1730 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.604887  1730 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.618326  1677 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:15.623215  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.624418  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:15.625290  1529 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
W20260709 12:57:15.630347  1572 leader_election.cc:343] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.631937  1822 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.632469  1822 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.634174  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:15.636485  1730 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.642257  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.639690  2009 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.643396  2009 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.643870  2009 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.644222  1725 tablet_bootstrap.cc:654] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:15.645818  1572 leader_election.cc:343] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.644646  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:15.649704  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:15.650370  1607 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:15.653692  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:15.655332  1851 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.655459  1822 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.655764  1851 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.657126  1851 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.661967  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.662607  1683 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:15.664104  1851 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.649298  1529 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:15.665678  1996 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.669050  1575 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:15.670871  1723 tablet_bootstrap.cc:492] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:15.671243  1723 ts_tablet_manager.cc:1403] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.192s	user 0.020s	sys 0.005s
I20260709 12:57:15.670270  1996 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.671729  1996 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.672605  1996 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.673621  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:15.675463  1607 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.677824  1723 raft_consensus.cc:359] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.678671  1723 raft_consensus.cc:385] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.678864  1723 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.679486  1723 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.684494  1851 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.685462  1724 tablet_bootstrap.cc:654] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.687462  1723 ts_tablet_manager.cc:1434] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:57:15.696422  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:15.696923  1677 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.698428  1725 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:15.698894  1725 ts_tablet_manager.cc:1403] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.009s
I20260709 12:57:15.700090  2009 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.700940  1607 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:15.702651  1725 raft_consensus.cc:359] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.703378  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:15.703725  1725 raft_consensus.cc:385] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.703941  1533 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.704062  1725 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.704177  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:15.705701  1822 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:15.706359  1822 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:15.705926  1996 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.706041  1725 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.707185  1822 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.708315  1723 tablet_bootstrap.cc:492] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:15.714387  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:15.714782  2009 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:15.717501  1572 leader_election.cc:343] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.717844  1533 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:15.719519  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:15.721184  2009 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.721897  2009 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:15.732684  1725 ts_tablet_manager.cc:1434] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
I20260709 12:57:15.736322  1724 tablet_bootstrap.cc:492] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:15.736829  1724 ts_tablet_manager.cc:1403] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.006s
I20260709 12:57:15.738538  1725 tablet_bootstrap.cc:492] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:15.723413  2009 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.744529  1730 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:15.753185  1822 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.753880  1822 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.777206  1822 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.786079  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:15.786835  1679 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
W20260709 12:57:15.787801  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 46550.6us
I20260709 12:57:15.788255  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:15.790282  1996 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.791062  1869 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:15.791455  1869 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.791783  1869 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.791321  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:15.793068  1533 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.823138  1428 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:15.827854  1677 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:15.834949  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:15.836190  1723 tablet_bootstrap.cc:654] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:15.839196  1572 leader_election.cc:343] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.842587  1724 raft_consensus.cc:359] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.843302  1724 raft_consensus.cc:385] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.843600  1724 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.820001  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:15.844306  1724 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.846412  1724 ts_tablet_manager.cc:1434] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.109s	user 0.012s	sys 0.010s
I20260709 12:57:15.854564  1533 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:15.856280  1724 tablet_bootstrap.cc:492] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
W20260709 12:57:15.861042  1498 leader_election.cc:343] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.866667  1575 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:15.871966  1944 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.878019  1944 raft_consensus.cc:697] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:15.879086  1944 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.884684  1869 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.888434  1429 catalog_manager.cc:5697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 2, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:15.896471  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:15.898581  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:15.904546  1677 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:15.906786  1725 tablet_bootstrap.cc:654] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.903069  1869 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:15.915304  1677 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
W20260709 12:57:15.916785  1498 leader_election.cc:343] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:15.918256  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:15.918906  1723 tablet_bootstrap.cc:492] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:15.919384  1723 ts_tablet_manager.cc:1403] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.224s	user 0.018s	sys 0.059s
I20260709 12:57:15.920468  1869 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:15.921178  1869 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:15.923278  1869 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.923779  1723 raft_consensus.cc:359] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.924973  1723 raft_consensus.cc:385] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.925345  1723 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.926077  1723 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.928265  1723 ts_tablet_manager.cc:1434] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:57:15.929364  1723 tablet_bootstrap.cc:492] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:15.927071  1431 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:15.937299  1723 tablet_bootstrap.cc:654] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.945871  1724 tablet_bootstrap.cc:654] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.951339  1724 tablet_bootstrap.cc:492] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:15.951992  1724 ts_tablet_manager.cc:1403] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.002s
I20260709 12:57:15.956164  1724 raft_consensus.cc:359] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.957185  1724 raft_consensus.cc:385] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.957655  1724 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.958815  1724 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.962458  1724 ts_tablet_manager.cc:1434] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:57:15.964095  1724 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:15.970476  1724 tablet_bootstrap.cc:654] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.970932  1723 tablet_bootstrap.cc:492] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:15.971472  1723 ts_tablet_manager.cc:1403] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.005s
I20260709 12:57:15.970865  1429 catalog_manager.cc:5697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:15.972683  1429 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:15.974682  1723 raft_consensus.cc:359] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.975384  1723 raft_consensus.cc:385] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.975642  1723 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.976356  1725 tablet_bootstrap.cc:492] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:15.976223  1723 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.976120  1429 catalog_manager.cc:5697] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:15.976796  1725 ts_tablet_manager.cc:1403] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.240s	user 0.029s	sys 0.028s
I20260709 12:57:15.978307  1723 ts_tablet_manager.cc:1434] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:15.979214  1723 tablet_bootstrap.cc:492] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:15.980132  1725 raft_consensus.cc:359] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.980770  1725 raft_consensus.cc:385] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.981429  1725 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.982115  1725 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.983387  1724 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:15.983791  1724 ts_tablet_manager.cc:1403] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:57:15.984076  1725 ts_tablet_manager.cc:1434] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:57:15.985144  1725 tablet_bootstrap.cc:492] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:15.986182  1723 tablet_bootstrap.cc:654] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.987161  1724 raft_consensus.cc:359] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.987914  1724 raft_consensus.cc:385] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:15.988277  1724 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:15.990427  1724 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:15.992318  1725 tablet_bootstrap.cc:654] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.992838  1724 ts_tablet_manager.cc:1434] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:57:15.993974  1724 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.002761  1724 tablet_bootstrap.cc:654] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:15.993624  1428 catalog_manager.cc:5697] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.023969  1677 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.039001  1723 tablet_bootstrap.cc:492] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:16.039492  1723 ts_tablet_manager.cc:1403] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.060s	user 0.033s	sys 0.013s
I20260709 12:57:16.042116  1723 raft_consensus.cc:359] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.042698  1840 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.042769  1723 raft_consensus.cc:385] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.043530  1609 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.043601  1723 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.044438  1723 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.047176  1723 ts_tablet_manager.cc:1434] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:16.048133  1723 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:16.049026  1724 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:16.049587  1724 ts_tablet_manager.cc:1403] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.003s
I20260709 12:57:16.072899  1724 raft_consensus.cc:359] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.074015  1724 raft_consensus.cc:385] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.074347  1723 tablet_bootstrap.cc:654] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.077032  1725 tablet_bootstrap.cc:492] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:16.077487  1725 ts_tablet_manager.cc:1403] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.023s
I20260709 12:57:16.074608  1724 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
W20260709 12:57:16.085912  1560 tablet.cc:2406] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:57:16.087405  1725 raft_consensus.cc:359] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.088126  1725 raft_consensus.cc:385] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.088413  1725 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.089036  1725 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.090339  1724 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.094919  1725 ts_tablet_manager.cc:1434] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:57:16.101091  1725 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:16.098039  1724 ts_tablet_manager.cc:1434] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.005s
I20260709 12:57:16.102694  1724 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.119784  1843 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.144935  1724 tablet_bootstrap.cc:654] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:16.148552  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:16.151293  1723 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:16.151746  1723 ts_tablet_manager.cc:1403] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.104s	user 0.023s	sys 0.003s
I20260709 12:57:16.154387  1723 raft_consensus.cc:359] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.155033  1723 raft_consensus.cc:385] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.155295  1723 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.156625  1723 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.158032  1725 tablet_bootstrap.cc:654] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.160359  1723 ts_tablet_manager.cc:1434] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:57:16.161551  1723 tablet_bootstrap.cc:492] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:16.170781  1843 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.166707  1996 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:57:16.171299  1843 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.176942  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.177873  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.179021  1840 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:16.179590  1647 leader_election.cc:343] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.179553  1840 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.174602  1843 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:16.188305  1723 tablet_bootstrap.cc:654] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.189224  1724 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:16.191777  1724 ts_tablet_manager.cc:1403] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.009s
I20260709 12:57:16.194306  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.195140  1529 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:16.199353  1724 raft_consensus.cc:359] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.200412  1724 raft_consensus.cc:385] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.200824  1724 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.202041  1724 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.204057  1840 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:16.205315  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:16.193436  1649 leader_election.cc:343] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.205972  1609 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:16.206143  1649 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.207460  1840 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.208166  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:16.209394  1724 ts_tablet_manager.cc:1434] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:57:16.210228  1944 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.212787  1840 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.213152  1840 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.213492  1840 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.213639  1843 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.214195  1843 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.217216  1843 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:16.219242  1724 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.219497  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.226673  1606 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:16.228113  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:16.229041  2051 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.229434  2051 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.230041  2051 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.234947  1724 tablet_bootstrap.cc:654] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.251821  1843 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:16.252610  1843 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:16.260171  1572 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:16.262540  1869 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.263058  1869 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.264806  1869 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.264762  2051 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.266184  1606 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:16.265748  1843 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:16.267729  1869 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.268260  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.269352  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.270499  2051 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:57:16.270769  1497 leader_election.cc:343] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.273911  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:16.274482  1534 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.274705  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.275332  1530 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:16.279481  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:16.280257  1534 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:16.280548  1843 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.280457  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:16.280974  1843 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:16.281139  1609 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.281343  1843 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.281728  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:16.282723  2012 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.283160  2012 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:16.283943  2012 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.285288  2029 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.286775  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.287374  1532 raft_consensus.cc:2376] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1. Re-sending same reply.
I20260709 12:57:16.291956  1822 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.292481  1822 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.296489  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.297199  1725 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:16.297437  1607 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:16.297775  1725 ts_tablet_manager.cc:1403] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.197s	user 0.026s	sys 0.035s
W20260709 12:57:16.307304  1498 leader_election.cc:343] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.307816  1498 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.308514  1869 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.310442  1725 raft_consensus.cc:359] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.311148  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.311149  1725 raft_consensus.cc:385] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.312407  1725 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.312523  1869 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.312999  1869 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.313124  1725 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.315032  1869 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.315179  1725 ts_tablet_manager.cc:1434] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
W20260709 12:57:16.315789  1498 leader_election.cc:343] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.316169  1725 tablet_bootstrap.cc:492] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:16.316704  1609 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:16.325313  1724 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:16.318404  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.327522  1724 ts_tablet_manager.cc:1403] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.017s
I20260709 12:57:16.319496  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.320509  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:16.328318  1498 leader_election.cc:343] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.330641  1724 raft_consensus.cc:359] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.332259  1724 raft_consensus.cc:385] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.332569  1724 raft_consensus.cc:740] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
W20260709 12:57:16.334443  1572 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:16.334733  1724 consensus_queue.cc:260] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.336903  1724 ts_tablet_manager.cc:1434] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:57:16.338066  1724 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.340025  1428 catalog_manager.cc:5697] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:16.309358  1822 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.321851  1723 tablet_bootstrap.cc:492] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:16.349879  1723 ts_tablet_manager.cc:1403] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.189s	user 0.019s	sys 0.014s
I20260709 12:57:16.321549  1843 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.322356  2009 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.317591  1840 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.351271  2009 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.352501  1723 raft_consensus.cc:359] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.352557  1840 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:16.353253  2009 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.354686  1843 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:16.356395  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:16.356979  1609 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.357316  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:16.353246  1723 raft_consensus.cc:385] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.358099  1723 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.358116  1604 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:16.358629  1724 tablet_bootstrap.cc:654] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.358733  1723 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.360898  1723 ts_tablet_manager.cc:1434] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 12:57:16.361110  1725 tablet_bootstrap.cc:654] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.356367  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.370841  1609 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:16.372031  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:16.373123  1840 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.373610  1840 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:16.374420  1840 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:16.375097  1575 leader_election.cc:343] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.381186  1724 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:16.381034  1944 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.381654  1724 ts_tablet_manager.cc:1403] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.005s
I20260709 12:57:16.384085  1724 raft_consensus.cc:359] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.384744  1724 raft_consensus.cc:385] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.385027  1724 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.386895  1724 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.388340  1724 ts_tablet_manager.cc:1434] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:57:16.388386  1723 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:16.389267  1724 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
W20260709 12:57:16.389429  1498 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:16.394023  1497 leader_election.cc:343] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.394438  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.396356  1677 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:16.396593  1724 tablet_bootstrap.cc:654] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.397498  1869 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.404208  1430 catalog_manager.cc:5697] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:16.422835  1724 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:16.423348  1724 ts_tablet_manager.cc:1403] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.007s
I20260709 12:57:16.423502  1723 tablet_bootstrap.cc:654] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.426433  1724 raft_consensus.cc:359] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.427091  1724 raft_consensus.cc:385] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.427337  1724 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.428020  1724 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.429946  1724 ts_tablet_manager.cc:1434] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:57:16.434877  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.437666  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:16.437891  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:16.438292  1530 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:16.440678  1497 leader_election.cc:343] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.441092  1497 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:57:16.442905  1572 leader_election.cc:343] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.443219  2065 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.443321  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:16.443718  2065 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.445067  2029 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.445362  1725 tablet_bootstrap.cc:492] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:16.445802  1725 ts_tablet_manager.cc:1403] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.130s	user 0.016s	sys 0.003s
I20260709 12:57:16.446156  2065 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.442925  1822 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.446775  2065 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.448288  1725 raft_consensus.cc:359] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.448933  1725 raft_consensus.cc:385] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.454674  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.455277  1724 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.456070  1725 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
W20260709 12:57:16.456327  1498 leader_election.cc:343] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.457837  1725 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.460353  1725 ts_tablet_manager.cc:1434] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 12:57:16.461236  1725 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:16.456948  1529 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:16.476121  1725 tablet_bootstrap.cc:654] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.476946  1724 tablet_bootstrap.cc:654] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.468699  1530 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:16.487322  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.491412  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.492204  2050 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.492364  1677 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:16.493012  2050 raft_consensus.cc:697] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:16.495253  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.496989  2050 consensus_queue.cc:237] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.499089  1869 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.521942  1723 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:16.522428  1723 ts_tablet_manager.cc:1403] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.041s
I20260709 12:57:16.523229  1869 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.523628  1869 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.523955  1869 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.524441  1725 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:16.524893  1725 ts_tablet_manager.cc:1403] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.004s
I20260709 12:57:16.527273  1725 raft_consensus.cc:359] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.527901  1725 raft_consensus.cc:385] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.528141  1725 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.528796  1725 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.531951  1725 ts_tablet_manager.cc:1434] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:16.532886  1725 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:16.534763  1724 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:16.535326  1724 ts_tablet_manager.cc:1403] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.010s
I20260709 12:57:16.547873  1822 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.548395  1822 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.554502  1822 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.561980  2029 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.564867  1428 catalog_manager.cc:5697] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:16.567327  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.561426  1869 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.562461  2029 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.571635  1724 raft_consensus.cc:359] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.574287  1724 raft_consensus.cc:385] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.574733  1724 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.575569  1723 raft_consensus.cc:359] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.576016  1723 raft_consensus.cc:385] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.576177  1723 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.576901  1724 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.578033  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.578629  1678 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:16.581327  1497 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:16.584244  2066 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.586777  2066 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.587093  2066 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.588171  1723 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.591522  1724 ts_tablet_manager.cc:1434] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.005s
I20260709 12:57:16.584308  1609 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:16.598663  2029 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.601249  1724 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.603020  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.603848  1677 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:16.605159  1822 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.607818  1572 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:16.605548  1822 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.608572  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.610379  2029 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.610733  2029 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.611048  2029 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.612798  1723 ts_tablet_manager.cc:1434] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.002s
I20260709 12:57:16.618165  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:16.619629  1498 leader_election.cc:343] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.620491  1723 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:16.619683  1725 tablet_bootstrap.cc:654] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.627949  1822 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.629485  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.629108  1724 tablet_bootstrap.cc:654] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:16.630949  1497 leader_election.cc:343] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.631407  1497 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.632375  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:57:16.633527  1498 leader_election.cc:343] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.632407  1822 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.637789  1869 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.638903  2066 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.640189  1530 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:16.642069  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:16.642640  1679 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.643657  2029 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.646266  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:16.646303  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:16.647109  1530 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:16.647073  1680 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.647265  1822 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.647701  1822 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.649510  1822 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.650403  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.650998  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.651589  1604 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
W20260709 12:57:16.651857  1497 leader_election.cc:343] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.652628  1498 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:16.652915  2029 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.653622  1822 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.654049  1822 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.654346  1822 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.657584  1679 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:16.663888  1725 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:16.664278  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:16.665176  1604 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:16.661046  1723 tablet_bootstrap.cc:654] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.661918  1680 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:16.660550  1822 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.666792  1572 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:16.665063  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.667641  2072 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.667819  2029 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.668332  2072 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:16.668516  2029 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:16.669133  1944 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.669358  2029 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.669715  1944 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.669387  2072 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.671793  1944 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.673138  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:16.674597  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.674768  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.665709  1725 ts_tablet_manager.cc:1403] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.001s
I20260709 12:57:16.674041  1679 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:16.663467  2066 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.677325  1572 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:16.680163  2029 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.685545  1724 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:16.686050  1724 ts_tablet_manager.cc:1403] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.017s
I20260709 12:57:16.687932  1497 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.688519  1724 raft_consensus.cc:359] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.689944  1724 raft_consensus.cc:385] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.690217  1724 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.690709  1725 raft_consensus.cc:359] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.691457  1725 raft_consensus.cc:385] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.691057  1724 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.691782  2066 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.691764  1430 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.694959  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:16.695565  1604 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.695976  1822 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.698208  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:57:16.699831  1497 leader_election.cc:343] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.705653  1428 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.694182  1724 ts_tablet_manager.cc:1434] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:57:16.691802  1725 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.718675  2072 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.718443  1725 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.720324  1725 ts_tablet_manager.cc:1434] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:57:16.721931  1725 tablet_bootstrap.cc:492] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:16.722031  2050 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:16.719210  2072 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.729621  1725 tablet_bootstrap.cc:654] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.729514  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:16.732082  1498 leader_election.cc:343] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.732411  2072 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.732921  1724 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.735147  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.739039  1604 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
W20260709 12:57:16.739146  1497 leader_election.cc:343] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.740099  1497 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.740350  1498 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:16.741055  1822 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.741873  1822 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.742362  1822 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:16.743124  1822 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.744304  1724 tablet_bootstrap.cc:654] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.747361  1723 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:16.747880  1723 ts_tablet_manager.cc:1403] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.014s
I20260709 12:57:16.766371  1723 raft_consensus.cc:359] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.767045  1723 raft_consensus.cc:385] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.767594  1723 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.768332  1723 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.775362  1604 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.776108  2057 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.776568  2057 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.778829  2057 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:16.781253  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.781875  1534 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:16.782159  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:16.783888  1647 leader_election.cc:343] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.784371  2050 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.785048  1649 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.786180  1843 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:16.786509  1843 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.786806  1843 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.787427  2009 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.787885  2009 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.793223  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:16.793850  1534 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:16.793936  2009 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.795333  1575 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:16.797420  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.798744  2009 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:16.799115  2009 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.799440  2009 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:16.802899  1843 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.808163  1725 tablet_bootstrap.cc:492] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:16.808781  1680 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.812880  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:57:16.814308  1647 leader_election.cc:343] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.815140  1843 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:16.823155  1725 ts_tablet_manager.cc:1403] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.012s
I20260709 12:57:16.809906  1724 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:16.824501  1724 ts_tablet_manager.cc:1403] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.003s
I20260709 12:57:16.808780  2009 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.826267  1822 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.826736  1822 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.809890  1723 ts_tablet_manager.cc:1434] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:57:16.828280  1723 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:16.828353  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:16.829245  1534 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:16.829815  1822 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.832479  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.832667  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:16.833338  1530 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:16.833886  1498 leader_election.cc:343] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.834585  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.836635  1724 raft_consensus.cc:359] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.837368  1724 raft_consensus.cc:385] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.837761  1724 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.838428  1724 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.840946  1724 ts_tablet_manager.cc:1434] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:57:16.841866  2009 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.829047  1725 raft_consensus.cc:359] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.844054  1725 raft_consensus.cc:385] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.844434  1725 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
W20260709 12:57:16.846240  1497 leader_election.cc:343] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.846860  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.847414  1530 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:16.847693  2072 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.849074  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:16.850273  1575 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:16.851147  2030 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:16.851605  2030 raft_consensus.cc:697] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:16.852362  2030 consensus_queue.cc:237] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.855546  1723 tablet_bootstrap.cc:654] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.855333  1430 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.850411  1725 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.867003  1724 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.860136  1534 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:16.870026  1649 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.875267  1843 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:16.875777  1843 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:16.876631  1843 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.877382  1725 ts_tablet_manager.cc:1434] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:57:16.878382  1725 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:16.902158  1724 tablet_bootstrap.cc:654] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.906843  1723 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:16.907387  1723 ts_tablet_manager.cc:1403] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.005s
I20260709 12:57:16.899931  1529 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:16.912915  1843 consensus_queue.cc:1059] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:16.916996  1725 tablet_bootstrap.cc:654] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.917255  1723 raft_consensus.cc:359] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.918747  1723 raft_consensus.cc:385] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.919052  1723 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.919858  2050 raft_consensus.cc:3055] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:16.920799  2050 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:16.921424  1723 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.921662  2050 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.923712  2050 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:16.924141  1723 ts_tablet_manager.cc:1434] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:57:16.926093  1723 tablet_bootstrap.cc:492] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:16.920821  1431 catalog_manager.cc:5697] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:16.936468  1429 catalog_manager.cc:5697] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:16.938578  1723 tablet_bootstrap.cc:654] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:16.955156  1843 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:16.959404  2072 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.961328  2072 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.963934  2072 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.965847  1723 tablet_bootstrap.cc:492] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:16.965965  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:16.966741  1723 ts_tablet_manager.cc:1403] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
I20260709 12:57:16.967705  1724 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
W20260709 12:57:16.967897  1498 leader_election.cc:343] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.968125  1724 ts_tablet_manager.cc:1403] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.023s
I20260709 12:57:16.969794  1723 raft_consensus.cc:359] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.965957  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.970752  1724 raft_consensus.cc:359] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.972713  1723 raft_consensus.cc:385] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.972777  1724 raft_consensus.cc:385] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.973593  1724 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.973593  1723 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
W20260709 12:57:16.973443  1497 leader_election.cc:343] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.974282  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.974532  1724 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.975463  2072 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:16.977417  1724 ts_tablet_manager.cc:1434] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:57:16.975559  1725 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:16.977967  1725 ts_tablet_manager.cc:1403] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.003s
I20260709 12:57:16.975651  1723 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.978417  2072 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.978884  2072 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.980602  2072 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:16.981812  1724 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:16.988020  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:16.988481  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:16.990819  1497 leader_election.cc:343] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.990965  1723 ts_tablet_manager.cc:1434] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
W20260709 12:57:16.994156  1498 leader_election.cc:343] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:16.994282  1723 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:16.994550  1498 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:16.994473  1725 raft_consensus.cc:359] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.995187  1725 raft_consensus.cc:385] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:16.995452  1725 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:16.996080  1725 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:16.998152  1725 ts_tablet_manager.cc:1434] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:57:16.999053  1725 tablet_bootstrap.cc:492] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:16.999089  2066 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:17.002101  1843 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.004451  1724 tablet_bootstrap.cc:654] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.005465  2051 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.005965  2051 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.008467  2051 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:17.009773  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:17.010933  1647 leader_election.cc:343] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.011897  1725 tablet_bootstrap.cc:654] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.016705  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.017395  1529 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:17.035501  1723 tablet_bootstrap.cc:654] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.048460  1649 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.049296  2050 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.049705  1723 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.049722  1724 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:17.049669  2050 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.050292  1723 ts_tablet_manager.cc:1403] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.003s
I20260709 12:57:17.050282  2050 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.050334  1724 ts_tablet_manager.cc:1403] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.004s
I20260709 12:57:17.053318  1723 raft_consensus.cc:359] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.053351  1724 raft_consensus.cc:359] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.054085  1723 raft_consensus.cc:385] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.054143  1724 raft_consensus.cc:385] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.054443  1723 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.054548  1724 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.055261  1723 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.055210  1724 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.058198  1724 ts_tablet_manager.cc:1434] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:17.059474  1724 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:17.062628  2050 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.065135  1724 tablet_bootstrap.cc:654] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.064854  1996 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.067662  1723 ts_tablet_manager.cc:1434] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:57:17.072491  1723 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.081441  1723 tablet_bootstrap.cc:654] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.084623  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:17.086207  1534 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.088860  1843 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.088611  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:17.089388  1843 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:17.090723  1647 leader_election.cc:343] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.091425  1843 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:17.092770  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.092530  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:17.094419  1649 leader_election.cc:343] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:17.095160  1647 leader_election.cc:343] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.095592  1647 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.099392  2057 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:17.101234  2050 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:17.105367  1723 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.106148  1723 ts_tablet_manager.cc:1403] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 12:57:17.108458  1725 tablet_bootstrap.cc:492] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.112720  1534 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:17.109054  1723 raft_consensus.cc:359] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.114068  1723 raft_consensus.cc:385] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.114514  1996 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.113972  1649 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.116796  1723 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.116290  1724 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:17.117749  1724 ts_tablet_manager.cc:1403] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.003s
I20260709 12:57:17.118405  2050 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:17.119987  2050 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:17.119951  1723 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.109218  1725 ts_tablet_manager.cc:1403] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.110s	user 0.032s	sys 0.016s
I20260709 12:57:17.121251  2050 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.122409  1723 ts_tablet_manager.cc:1434] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:57:17.123407  1723 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.126372  1724 raft_consensus.cc:359] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.126521  1725 raft_consensus.cc:359] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.127202  1725 raft_consensus.cc:385] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.127161  1724 raft_consensus.cc:385] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.127673  1724 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.127635  1725 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.130638  1724 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.131484  1725 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.133108  1724 ts_tablet_manager.cc:1434] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 12:57:17.133116  1996 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.133759  1996 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.134269  1724 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:17.137255  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.138059  1534 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:17.138670  1996 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.142714  1725 ts_tablet_manager.cc:1434] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:57:17.143862  1725 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.146262  1604 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.152442  1724 tablet_bootstrap.cc:654] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.155066  1723 tablet_bootstrap.cc:654] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.160115  1996 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.160764  1996 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.164072  1996 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.168308  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.168980  1534 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:17.173971  1724 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:17.174571  1724 ts_tablet_manager.cc:1403] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.007s
I20260709 12:57:17.173873  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:17.177349  2029 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.177305  1724 raft_consensus.cc:359] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.178158  1724 raft_consensus.cc:385] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.178028  2029 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.178635  2029 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.182682  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.183236  1725 tablet_bootstrap.cc:654] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:17.184478  1572 leader_election.cc:343] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.187767  2029 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.191686  1723 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.192160  1723 ts_tablet_manager.cc:1403] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.001s
I20260709 12:57:17.194856  1723 raft_consensus.cc:359] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.196597  2029 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.195482  1723 raft_consensus.cc:385] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.197181  1723 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.197866  1723 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.199003  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.199884  1723 ts_tablet_manager.cc:1434] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:17.200507  1724 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.201161  1724 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.203145  1724 ts_tablet_manager.cc:1434] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:57:17.203307  1725 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.203722  1725 ts_tablet_manager.cc:1403] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.002s
I20260709 12:57:17.204039  1724 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Bootstrap starting.
I20260709 12:57:17.210109  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:17.210744  1530 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.215611  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:17.218619  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:17.222412  1677 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:17.223462  1572 leader_election.cc:343] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.224319  1944 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:17.226604  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:17.228467  1723 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.231343  1530 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:17.234665  2066 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.238756  1429 catalog_manager.cc:5697] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:17.240361  1944 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:17.243712  1680 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.244135  1723 tablet_bootstrap.cc:654] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.246883  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:17.257038  1724 tablet_bootstrap.cc:654] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.259545  2066 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:17.271044  2066 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.271781  1725 raft_consensus.cc:359] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.272423  2029 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:17.272917  2029 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:17.273774  2029 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.283643  1869 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:17.286789  1723 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.287323  1723 ts_tablet_manager.cc:1403] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.016s
I20260709 12:57:17.290608  1723 raft_consensus.cc:359] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.291373  1723 raft_consensus.cc:385] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.291698  1723 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.293046  1723 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.297561  1723 ts_tablet_manager.cc:1434] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:57:17.298825  1723 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.272471  1725 raft_consensus.cc:385] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.307482  1725 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.309592  1725 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.315778  1725 ts_tablet_manager.cc:1434] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.001s
I20260709 12:57:17.316722  1725 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.319679  1724 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: No bootstrap required, opened a new log
I20260709 12:57:17.320122  1724 ts_tablet_manager.cc:1403] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.002s
I20260709 12:57:17.322682  1724 raft_consensus.cc:359] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.323361  1724 raft_consensus.cc:385] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.323658  1724 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.324260  1724 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.325544  1725 tablet_bootstrap.cc:654] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.341907  1843 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.325387  1429 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:17.334652  1869 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.343204  1869 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.337760  1678 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:17.331233  1724 ts_tablet_manager.cc:1434] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:57:17.343930  1678 pending_rounds.cc:85] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 1
I20260709 12:57:17.344326  1678 pending_rounds.cc:107] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:17.344653  1678 raft_consensus.cc:2889] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:17.345132  1869 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.347322  2009 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:17.356691  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:17.358560  1725 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.359041  1725 ts_tablet_manager.cc:1403] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
W20260709 12:57:17.359840  1498 leader_election.cc:343] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.360453  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.361626  1725 raft_consensus.cc:359] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.362257  1725 raft_consensus.cc:385] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.362519  1725 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.363137  1725 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.364979  2072 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.365187  1725 ts_tablet_manager.cc:1434] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:57:17.365455  2072 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.367435  2072 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.371131  1723 tablet_bootstrap.cc:654] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:17.373396  1497 leader_election.cc:343] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.374872  1497 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.378415  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.378742  1534 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:17.380170  2066 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:17.384078  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:17.385706  1498 leader_election.cc:343] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.387995  2009 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.389732  2051 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.394940  1725 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.401275  1725 tablet_bootstrap.cc:654] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.414907  1843 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.415405  1843 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.419004  1725 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.419402  1723 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.419467  1725 ts_tablet_manager.cc:1403] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 12:57:17.421100  1843 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:17.424681  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:17.419898  1723 ts_tablet_manager.cc:1403] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.010s
I20260709 12:57:17.427665  2066 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.428438  2066 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:17.429474  1647 leader_election.cc:343] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.430799  2066 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.432514  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:17.427608  1723 raft_consensus.cc:359] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.433748  1723 raft_consensus.cc:385] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.432320  1725 raft_consensus.cc:359] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.434103  1725 raft_consensus.cc:385] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:57:17.434145  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 55060.5us
I20260709 12:57:17.434470  1725 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
W20260709 12:57:17.435151  1498 leader_election.cc:343] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.436204  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.437215  1679 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:17.440356  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.440994  1531 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
W20260709 12:57:17.441449  1497 leader_election.cc:343] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.441885  1497 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.435148  1725 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.442554  2072 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:17.443986  1725 ts_tablet_manager.cc:1434] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
I20260709 12:57:17.443864  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.445007  1725 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.445097  2072 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.445459  2072 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.445811  2072 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.452505  1725 tablet_bootstrap.cc:654] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.453647  2072 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.455603  2072 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.461064  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.461237  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:17.435215  1723 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.462364  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:17.462534  1723 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.463209  1679 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:17.462600  1498 leader_election.cc:343] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.471597  1723 ts_tablet_manager.cc:1434] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.046s	user 0.001s	sys 0.005s
I20260709 12:57:17.472539  1723 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.484031  1725 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.484549  1725 ts_tablet_manager.cc:1403] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.023s
I20260709 12:57:17.486797  1723 tablet_bootstrap.cc:654] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.488195  1725 raft_consensus.cc:359] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.488883  1725 raft_consensus.cc:385] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.489147  1725 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.489776  1725 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.490798  1679 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:17.491508  2051 raft_consensus.cc:2764] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:57:17.491755  1725 ts_tablet_manager.cc:1434] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:57:17.493139  1725 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.494915  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.496660  2009 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.497278  2009 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.499140  1725 tablet_bootstrap.cc:654] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.500357  2117 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:17.501241  2117 raft_consensus.cc:697] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:17.502343  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.502182  2117 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.502974  1531 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:17.505077  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:17.506093  2110 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.506546  2110 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.506961  2110 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.507722  2009 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.509943  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.511049  1679 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:17.512049  1725 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.512486  1725 ts_tablet_manager.cc:1403] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 12:57:17.518963  1725 raft_consensus.cc:359] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.519644  1725 raft_consensus.cc:385] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.519899  1725 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.520594  1725 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.518090  2110 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.524721  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:17.524952  2110 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.525267  1531 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.526587  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:17.527140  1679 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.530110  1725 ts_tablet_manager.cc:1434] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 12:57:17.531181  1725 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.525791  1428 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:17.531463  1531 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:17.533896  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:17.534235  1679 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:17.535187  2110 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:17.536182  2110 raft_consensus.cc:697] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:17.537022  2110 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.540055  1723 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.540510  1723 ts_tablet_manager.cc:1403] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.027s
I20260709 12:57:17.543135  1723 raft_consensus.cc:359] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.543771  1723 raft_consensus.cc:385] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.544037  1723 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.544737  1723 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.545264  1725 tablet_bootstrap.cc:654] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.551795  1725 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.552237  1725 ts_tablet_manager.cc:1403] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 12:57:17.554634  1723 ts_tablet_manager.cc:1434] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:57:17.554816  1725 raft_consensus.cc:359] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.555498  1725 raft_consensus.cc:385] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.555595  1723 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.555769  1725 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.556430  1725 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.558491  1725 ts_tablet_manager.cc:1434] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:57:17.559373  1725 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.562548  1723 tablet_bootstrap.cc:654] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.565356  1725 tablet_bootstrap.cc:654] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.571774  1723 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.572887  1723 ts_tablet_manager.cc:1403] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.008s
I20260709 12:57:17.572914  1725 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.573671  1725 ts_tablet_manager.cc:1403] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 12:57:17.576252  1723 raft_consensus.cc:359] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.577857  1723 raft_consensus.cc:385] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.578154  1723 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.577724  1725 raft_consensus.cc:359] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.578594  1725 raft_consensus.cc:385] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.579047  1725 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.578800  1723 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.579769  1725 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.581432  1725 ts_tablet_manager.cc:1434] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:17.582345  1725 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.583112  1428 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:17.582028  2051 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.589097  1725 tablet_bootstrap.cc:654] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.594463  1723 ts_tablet_manager.cc:1434] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.005s
I20260709 12:57:17.595789  1723 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.606482  1723 tablet_bootstrap.cc:654] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.617869  2072 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.618417  2072 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.620416  2072 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.628187  1996 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.628736  1996 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.629375  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.630028  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:17.630954  1497 leader_election.cc:343] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.630862  1609 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:17.631208  1996 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.632159  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.637017  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.637241  1498 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:17.639443  2117 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.639827  2117 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.640158  2117 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.641801  1996 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.642413  1996 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.645605  1575 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:17.646426  2009 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:17.647600  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.648355  1679 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:17.651844  1572 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:17.653460  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.653911  2110 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.654177  1533 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:17.654208  1723 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.654316  2110 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.655041  2110 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.655155  1723 ts_tablet_manager.cc:1403] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.019s
I20260709 12:57:17.658802  1723 raft_consensus.cc:359] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.659677  1723 raft_consensus.cc:385] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.660000  1723 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.660847  1723 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.662844  1723 ts_tablet_manager.cc:1434] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:17.664268  1996 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.666505  1723 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.673796  2117 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.680076  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:17.680900  1607 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.681861  2117 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.676808  2110 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.683202  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:57:17.691416  1497 leader_election.cc:343] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:17.693451  1723 tablet_bootstrap.cc:654] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.696363  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:17.697052  1679 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.698920  1607 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:17.701208  1609 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.702739  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:17.706274  1533 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.694653  2110 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.712514  1533 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:17.713663  2057 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:17.715236  1498 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:17.715986  2072 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:17.716440  2072 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:17.717216  2072 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.717927  1575 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:17.720170  1996 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:17.722903  1996 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:17.723973  1996 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.720441  1679 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:17.730476  1725 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.732710  1725 ts_tablet_manager.cc:1403] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.151s	user 0.062s	sys 0.038s
I20260709 12:57:17.736392  1725 raft_consensus.cc:359] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.737118  1725 raft_consensus.cc:385] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.737449  1725 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.738137  1725 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.740229  1725 ts_tablet_manager.cc:1434] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:57:17.744890  1725 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.752439  1725 tablet_bootstrap.cc:654] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.754860  2009 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:17.756129  1723 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.756626  1723 ts_tablet_manager.cc:1403] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.004s
I20260709 12:57:17.763420  2050 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.764166  2050 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.772837  2050 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:17.772696  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.768069  1723 raft_consensus.cc:359] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.774080  1723 raft_consensus.cc:385] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.774369  1723 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.774272  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:17.775038  1723 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.776575  1647 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:17.781626  1723 ts_tablet_manager.cc:1434] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 12:57:17.781725  2057 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:17.782586  1723 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.788638  1431 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:17.790663  1678 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.792999  1723 tablet_bootstrap.cc:654] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.798293  1725 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:17.798756  1725 ts_tablet_manager.cc:1403] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.019s
I20260709 12:57:17.801545  2009 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:17.802146  1725 raft_consensus.cc:359] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.805740  1725 raft_consensus.cc:385] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.806007  1725 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.806592  1725 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.813086  1996 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.823824  1996 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.825865  1725 ts_tablet_manager.cc:1434] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:57:17.830390  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.831172  1531 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:17.831561  1431 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:17.834908  1725 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Bootstrap starting.
I20260709 12:57:17.834887  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:17.838393  2009 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.838747  2009 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.839038  2009 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.841331  1996 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.843048  1723 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:17.843498  1723 ts_tablet_manager.cc:1403] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.011s
I20260709 12:57:17.847563  1725 tablet_bootstrap.cc:654] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:17.850548  1843 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.851017  1843 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.851228  1723 raft_consensus.cc:359] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.853724  1723 raft_consensus.cc:385] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:17.854871  1723 raft_consensus.cc:740] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:17.855370  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.855860  1533 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:17.856681  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:17.858700  1843 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:17.852598  2050 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.858476  2057 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.852449  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:17.860605  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:17.866271  1679 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:17.866655  1607 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:17.862985  2057 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.867823  2057 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.869827  1723 consensus_queue.cc:260] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.865222  2050 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.890179  1723 ts_tablet_manager.cc:1434] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:57:17.904902  2050 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:17.908574  2009 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.911567  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:17.912392  1606 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:17.912449  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:17.913513  1533 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:17.914618  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:17.916643  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:17.916954  1723 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:17.917196  1533 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.932802  1606 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.935483  1533 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:17.941049  1843 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.941756  1843 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:17.921746  2051 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:17.945762  2051 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.946218  2051 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:17.955835  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:17.986593  2009 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:17.985478  2110 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:18.042580  1944 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.148789  1944 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:18.151803  1944 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:18.060456  2110 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:18.157784  2110 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:18.158352  2051 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:18.160451  2051 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:57:18.514655  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.015s	sys 0.018s
W20260709 12:57:18.525910  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.015s	sys 0.018s
I20260709 12:57:18.031888  2057 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:18.858773  2057 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:57:19.254495  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.304s	user 0.004s	sys 0.038s
W20260709 12:57:19.254957  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.004s	sys 0.038s
W20260709 12:57:19.255314  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 1.3054e+06us
I20260709 12:57:19.268270  1843 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.274295  1843 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:19.274911  1843 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:19.276199  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.296s	user 0.042s	sys 0.065s
W20260709 12:57:19.276602  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.042s	sys 0.065s
W20260709 12:57:19.276885  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 1.32105e+06us
I20260709 12:57:19.277246  1843 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.282508  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 209) took 1355 ms. Trace:
I20260709 12:57:19.283043  1609 rpcz_store.cc:276] 0709 12:57:17.927372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.932358 (+  4986us) service_pool.cc:224] Handling call
0709 12:57:19.281877 (+1349519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:19.282100 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:19.282136 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:19.282183 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:19.282223 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:19.282295 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:19.282422 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:19.292913  1723 tablet_bootstrap.cc:654] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:19.295886  1843 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:19.302044  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 230) took 1345 ms. Trace:
W20260709 12:57:19.270839  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.274s	user 0.024s	sys 0.024s
I20260709 12:57:19.296591  1843 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:19.305619  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.024s	sys 0.025s
W20260709 12:57:19.309077  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.015s
W20260709 12:57:19.309128  2110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.005s	sys 0.011s
W20260709 12:57:19.326398  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.013s	sys 0.013s
I20260709 12:57:19.328269  1843 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.347714  2141 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:19.348299  2141 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.348986  2143 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:19.349658  2143 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.350540  2141 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.352272  2143 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.315138  2050 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:19.353454  2050 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:19.320546  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.000s	sys 0.016s
W20260709 12:57:19.325634  2110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.005s	sys 0.011s
I20260709 12:57:19.302573  1680 rpcz_store.cc:276] 0709 12:57:17.956369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.270441 (+1314072us) service_pool.cc:224] Handling call
0709 12:57:19.299922 (+ 29481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:19.301537 (+  1615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:19.301627 (+    90us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:19.301671 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:19.301710 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:19.301780 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:19.301970 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:19.318807  2144 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:19.359347  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.013s	sys 0.013s
I20260709 12:57:19.347767  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 229) took 1412 ms. Trace:
I20260709 12:57:19.452497  1843 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:19.453212  1843 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:19.359690  1996 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:19.543413  1843 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.558449  1725 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: No bootstrap required, opened a new log
I20260709 12:57:19.575624  1725 ts_tablet_manager.cc:1403] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Time spent bootstrapping tablet: real 1.741s	user 0.013s	sys 0.016s
I20260709 12:57:19.363175  2144 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.590123  2050 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.577538  2153 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.571208  2152 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.586766  1944 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:19.547322  1996 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.605528  2146 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:19.606254  2146 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.607874  2159 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:19.608911  2146 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.608659  2159 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.610898  1944 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.613222  1944 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:19.423729  1679 rpcz_store.cc:276] 0709 12:57:17.912860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.916443 (+  3583us) service_pool.cc:224] Handling call
0709 12:57:19.305321 (+1388878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:19.315047 (+  9726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:19.315999 (+   952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:19.318368 (+  2369us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:19.318417 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:19.318498 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:19.325188 (+  6690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:19.604307  2145 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:19.618422  2050 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:19.621757  1944 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:19.723415  2145 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.725013  2050 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.654476  2144 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:19.602563  2153 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.614609  2152 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.730203  1996 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.274955  1996 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.275679  1996 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.312601  2160 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.314419  2163 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:19.810406  2057 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.319900  2057 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.322871  2057 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:19.873692  2155 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.313526  2160 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.876364  2050 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.315196  2163 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:19.827845  2156 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.850015  2157 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.326798  2164 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:57:20.238173  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.020s	sys 0.010s
I20260709 12:57:19.653985  2162 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.372854  2166 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:19.804909  2146 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:19.822228  2165 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.025071  2158 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:19.792661  2147 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.602s
I20260709 12:57:19.727603  1944 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.378515  2155 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.353269  1725 raft_consensus.cc:359] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.412953  1944 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.413264  1725 raft_consensus.cc:385] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:20.413542  1725 raft_consensus.cc:740] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Initialized, Role: FOLLOWER
I20260709 12:57:20.414242  1725 consensus_queue.cc:260] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.381250  2156 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.416761  1725 ts_tablet_manager.cc:1434] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Time spent starting tablet: real 0.841s	user 0.014s	sys 0.014s
W20260709 12:57:20.417179  1725 ts_tablet_manager.cc:1467] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Tablet startup took 841ms
I20260709 12:57:20.414479  2155 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.381768  2160 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.572844  2160 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.573444  2160 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.382239  1996 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:20.382802  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.022s	sys 0.011s
I20260709 12:57:20.383292  2162 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.383467  2164 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.584388  2164 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.383774  2166 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.587575  2166 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.383994  2146 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.590921  1996 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.591573  1996 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:20.594674  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.001s	sys 0.006s
W20260709 12:57:20.595211  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.001s	sys 0.006s
I20260709 12:57:20.595335  2146 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.581375  2162 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.596474  2162 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.597054  2162 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.599491  2162 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.408072  2153 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.377548  2169 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.409946  2152 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.385663  2165 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.446614  2161 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.602344  2169 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.603063  2161 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.604537  2169 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.604660  2165 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.601608  2160 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.605270  2161 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.450721  2144 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.607025  2144 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.381584  2157 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.609033  2144 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.458626  2177 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.609851  2157 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.609710  2177 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.418329  2156 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.385198  2163 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.386097  2158 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.611845  2177 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.601310  2162 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.606066  1996 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.464648  1944 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.612828  2162 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.612964  1944 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.614787  1944 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:20.441953  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.005s	sys 0.001s
W20260709 12:57:20.617578  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.005s	sys 0.001s
I20260709 12:57:20.617014  2158 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.620182  2147 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.628790  2147 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.633738  2147 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:20.601282  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.683s (SENT) [suppressed 2 similar messages]
I20260709 12:57:20.614805  2162 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.725972  2162 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.726788  2162 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.730072  2162 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.730816  2162 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.731446  2162 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.733951  2162 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:20.734508  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.014s	sys 0.018s
W20260709 12:57:20.796502  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.015s	sys 0.018s
W20260709 12:57:20.741257  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 140000us
I20260709 12:57:20.748464  1996 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.797621  1996 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.798666  2186 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.799166  2186 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.799760  1996 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.749195  1944 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.800415  1944 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.774816  2147 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.793552  2175 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.803865  2185 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.803710  2175 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.805311  2185 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:20.417544  1725 ts_tablet_manager.cc:1469] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Trace:
0709 12:57:09.752330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.361196 (+608866us) service_pool.cc:224] Handling call
0709 12:57:10.415972 (+ 54776us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:10.416069 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:10.547751 (+131682us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:10.635627 (+ 87876us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:10.659425 (+ 23798us) inbound_call.cc:177] Queueing success response
0709 12:57:17.826763 (+7167338us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:57:19.576047 (+1749284us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:57:19.727214 (+151167us) tablet_replica.cc:261] Starting instrumentation
0709 12:57:19.728582 (+  1368us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":27876,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"tablet-open.queue_time_us":7167409}
I20260709 12:57:20.802639  1944 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.794224  2182 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.806833  2182 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.808434  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 235) took 2868 ms. Trace:
I20260709 12:57:20.808724  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:20.809434  1609 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:20.809477  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:20.810081  1606 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:20.815865  1606 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:20.815886  1609 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:20.818317  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:20.819017  1606 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:20.820237  2175 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.820616  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:20.842551  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:20.845091  1606 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
W20260709 12:57:20.845273  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.004s	sys 0.003s
W20260709 12:57:20.845943  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.004s	sys 0.003s
W20260709 12:57:20.846231  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.017s	sys 0.055s
W20260709 12:57:20.846570  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.017s	sys 0.056s
I20260709 12:57:20.847045  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:20.847218  2162 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:57:20.847223  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.007s	sys 0.003s
I20260709 12:57:20.847497  1944 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:57:20.843621  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.008s	sys 0.004s
I20260709 12:57:20.847862  2162 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.848657  2163 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.848963  1606 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:20.801371  2186 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:20.850661  1723 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.003s	sys 0.024s
W20260709 12:57:20.854853  1723 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.003s	sys 0.024s
I20260709 12:57:20.842669  2188 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.850394  1996 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:57:20.851413  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.008s	sys 0.004s
I20260709 12:57:20.851800  2051 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.827137  2147 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.808995  1533 rpcz_store.cc:276] 0709 12:57:17.939873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.807558 (+2867685us) service_pool.cc:224] Handling call
0709 12:57:20.807859 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:20.808040 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:20.808077 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:20.808130 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:20.808173 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:20.808242 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:20.808369 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:20.851110  2158 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.859668  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:20.852072  1944 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.856383  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:20.860219  2182 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.854960  2163 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.856837  1996 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:20.854357  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.007s	sys 0.004s
I20260709 12:57:20.856340  2181 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.877763  2185 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.881651  2163 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.867020  1679 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:20.870549  2157 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.871313  1944 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.862643  2051 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.878805  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:20.875506  2165 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.856429  2188 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.946203  1723 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:20.946902  1723 ts_tablet_manager.cc:1403] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 3.030s	user 0.051s	sys 0.079s
I20260709 12:57:20.865777  2158 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.914582  2173 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.878219  2181 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.916232  2176 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.917795  2185 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.919364  2162 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.919930  2184 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.883083  2169 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:57:20.917546  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.918s	user 0.043s	sys 0.026s
I20260709 12:57:20.889799  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:20.926115  2155 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.968542  1723 raft_consensus.cc:359] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.970952  1723 raft_consensus.cc:385] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:20.929056  1677 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:20.929374  2166 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.921485  2167 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.932263  2051 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:20.934978  2147 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:20.898528  2153 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.897476  2180 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.954236  2187 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.922250  2157 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.948931  2165 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.925014  2175 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.928104  2174 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:57:20.968087  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.968s	user 0.045s	sys 0.026s
I20260709 12:57:20.928812  2146 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.948499  2186 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.972064  1723 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:21.003597  1723 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.975597  2166 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.969094  2173 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.967693  2179 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:20.972702  2176 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:21.002074  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48604.8us
I20260709 12:57:20.980244  2051 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:21.015592  2189 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.015479  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:20.986974  2147 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:20.972232  2169 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.971180  2185 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.973714  2155 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.016330  2189 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.986671  2153 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:20.976749  2167 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.046407  1723 ts_tablet_manager.cc:1434] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 12:57:20.994964  2175 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.010687  2146 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.009692  2186 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.023448  2051 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.033254  2147 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.049754  2191 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:20.980350  2184 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:21.060180  2159 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.080265  2190 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.064937  2154 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:21.004381  2174 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.007519  2187 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.002568  2180 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.017143  2179 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.120841  2147 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.080968  2190 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.082832  2191 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.159169  2154 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.122157  2194 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.229444  2146 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.121845  2175 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.121825  2184 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.122613  2188 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.205469  2187 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.177810  2196 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.122346  2158 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.160153  2197 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.160697  2181 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.217634  2165 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.229110  2194 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.160524  2157 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.221129  2195 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.220140  2147 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.242252  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.242951  1533 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:21.243301  2186 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.242304  2195 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.237085  2155 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.234639  2175 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.239246  2185 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.251444  2190 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.252991  2189 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.253480  2167 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.254019  2174 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.248396  2186 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.254760  2186 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.257544  2198 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.257891  2186 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.247937  2166 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.260782  2195 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.241123  2197 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.264482  2191 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.264796  2180 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.265027  2185 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.265554  2185 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.244066  2147 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.251991  2175 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.268066  2187 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.271109  1677 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.270864  2187 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.265936  2201 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.269518  2199 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.275357  2189 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.241420  2196 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.275353  2194 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.258692  2198 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.278784  2191 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.278510  2189 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.281791  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:21.280874  2191 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.279105  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.286877  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:21.287484  1534 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:21.285835  1527 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:21.286706  2189 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.272782  2201 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.289188  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.292158  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.293783  2179 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:21.291345  2194 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.295680  2200 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.278545  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.292308  2189 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.278666  2199 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.294128  1530 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.297178  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.299616  2190 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:21.298491  2200 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.301187  1525 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:21.301481  2190 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.303529  2189 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.309508  1528 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.311532  1534 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:21.306847  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.315814  1530 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.317687  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.318331  1530 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.316545  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.312358  2184 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:21.299562  2194 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.323581  2184 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.325623  2202 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.326790  1527 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:21.330659  2200 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.332664  2201 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.330617  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.330201  2202 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:21.335286  1527 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.336359  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.336706  2202 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.334751  2184 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:21.337015  1527 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.338027  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.338604  1527 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.339850  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.339679  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.340939  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.341555  1527 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:21.341403  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.342806  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.343916  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.344519  1529 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.345386  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.345984  1529 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.346813  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.347766  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.349218  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.350483  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.351193  1527 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.352191  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.352839  1527 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:21.354167  1529 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:22.024012  2154 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.033988  2153 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.039531  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.041534  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.041720  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.042861  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.043696  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.043955  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.047797  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.048570  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.048684  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 226) took 1074 ms. Trace:
I20260709 12:57:22.050308  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.049147  1604 rpcz_store.cc:276] 0709 12:57:20.974668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.975237 (+   569us) service_pool.cc:224] Handling call
0709 12:57:22.047638 (+1072401us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b58000dfe98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:57:22.048597 (+   959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6960000}
I20260709 12:57:22.056397  2176 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.057365  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.058300  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.059022  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.062242  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.060659  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.063031  2009 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:57:22.061059  1649 connection.cc:256] RPC call timeout handler was delayed by -1.2342121339999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 12:57:22.062296  2198 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.059907  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.064347  2009 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.060665  1531 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.065202  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.063102  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:21.054117  1996 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.065881  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.066864  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.071446  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.067425  1529 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.070251  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.070542  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.072989  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.073763  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:57:22.074105  1679 consensus_meta.cc:287] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.162s	user 0.012s	sys 0.012s
I20260709 12:57:22.074160  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.074429  2173 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.074699  1679 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:22.074954  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.075536  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 231) took 1223 ms. Trace:
I20260709 12:57:22.076166  1679 rpcz_store.cc:276] 0709 12:57:20.852386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.853479 (+  1093us) service_pool.cc:224] Handling call
0709 12:57:22.075443 (+1221964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:22.075574  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.076110  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.064765  1533 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:22.070501  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.078850  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.077831  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.079759  2169 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.078877  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.078055  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.079967  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.077535  2009 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.080092  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.082309  1529 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.082799  2051 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.080050  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.084491  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.087397  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.088579  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.088696  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.089545  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.090071  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.090713  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.091272  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.091890  1674 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.091918  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.092268  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.093000  1680 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.092860  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.093161  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.093966  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.091946  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 239) took 1204 ms. Trace:
I20260709 12:57:22.094903  1679 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.094806  1683 rpcz_store.cc:276] 0709 12:57:20.888132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.889532 (+  1400us) service_pool.cc:224] Handling call
0709 12:57:20.894314 (+  4782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:21.015562 (+121248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.091726 (+1076164us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001f7f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:57:22.091892 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268644736}
I20260709 12:57:22.095402  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.096092  1677 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.094102  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.097513  2191 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.099550  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.100235  1683 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.093901  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.109680  2191 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:22.112434  2199 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.114535  1497 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.114580  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 246) took 1175 ms. Trace:
I20260709 12:57:22.115219  2191 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.115720  2191 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.115857  1497 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.115101  1682 rpcz_store.cc:276] 0709 12:57:20.939020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.939159 (+   139us) service_pool.cc:224] Handling call
0709 12:57:20.939564 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:22.113771 (+1174207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:22.113795 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:22.113831 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:22.113853 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.114385 (+   532us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002800d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:57:22.114418 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.114530 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699934080}
I20260709 12:57:22.116286  2191 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.116711  2199 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.116871  2190 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.117177  2199 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.117694  2199 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:22.120781  1572 connection.cc:256] RPC call timeout handler was delayed by -1.0819567140000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 12:57:22.123826  2191 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.125294  2199 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.126062  2191 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.127456  2199 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.127765  2196 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.128111  2189 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.129166  2140 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:22.132753  1572 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:22.133352  2140 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.133843  2140 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.134236  2140 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.134861  1497 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.135486  2198 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.135847  2198 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.135768  2009 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:22.136282  2198 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:22.139421  1497 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:22.141809  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.141781  2140 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.143059  2189 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.143489  2189 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.143424  2198 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.143921  2189 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.145125  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 225) took 1188 ms. Trace:
I20260709 12:57:22.145643  2198 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.145685  1607 rpcz_store.cc:276] 0709 12:57:20.957106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.967354 (+ 10248us) service_pool.cc:224] Handling call
0709 12:57:22.144320 (+1176966us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b58000dfe98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:57:22.144577 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:22.144754 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:22.144785 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:22.144841 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:22.144878 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.144945 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.145066 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10758016}
I20260709 12:57:22.145072  2140 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.149711  2189 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.151366  2189 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.151819  2147 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.153422  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.153648  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.154331  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.155148  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 248) took 1212 ms. Trace:
I20260709 12:57:22.155455  1676 rpcz_store.cc:276] 0709 12:57:20.942437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.942575 (+   138us) service_pool.cc:224] Handling call
0709 12:57:22.155100 (+1212525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:22.159706  2197 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.161347  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.163640  2197 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.163699  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 224) took 1217 ms. Trace:
I20260709 12:57:22.164510  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.164242  2197 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.165427  2175 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.166532  2194 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.166806  2197 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.167536  2176 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:22.167948  2176 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.168326  2176 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.164817  1605 rpcz_store.cc:276] 0709 12:57:20.946515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.948250 (+  1735us) service_pool.cc:224] Handling call
0709 12:57:22.162976 (+1214726us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b58000dfe98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:57:22.163143 (+   167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:22.163335 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:22.163366 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:22.163412 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:22.163449 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.163515 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.163644 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6472960}
W20260709 12:57:22.176146  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08001188c0 after lost signal to thread 434
I20260709 12:57:22.176504  2187 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.177959  2145 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.176610  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.179318  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.180138  2193 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:22.180665  2193 raft_consensus.cc:697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:22.180811  2141 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:22.181362  2141 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:22.181654  2193 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.182639  2141 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.185417  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.186751  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.187572  1603 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.176132  2176 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.193712  1649 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.195703  2143 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.196249  2143 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.196666  1649 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.196795  2143 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.197623  2141 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.198063  2141 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.197991  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.198558  2141 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.198886  2164 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:22.199308  2164 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.199697  2164 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.202630  2185 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.203042  2176 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.204501  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.205497  1607 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.208446  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.210356  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.211038  1603 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 0.
I20260709 12:57:22.211647  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 244) took 1275 ms. Trace:
I20260709 12:57:22.212106  1681 rpcz_store.cc:276] 0709 12:57:20.936068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.936224 (+   156us) service_pool.cc:224] Handling call
0709 12:57:20.936625 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:21.927288 (+990663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.927316 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:21.927356 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:21.927386 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.211393 (+284007us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b540045bad4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:57:22.211447 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.211585 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277680512}
I20260709 12:57:22.212886  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.213943  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.214934  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.218600  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.217793  2145 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.220036  2145 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:22.221982  1647 connection.cc:256] RPC call timeout handler was delayed by -1.1024997819999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 12:57:22.222263  2145 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.223910  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.227880  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.228467  1606 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.229652  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.230319  1605 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.230711  2164 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.231436  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.232168  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 238) took 1347 ms. Trace:
I20260709 12:57:22.232905  2164 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.232606  1678 rpcz_store.cc:276] 0709 12:57:20.885186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.886024 (+   838us) service_pool.cc:224] Handling call
0709 12:57:20.914511 (+ 28487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:22.030971 (+1116460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:22.031009 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:22.031057 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:22.031104 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.231920 (+200816us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540015ed54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:57:22.231982 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.232108 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566841728}
I20260709 12:57:22.234642  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.234800  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.235407  1603 raft_consensus.cc:2376] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1. Re-sending same reply.
I20260709 12:57:22.235759  1843 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.236167  1843 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.236516  1843 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.239313  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.239786  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.245792  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.246699  1528 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 2: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:22.249271  1843 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.250576  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 94) took 4344 ms. Trace:
I20260709 12:57:22.251787  1843 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.250960  1429 rpcz_store.cc:276] 0709 12:57:17.906258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.914171 (+  7913us) service_pool.cc:224] Handling call
0709 12:57:22.250099 (+4335928us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:57:22.258170  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:22.259506  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08001ddfa0 after lost signal to thread 1466
I20260709 12:57:22.260227  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:22.260756  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002949a0 after lost signal to thread 1558
W20260709 12:57:22.261054  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6c40 after lost signal to thread 1559
W20260709 12:57:22.262709  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080029d160 after lost signal to thread 1633
W20260709 12:57:22.263018  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080029d100 after lost signal to thread 1634
I20260709 12:57:22.266036  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.266616  1723 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Bootstrap starting.
I20260709 12:57:22.266701  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.267133  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:22.267467  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002d63a0 after lost signal to thread 1707
I20260709 12:57:22.266851  1683 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 0.
I20260709 12:57:22.268242  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:22.268455  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.268939  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:22.269690  1683 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.269821  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.217203  2141 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:22.268255  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002d66a0 after lost signal to thread 2144
I20260709 12:57:22.275684  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.282032  1680 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.283607  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:22.284262  1678 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.284408  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:22.285091  1681 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.269716  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.266067  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.288484  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.295701  1608 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.295974  1604 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:22.299276  1677 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.299346  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.300604  2143 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.300750  1683 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:22.294338  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.304687  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.305024  2143 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.305629  1605 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:22.306149  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.307865  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.308496  1683 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.309388  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.301553  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.319320  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.321764  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.321988  1683 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.325431  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.326962  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.327031  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.329461  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.333683  1681 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:22.335558  2141 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.338135  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40874 (request call id 110) took 1160 ms. Trace:
I20260709 12:57:22.338498  1431 rpcz_store.cc:276] 0709 12:57:21.177511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.325153 (+147642us) service_pool.cc:224] Handling call
0709 12:57:22.338057 (+1012904us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":928414,"reported_tablets":9}
W20260709 12:57:22.339856  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:22.346074  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.346737  1607 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.354234  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.354528  1678 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:22.355010  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.355588  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.356232  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.356415  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.356858  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.353783  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.357834  1607 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.357820  2185 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.360167  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.363623  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.385874  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.384665  1604 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.360078  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.387481  1605 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.368331  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.361047  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.387423  2185 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.367457  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.394709  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.382898  1723 tablet_bootstrap.cc:654] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:22.386399  1608 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.390564  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.385313  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.398274  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.398360  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.401737  2185 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.404574  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.404852  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.405354  1602 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.407675  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.409313  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.409905  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.411161  1525 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.410584  1497 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.413154  1497 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.414341  1497 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.415901  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:22.418833  1575 connection.cc:256] RPC call timeout handler was delayed by -1.57498975499999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 12:57:22.420378  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.422082  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.420674  2189 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:22.417060  2187 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:22.423811  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.424245  2187 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.424590  2187 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.423132  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.424526  1683 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 0.
I20260709 12:57:22.405824  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.427024  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.427564  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.428118  1534 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.428200  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.428447  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.427970  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.427546  1647 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.425181  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.426709  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.432926  1843 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.433319  1843 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:22.433625  1843 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.434722  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.430498  2189 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:22.423739  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.438459  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:22.441068  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.439327  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.442368  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.425518  2175 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.443733  1497 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.436961  2189 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.450764  1647 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.450767  1843 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.451283  1534 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.438434  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.452243  1676 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.453271  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.453370  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.448180  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.456097  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.446043  2143 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.446401  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.444506  2175 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.454447  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.438768  2194 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:22.449621  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.458083  2143 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:22.466552  2143 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.467108  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.467424  1675 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.455281  2185 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:22.457255  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.469506  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.469729  2185 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:22.470439  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.470706  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:22.470579  2185 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.459815  2193 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.471854  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.461591  2194 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:22.458452  2175 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.459093  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.474622  1647 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.475370  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.474006  2187 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.480285  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.473801  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.481815  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.485529  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.486312  1681 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.487234  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.487902  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.459412  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.489243  1681 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:22.489847  1529 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 2: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:22.461195  1676 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.491225  1681 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:22.493660  2194 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.494446  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.494007  2187 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.495991  2176 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.499389  1680 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.501816  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.463245  1528 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.471884  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:22.507017  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.509739  1683 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.511996  2143 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.501156  1608 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.514353  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.506799  1677 raft_consensus.cc:2376] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1. Re-sending same reply.
I20260709 12:57:22.515728  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.516492  2141 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:22.516770  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.516963  2141 raft_consensus.cc:697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:22.517812  2141 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.519717  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:22.522244  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 83362.1us
I20260709 12:57:22.525415  1647 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.501446  2175 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.522064  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.528797  2193 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.529215  2193 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:22.529672  2193 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.530599  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.531436  1647 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.532707  1843 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.539578  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.528117  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:22.541608  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.543725  1607 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.543813  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.544571  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.544765  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.544607  1606 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.545989  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.545205  1607 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.542783  1572 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:22.595629  1606 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
W20260709 12:57:22.597354  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 52672.2us
I20260709 12:57:22.598271  1647 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.601801  2140 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:22.545327  2143 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.602264  2140 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.602686  2140 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.604689  2207 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:57:22.606594  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.606015  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:22.607156  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64411.1us
W20260709 12:57:22.608415  2208 log.cc:927] Time spent T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:57:22.610405  2166 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.594998  2176 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.618544  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.619652  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:22.620321  1675 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.605811  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.607839  1431 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:22.622987  1431 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:22.624698  1647 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.596395  2164 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:22.627451  1647 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.628364  1647 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.630952  1723 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: No bootstrap required, opened a new log
I20260709 12:57:22.631400  1723 ts_tablet_manager.cc:1403] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Time spent bootstrapping tablet: real 0.365s	user 0.010s	sys 0.009s
I20260709 12:57:22.631376  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:22.631913  1572 leader_election.cc:343] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:22.632911  2176 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.633080  2143 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.633330  2176 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:22.611662  1525 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:22.633806  2176 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.625173  2211 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:57:22.635109  1531 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.631376  1647 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.633661  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.638128  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.653259  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.639004  2169 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.657832  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.658663  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.650210  2207 consensus_queue.cc:1059] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:57:22.659328  1679 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:22.655970  1600 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.660130  2154 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.660550  2154 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:22.660970  2154 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.626672  1605 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:22.664503  1996 raft_consensus.cc:2764] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:57:22.663045  1647 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.667122  1843 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.667528  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.663196  1428 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:22.668694  1647 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:57:22.669497  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 71255.8us
I20260709 12:57:22.652608  2175 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.673035  1647 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.669131  1497 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.664417  2169 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:22.671244  2213 log.cc:927] Time spent T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:57:22.669641  2167 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.690232  1843 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.675377  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.669644  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.675047  2164 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.694998  1647 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.675010  2174 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.677793  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.693989  2175 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.697790  2169 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.698105  2164 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:22.735320  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.734897  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.737299  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:22.738591  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 63851.9us
I20260709 12:57:22.702775  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:22.739275  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 62896.7us
W20260709 12:57:22.739938  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 45038.9us
I20260709 12:57:22.740633  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:22.741966  2197 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.745325  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.707129  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.748240  1605 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:22.747885  2140 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.749193  1607 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:22.746567  1575 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.709758  2175 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.687935  2214 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:57:22.735436  2164 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.751199  2175 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.749289  2169 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.753189  1647 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.707686  2207 consensus_queue.cc:1059] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 12:57:22.745008  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.741377  2174 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.773726  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.754626  2197 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.776597  2176 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.777761  2145 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:22.777652  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.778185  2145 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:22.778652  2176 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:22.779007  2145 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.774389  2216 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.780270  2145 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.780972  2216 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.752236  2185 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.782317  2185 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.783802  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.755492  1723 raft_consensus.cc:359] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.757465  2167 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.785730  2167 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:22.786123  2167 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.787242  1723 raft_consensus.cc:385] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:22.787545  1723 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Initialized, Role: FOLLOWER
I20260709 12:57:22.800136  2140 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.800333  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.802387  1723 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.803134  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.798336  2194 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:22.804983  2194 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.773820  2211 raft_consensus.cc:3055] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:22.810318  2211 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:22.811452  2211 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.813038  2211 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.814369  1723 ts_tablet_manager.cc:1434] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Time spent starting tablet: real 0.182s	user 0.009s	sys 0.008s
I20260709 12:57:22.817788  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:22.819285  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:22.792465  2198 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:57:22.827324  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 51929.4us
W20260709 12:57:22.829680  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 83195us
I20260709 12:57:22.830997  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:22.831537  2198 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:22.835520  1680 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.838613  2198 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.840757  1575 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:22.843560  1575 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:22.845808  1681 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.846920  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.837451  2194 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.863816  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.828696  2143 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:22.866232  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:22.833325  2153 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:57:22.836257  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.850489  2207 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.874955  2207 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:22.875418  2207 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.876068  2221 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.876149  2197 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.881784  2221 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:22.873944  2143 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:22.882272  2221 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.833477  2140 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:57:22.865247  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.841952  2174 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
W20260709 12:57:22.930967  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 43932.4us
I20260709 12:57:22.864529  2194 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:57:22.867744  2224 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:22.938887  1996 consensus_queue.cc:1059] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:22.950145  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 100698us
I20260709 12:57:22.885908  2214 consensus_queue.cc:1059] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:57:22.943483  2009 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.851775  2218 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.103s
I20260709 12:57:22.977058  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:22.950883  2143 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:22.979377  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 113213us
I20260709 12:57:23.022902  1575 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.023989  1575 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.024946  1575 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:22.979666  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:22.951669  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:22.939642  2224 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:22.945413  2185 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:22.992240  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:57:23.026027  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 93295.9us
W20260709 12:57:23.030272  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 190253us
I20260709 12:57:23.030167  2214 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.034035  2214 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.034394  2214 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.030042  1605 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 1: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:23.030956  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:23.056730  2214 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.059937  1681 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:23.029901  2216 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.030189  2224 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.057543  2230 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.070379  1677 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:23.070520  2230 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.071166  2230 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.066946  2216 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:57:23.078408  2193 consensus_meta.cc:287] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.548s	user 0.026s	sys 0.033s
I20260709 12:57:23.082903  1498 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:57:23.081216  2223 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 12:57:23.092947  1498 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.074087  2164 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:23.090312  1528 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.584s	user 0.015s	sys 0.013s
I20260709 12:57:23.081591  2194 consensus_queue.cc:1059] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:57:23.097800  2228 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.101866  1674 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:23.102627  2226 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.105031  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:23.089387  2216 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.092149  2197 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:23.115851  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63590.4us
I20260709 12:57:23.092283  2193 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:23.118346  2141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.011s	sys 0.019s
I20260709 12:57:23.112120  2226 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:23.111078  1528 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:23.122520  1682 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:23.118852  2227 raft_consensus.cc:3055] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:23.125706  2141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.011s	sys 0.019s
W20260709 12:57:23.141201  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48370.3us
I20260709 12:57:23.141714  2179 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:23.118709  2154 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.142251  1498 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:57:23.148792  1675 consensus_meta.cc:287] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.528s	user 0.014s	sys 0.016s
I20260709 12:57:23.149194  1675 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:23.152894  1498 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.154253  2189 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.154376  2164 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:23.154387  1498 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.155306  2189 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:23.146870  2179 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.155319  2226 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.129812  2227 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:23.157347  2226 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.158124  1498 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.161094  2229 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.161919  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.162561  1679 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.166043  2227 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.167363  2227 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.168612  2187 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.168907  2009 raft_consensus.cc:3055] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.169164  2187 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:23.169414  2009 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:23.170377  2187 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.170756  2009 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.171988  2009 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.172075  2187 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.181432  1498 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.184504  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:23.190181  1497 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:23.193740  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:23.195781  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 170892us
I20260709 12:57:23.193701  1498 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.196656  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.165167  2207 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.197940  2211 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.198410  1996 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.198747  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.199209  1575 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.201108  1680 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:23.201479  1681 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:23.201385  1678 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:23.206146  1843 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:23.217195  1843 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.218747  1575 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.220376  1575 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.189093  2197 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.222893  1996 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:23.222324  1575 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.228646  1843 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:23.228900  1575 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.157987  2238 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.240862  2216 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.245908  2222 raft_consensus.cc:3055] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.246042  2216 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.246380  2222 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:23.247535  2222 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.248790  2222 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.245393  2217 raft_consensus.cc:3055] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.249963  2217 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:23.206200  2166 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:23.251046  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:23.190404  2189 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:57:23.221781  2214 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.273602  2239 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.231760  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:57:23.277752  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 87644.8us
W20260709 12:57:23.286077  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 92439us
I20260709 12:57:23.271283  1676 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 1: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:23.224953  2211 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.189517  2228 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:57:23.273146  2140 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:23.305145  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 76371.6us
I20260709 12:57:23.232851  2175 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.279143  2197 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:23.306434  1575 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.280488  2216 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.311806  2237 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.320632  2243 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.309383  2140 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.317279  2216 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.331773  2175 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.317850  2166 raft_consensus.cc:697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:23.327517  2140 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.319015  2221 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.347384  2221 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.348306  2230 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.329793  2193 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:23.336361  2154 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:23.333161  2216 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:23.345300  2167 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.559s	user 0.002s	sys 0.029s
I20260709 12:57:23.352635  2166 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.354529  2211 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.350638  2207 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.355427  2224 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.357550  2224 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:23.357771  2233 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 12:57:23.355720  2167 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.361451  2167 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:23.352025  2230 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.364823  2216 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.366955  2216 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.406358  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:57:23.408511  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 102050us
I20260709 12:57:23.411091  2216 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.417984  1683 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:23.418030  1605 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:57:23.419992  1605 pending_rounds.cc:85] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 0
I20260709 12:57:23.436833  1677 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:23.439828  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 142052us
I20260709 12:57:23.428432  1605 pending_rounds.cc:107] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:57:23.443070  1605 raft_consensus.cc:2889] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:23.449162  2197 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:57:23.454330  2244 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.172s	user 0.000s	sys 0.004s
I20260709 12:57:23.454205  2197 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.463403  2198 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.463967  2198 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:23.463851  1604 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:23.469074  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:23.471916  2198 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.473169  2179 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:23.478499  1498 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.481031  2217 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.486343  1575 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.482553  2175 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.487766  2222 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.488579  2222 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.489039  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.489225  2222 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.490980  1575 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.482618  2217 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.482555  1498 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.497958  1683 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:23.497187  2216 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.500454  2216 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.505223  2216 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.518474  2175 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:23.521910  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.522234  1498 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.525072  2256 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.531186  2140 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.532655  1498 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.533510  2256 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.534175  2256 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.545812  1679 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:23.546938  2175 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.547420  2147 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:23.518397  2198 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:23.551076  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 60376.3us
I20260709 12:57:23.556758  2258 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:23.558789  1674 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:23.564307  2175 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.564925  2175 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:57:23.568159  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:23.569142  2228 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.569169  2175 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.572373  2175 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.567991  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 115) took 1122 ms. Trace:
I20260709 12:57:23.568356  1429 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:23.548956  2140 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.576789  2228 consensus_queue.cc:1059] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:23.579221  2228 raft_consensus.cc:3055] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.576738  2257 consensus_queue.cc:1059] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:57:23.583170  2257 raft_consensus.cc:3055] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.583678  2257 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:23.574757  2222 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.579650  2228 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:23.588912  1674 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:23.590022  2216 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.590549  1679 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 12:57:23.594656  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 62380us
I20260709 12:57:23.595690  2222 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.597090  2258 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:23.598270  2258 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.598667  2258 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:23.604220  2228 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.604725  2258 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.605810  2228 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.606442  2258 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.584991  2257 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.620128  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:57:23.621632  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:23.621474  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.623636  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.625214  2147 consensus_queue.cc:1059] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:23.573379  1431 rpcz_store.cc:276] 0709 12:57:22.457652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:22.461661 (+  4009us) service_pool.cc:224] Handling call
0709 12:57:23.567745 (+1106084us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:22.761773 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:22.773722 (+ 11949us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:22.773757 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:57:22.773773 (+    16us) tablet.cc:662] Decoding operations
0709 12:57:22.808358 (+ 34585us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:22.808470 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:22.808516 (+    46us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:57:22.809970 (+  1454us) tablet.cc:701] Row locks acquired
0709 12:57:22.810000 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:57:22.822630 (+ 12630us) write_op.cc:270] Start()
0709 12:57:22.828166 (+  5536us) write_op.cc:276] Timestamp: P: 1783601842822555 usec, L: 0
0709 12:57:22.828190 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:57:22.886588 (+ 58398us) log.cc:844] Serialized 928 byte log entry
0709 12:57:23.363619 (+477031us) op_driver.cc:464] REPLICATION: finished
0709 12:57:23.365517 (+  1898us) write_op.cc:301] APPLY: starting
0709 12:57:23.365626 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:23.365735 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:23.365873 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:23.366196 (+   323us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:23.366349 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:57:23.366389 (+    40us) write_op.cc:312] APPLY: finished
0709 12:57:23.366570 (+   181us) log.cc:844] Serialized 28 byte log entry
0709 12:57:23.367314 (+   744us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:23.367391 (+    77us) write_op.cc:454] Released schema lock
0709 12:57:23.367432 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:23.367733 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:23.367760 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":134107,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":1680,"apply.run_cpu_time_us":1661,"apply.run_wall_time_us":2214,"num_ops":2,"prepare.queue_time_us":128067,"prepare.run_cpu_time_us":25985,"prepare.run_wall_time_us":321004,"raft.queue_time_us":6289,"raft.run_cpu_time_us":3242,"raft.run_wall_time_us":3242,"replication_time_us":535284,"thread_start_us":233600,"threads_started":4,"wal-append.queue_time_us":241297}]]}
I20260709 12:57:23.626631  2147 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.627106  2147 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:23.628773  2147 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.632344  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:23.636832  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.637205  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.640710  2185 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:23.644902  1575 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.654281  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:57:23.656808  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:23.657912  1498 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.661698  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.662974  2222 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.663460  2222 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.663898  2222 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.670032  2257 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.672467  2147 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.677402  2185 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.674088  2216 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.677996  2185 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.678500  2185 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.680027  1498 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:23.681265  2227 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.681741  2227 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:23.683146  2227 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:23.691337  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 71506.3us
I20260709 12:57:23.690922  1498 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.703321  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.706604  2197 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.707506  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.713099  2256 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.715374  2227 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.717905  2227 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.717974  1497 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:23.718778  2216 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:23.720508  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.721791  2216 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.723649  1575 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.715749  2256 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.725143  2216 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.725790  1498 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.725215  2227 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:57:23.734911  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47956.5us
I20260709 12:57:23.735721  2258 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.735237  2227 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:23.736644  2227 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:23.737949  2227 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.743088  1498 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.745942  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.747156  2256 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.751003  2197 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.751406  2185 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.752565  1528 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:23.753607  2185 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.754168  2222 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.756800  2222 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:23.761379  1498 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.763172  2185 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:23.763585  1498 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.763291  1431 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:23.768186  2197 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.768841  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:23.771649  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.774501  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.775087  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.775887  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.765065  1431 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:23.776849  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:23.779372  2216 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.780077  2216 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:23.783468  2224 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.783905  2224 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:23.784838  2224 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.786268  2224 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.773486  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.785321  1498 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:57:23.791438  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 60613us
I20260709 12:57:23.793838  1431 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:23.799918  2228 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.805948  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.796752  1528 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:23.802954  2222 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.840014  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:23.843439  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:57:23.836998  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 51776.6us
W20260709 12:57:23.849356  1480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:57:23.869277  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50865us
I20260709 12:57:23.875634  1498 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.876394  2221 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:23.878301  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:23.883426  2228 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.887897  1575 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.898346  2140 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.900118  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:23.905622  1428 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:23.907788  1428 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:23.909381  1428 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:23.924948  1498 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.930294  1531 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:23.926381  2228 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:23.939149  1532 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:23.932706  1575 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.943794  1529 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:23.944024  2221 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.945534  1575 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.950611  2221 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.951140  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.952037  2221 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.952661  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.953511  2221 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.923771  1528 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:23.945403  1498 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.965554  2228 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.969172  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:23.977885  1498 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.979151  2228 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.981456  1498 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.972373  2173 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:57:23.983891  1498 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.984138  2147 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.986568  2173 raft_consensus.cc:3055] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:23.986861  2147 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.986943  2173 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:23.988119  2173 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:23.990123  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:23.991029  2173 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.991488  2174 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.993041  1647 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:23.994215  2174 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.994560  2174 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:23.995209  2174 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.995909  1649 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:23.998071  2259 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:23.998595  2259 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:23.999612  2259 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.003947  1498 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.005030  1647 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.005467  2197 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.006956  1498 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.007176  2051 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.009779  2197 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.014424  2179 consensus_queue.cc:1059] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:24.015501  2051 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.015923  2051 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.017236  2051 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.018726  2051 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.019318  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:24.021250  2179 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:24.022405  2179 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.023414  2179 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.008769  2174 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.025146  1498 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.026158  2197 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.027776  1498 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.033540  2174 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:24.041060  2166 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:24.041800  2197 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.043388  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.044026  2147 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:24.044914  2173 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:24.048206  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.049855  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.050524  1600 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:24.050586  1528 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:24.050700  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.051683  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.051847  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.052448  1607 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:24.053053  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.053767  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.054490  1602 raft_consensus.cc:2393] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:24.054553  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.055720  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.055871  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:24.056137  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.056623  1608 raft_consensus.cc:2410] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:57:24.057621  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:24.058293  1606 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.059031  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.060338  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.062065  1527 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:24.063691  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.064373  1604 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:24.063637  1431 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.065764  2173 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:24.066346  2173 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.066622  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.067443  1605 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:24.067257  2173 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.070739  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.072831  1606 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.078094  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.081142  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.088274  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.089349  1606 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:24.091305  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.092192  1605 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:24.092334  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.093217  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.093991  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.052394  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.098883  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.115289  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.098842  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.120527  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.120736  1532 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:57:24.120996  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.121909  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.122015  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.123452  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.105763  2197 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:57:24.127206  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.132239  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.134141  1605 raft_consensus.cc:2376] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1. Re-sending same reply.
I20260709 12:57:24.125206  1600 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.146219  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.146903  1608 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.147766  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.152140  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.153379  1606 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.158236  1607 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.158253  1608 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.159220  1602 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.165912  1606 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
W20260709 12:57:24.167599  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.170702  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.171345  1605 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.171439  1607 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.171865  1601 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.172897  1605 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.174466  1608 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.175444  1605 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.175765  1601 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.176666  1605 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.180896  1428 catalog_manager.cc:5697] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:24.183151  1600 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:24.187587  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.193107  1607 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:24.195341  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.198017  1498 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.201303  1603 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.208823  1607 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.211426  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.215391  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.217135  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.217295  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.218189  1603 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.220662  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.224089  1674 raft_consensus.cc:1240] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.221336  1602 raft_consensus.cc:2376] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1. Re-sending same reply.
I20260709 12:57:24.226755  2197 consensus_queue.cc:1059] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.227968  2197 raft_consensus.cc:3055] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.228361  2197 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:24.229300  2197 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.231034  2197 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:24.237982  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:24.245038  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 47147.9us
I20260709 12:57:24.244670  2198 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.260064  1608 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.253829  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.262413  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.262638  1647 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.264583  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.265750  2259 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:24.266551  2259 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.270229  1647 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.273990  2051 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.274029  2259 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:24.274336  1647 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.274366  1498 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.274741  2259 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.276917  2259 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:24.277170  2258 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.279798  2198 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.280982  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.281803  2256 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.282301  2256 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.283414  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:24.284145  1498 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:24.284335  2256 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.284950  2147 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:24.285326  2147 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:24.285377  1498 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.285778  2147 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.285879  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:24.288192  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.288796  2258 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:24.289148  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.289541  2227 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.288938  2256 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:24.291833  1575 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.292615  2256 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.293447  2256 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.293932  2256 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:24.296715  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.297983  2173 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.298092  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:24.298563  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.299437  2174 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.300150  1647 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.300921  2259 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.301537  1647 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.303220  1603 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:24.326171  2259 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.329201  1647 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.331367   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 12:57:24.304456  2256 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.336925  2259 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.338577  2259 consensus_queue.cc:1059] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.339741  2166 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.340108  2166 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.340871  2166 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.342803  2166 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.348084  1676 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:24.351063  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.350970  2197 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:24.352864  2174 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.307374  1498 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.322098  2227 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.313700  2258 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.355365  2227 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.355253  2258 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:24.356531  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 49245.6us
I20260709 12:57:24.305609  1575 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.324393  1428 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:24.359045  2197 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.360023  1428 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:24.361392  2258 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.362402  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.363219  2198 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:24.308889  2280 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:57:24.365306  1498 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:57:24.363269  2285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:24.322885  2147 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.376189  2227 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.379957  2140 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:24.380218  2147 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.382462  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.320580  1602 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:24.380475  2140 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.385808  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:24.386716  2227 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.383863  2051 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:57:24.388463  2051 raft_consensus.cc:3055] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.388793  2051 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.370095  2174 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:57:24.389948  2179 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.390324  2179 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.375325  2256 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:24.391474  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 85958us
I20260709 12:57:24.382081  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:24.398465  1534 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.398327  1674 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:24.399645  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.400389  2166 consensus_queue.cc:1059] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.400979  2173 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:24.402145  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:24.402469  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.401424  2166 raft_consensus.cc:3055] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.403462  2166 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.403383  2051 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.396494  2179 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.405145  2140 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.405316  2179 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.405611  2228 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.401460  2173 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.406024  2228 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.406399  2228 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.406687  2173 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:24.409459  2286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:24.404816  2051 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.413934  1498 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:24.415791  2174 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:24.415634  2166 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.409816  2259 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:57:24.417611  2166 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.418256  2258 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:24.418440  2259 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.418797  2258 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:24.419687  2258 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.425316  2140 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.425904  2197 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:24.428820  2174 consensus_queue.cc:1059] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.429335  2227 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.418809  2259 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.430564  2174 raft_consensus.cc:3055] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.431002  2174 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.430693  2259 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.431957  2259 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.432030  2174 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.432526  1575 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.433312  2140 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.433708  1575 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.442131  1534 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.446559  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:24.446789  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.447357  1604 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:24.447455  1675 raft_consensus.cc:2393] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:24.457015  1604 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:57:24.457626  1604 pending_rounds.cc:85] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 0
I20260709 12:57:24.463037  1604 pending_rounds.cc:107] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:57:24.463326  1604 raft_consensus.cc:2889] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:24.471390  1575 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.447487  2164 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:57:24.470956  2185 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:57:24.479153  2256 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:24.479785  2256 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.464957  2140 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.511634  2256 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:24.509238  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 50997.3us
W20260709 12:57:24.526154  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 54877us
I20260709 12:57:24.526101  2302 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.537624  1575 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:57:24.530150  2289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:24.549789  2197 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.551951  2197 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.553828  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.532029  2298 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:57:24.537173  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:24.549770  2302 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.568351  1575 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.580920  2228 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.584080  1575 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.586025  2302 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.587335  2174 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.589063  2302 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.590420  1575 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.594457  2300 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.595618  2197 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.595705  1575 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.603435  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.604887  2166 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:24.606989   431 server_base.cc:1061] running on GCE node
I20260709 12:57:24.608088  1429 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.612069  2297 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.614854  1575 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.614794  2166 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.615660  2297 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.618940  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:24.619571  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:24.620339  1532 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:24.622023  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:24.623526  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:24.624331  1526 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:24.610644  2291 consensus_queue.cc:1059] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:57:24.625751  2291 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.626123  2291 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.629905  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.633078  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.617316  2166 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:24.607394  2300 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.634999  1534 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.636121  1575 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:24.638206   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:24.638541   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:24.638763   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601844638747 us; error 0 us; skew 500 ppm
I20260709 12:57:24.641263  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:24.641841  1534 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.643232  2221 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:24.644414  2221 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:24.644774  2221 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.642061  2297 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.647517  1532 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.643617  2140 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.649191  2228 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.652458  2259 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.653303  2179 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.626931  2291 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.657249  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.660130  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:24.660787  1676 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:24.662950  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:24.663759  1683 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.667963   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:24.668800  2296 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.669893  2296 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.670240  2296 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:24.670308  2291 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.671090  2296 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.674144  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.675143  1602 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:24.676328  2300 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.680824  1498 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.683032  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:24.677416  1428 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:24.690133  2185 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.691525  2164 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.691947  2164 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.692767  2164 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.698900  2299 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.699338  2299 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.699684  2299 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.700878  2164 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.706949  1683 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:24.708300  2166 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.701929  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.711141  1600 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.709456  2166 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.715106  2166 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.716120  2166 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.718307  2166 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.717424  2296 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.735523  2174 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:24.736433  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:24.737165  2185 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:24.737689  2185 raft_consensus.cc:697] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:24.737967  2221 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.733284  2299 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.738543  2185 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.740396  2221 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.740792  2299 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.740691  1647 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.710269  2300 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.755360  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:24.756017  1676 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.741544  2166 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:57:24.758491  2259 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.758870  2259 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.759693  2259 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.760880  2259 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.742733  2174 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.763357  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:24.773247  1677 raft_consensus.cc:2393] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:24.775276  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:24.790975  1600 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:24.792634  1647 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:24.783828  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.793838  1602 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.794305  1647 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.795660  2174 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.797698  2308 consensus_queue.cc:1059] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:24.798935  2304 raft_consensus.cc:3055] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.799291  2304 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.800148  2304 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.801666  2304 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.809783  2296 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.810524  2296 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.824007  1647 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.826509  2298 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.829066  1526 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:24.830529  1575 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:24.831096  2296 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.831461  2140 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:24.830529  2298 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:57:24.834151  2140 raft_consensus.cc:697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:24.835083  1647 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.835095  2140 consensus_queue.cc:237] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.842217  1677 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.835259  2291 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:57:24.839036  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:24.845197  1683 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:24.846256  1572 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:24.847011  2221 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.847378  2221 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.847725  2221 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.848347  2299 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.854844  2308 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.857748  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.870688  1607 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.872946  1609 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.873818  1676 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:24.878197  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.878613  2166 raft_consensus.cc:2764] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:57:24.856231  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:24.879845  1526 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:57:24.862658  2185 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.884840  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:24.894972  1647 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.880654  1600 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.897439  2147 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:24.898319  2304 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.910301  1606 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.919283  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:24.896008  2185 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.921895  2174 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.923341  2174 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.926370  2185 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:24.927002  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:24.927242  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:24.933156  1606 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:57:24.919582  1431 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.935436  1526 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:24.943806  1498 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:24.944556  2185 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.945053  2185 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.945385  2185 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.948664  1428 catalog_manager.cc:5697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.954154  2185 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.959421  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:24.960108  1606 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.918358  2147 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:24.925925  2298 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:57:24.967835  1606 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:24.971082  1498 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:24.975692  2259 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:57:24.977967  2259 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.978371  2259 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:24.927778  2299 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:57:24.979417  2259 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.974115  1676 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:24.981945  2140 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.982491  2140 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:24.965118  2147 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.012284  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:25.013020  1526 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:24.986294  2197 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.014071  2197 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:25.014887  2197 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.017170  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:24.961483  1602 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:25.023926   431 webserver.cc:533] Webserver started at http://127.0.107.196:45737/ using document root <none> and password file <none>
I20260709 12:57:25.027510  2300 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.027941  2300 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.028309  2300 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.988318  2259 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.964089  2221 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.029337   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:25.039882   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:25.040621   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:25.042359   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-3-root/instance:
uuid: "1e45ac8b66854c2f905bf2c4114cb489"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-qv7r"
I20260709 12:57:25.043072  2185 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.055737  2221 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.058472  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:25.059346  1682 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.064345  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.065872  2228 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.065546  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:25.066412  1683 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.066356  2228 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.068506  2228 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.070573  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:25.071213  1529 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.074134  1600 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:25.074293  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.075795  2298 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.079965  1675 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:25.045353  2140 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.097389  1683 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:25.108946  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.109773  1602 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
W20260709 12:57:25.098925  2324 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:57:25.116220  1529 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:25.112653  1498 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:25.117858  2299 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.118384  2299 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.118810  2299 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.125793  2300 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.131886  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:25.147244  2296 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.147774  2296 raft_consensus.cc:697] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:25.148725  2296 consensus_queue.cc:237] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.151408  2300 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.153914  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:25.154599  1683 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.141306  1682 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:25.163755  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:25.164410  1531 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.163347  1683 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:25.165781  1572 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:25.171514  2140 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.178891  2140 raft_consensus.cc:697] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:25.179755  2140 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.191090  1428 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.194144  1428 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.205299  1531 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:25.212930  2298 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.213503  2298 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.213919  2299 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.215709  2298 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:25.217093  2299 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.217145  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:25.222075  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:25.218984  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:25.227065  1531 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:25.228583  1649 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:25.229585  2308 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.229796  1607 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.230171  2308 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.230906  2308 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.235734  1531 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:25.244153  2298 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.244115  1607 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:25.245445  2298 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:25.245955  2298 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:25.246861  2298 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.247918  2298 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.251674  1498 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:25.254196  2147 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.257964  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.258139  1608 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:25.256485  2308 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.259253  1600 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:25.260867  2308 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:25.261523  2147 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:25.263795  2147 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.265939  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:25.266531  1529 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.268765  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:25.269309  1600 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.278412  1675 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.280797  1600 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:25.282019  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:25.282823  2259 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.283704  2299 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:25.284497  2259 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:25.285837  1531 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:25.285364  2259 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.287164   431 fs_manager.cc:696] Time spent creating directory manager: real 0.241s	user 0.016s	sys 0.010s
I20260709 12:57:25.287335  2221 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.289470  1529 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:25.329813  1429 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.332023  1608 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.331686  2337 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.333380   431 fs_manager.cc:730] Time spent opening block manager: real 0.043s	user 0.005s	sys 0.004s
I20260709 12:57:25.333806   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-3-root
uuid: "1e45ac8b66854c2f905bf2c4114cb489"
format_stamp: "Formatted at 2026-07-09 12:57:25 on dist-test-slave-qv7r"
I20260709 12:57:25.334165   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:25.336455  2147 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:25.338905  1429 catalog_manager.cc:5697] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.342770  1676 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:25.342288  1431 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.345614  2330 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.347033  2299 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:25.347517  2299 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.350229  2299 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.350454  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.351111  1676 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:25.352303  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:25.357873  2147 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:25.358283  2147 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:25.358649  2147 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:25.365186  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.365998  1604 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:25.383735  1428 catalog_manager.cc:5697] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:25.386926  2147 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.390165  2147 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.390209  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:25.391041  1608 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:25.391074  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:25.396175  2299 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:25.396713  2299 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.401467  2299 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.403261  1677 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:25.403333  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.404138  1676 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:25.404749  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:25.405766  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:25.406953  2198 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:25.407619  2198 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:25.409792  2227 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:25.410357  2227 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:25.410892  2227 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:25.421710  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.422526  1608 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:25.408769  2198 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.429724  1608 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.439610  2227 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.442600  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:25.445794   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:25.449373   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:25.449250  2185 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:25.455938  1675 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:25.450238  2227 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.458879  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:25.460572  2185 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:25.461256  2185 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:25.462419  2185 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.466998  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:25.467743  1604 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:25.484197  1604 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.485597   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:25.493178  2185 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:25.501493  1676 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.503508  2227 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.516368   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:25.517139   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
I20260709 12:57:25.517694   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:25.517975   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:25.524809  1428 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.526667  1428 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.555773  1683 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.558804  2197 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.590431  1527 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.596602  2296 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.601328  1527 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.609050  2302 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:25.632211  1675 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.633754  2221 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:25.652031  1604 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.655323  2228 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.644739  2296 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:25.657029  2296 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.667701  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.668488  1683 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:25.670909  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:25.671671  1529 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:25.674192  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:25.665911  2296 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.677142  1677 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:25.677592  1677 pending_rounds.cc:85] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 1
I20260709 12:57:25.677837  2296 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:25.678330  2296 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:25.678731  2296 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:25.677872  1677 pending_rounds.cc:107] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:25.684711  1677 raft_consensus.cc:2889] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:25.685982  1683 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.689460  2296 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.700623  2228 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.702315  2296 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.702387  2330 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:25.705684  2298 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.706971  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:25.708962  1677 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:25.724007  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:25.706210  2298 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.745777  2298 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:25.748284  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:25.749114  1531 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:25.751637  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:25.754032  2173 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.754505  2173 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.754913  2173 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.754317  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.757217  1604 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:25.785360  2197 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:25.785961  2197 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.791584  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.792361  1607 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:25.795852  2299 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:25.796382  2299 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.799136  2299 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.799718  2197 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.800168  2259 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.800230  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.800777  2259 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.801544  1604 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:25.806986  1527 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:25.808338  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:25.810227  2140 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:25.810712  2140 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:25.811580  2140 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.815104  2259 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:25.817202  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.817848  1604 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:25.818459  2173 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.820171  1647 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:25.820719  2173 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:25.824775  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:25.825517  1604 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.834611  1604 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:25.836007  1608 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:25.835969  1647 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:25.821342  2173 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.837023  2173 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.837116  2298 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.844828  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:25.845285  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:25.845927  2173 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.846140  1533 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.851760  1528 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.854705  2227 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:25.855214  2227 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.858141  2227 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.861145  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.862293  1608 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:25.862708  2298 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:25.867069  2298 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.849740  2197 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:25.887883  2304 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.888393  2304 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.887789  1533 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:25.891791  2173 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.901825  2147 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:25.902412  2147 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.904695  2147 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.905463  2304 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:25.906983  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.907742  1683 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:25.908419  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.909328  1607 raft_consensus.cc:2393] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:25.910079  2173 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:25.913671  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:25.914548  1607 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.916105  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.916747  1600 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:25.923290  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.924018  1675 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:25.929103  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:25.929946  2298 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.930330  2298 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.930688  2298 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.930507  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.933048  1600 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.935395  2173 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.940548  1607 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:25.940267  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:25.941815  1683 raft_consensus.cc:2368] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:25.942016  1428 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.944496  1647 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:25.949958  2259 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.950718  2259 raft_consensus.cc:697] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:25.952250  2259 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.955876  2298 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.956714  2147 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.957046  1675 raft_consensus.cc:2368] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:25.957441  2147 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.962803  2147 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.963182  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:25.963869  1604 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:25.965092  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:25.965847  2147 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.966238  2140 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.966285  2147 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.966964  2147 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.966876  2140 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.969499  2140 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:25.970052  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:25.972223  1675 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:25.982987  2173 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.983600  2173 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.987455  2366 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.988009  2366 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.990032  2304 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.990535  2304 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:25.992992  2366 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:25.998150  2304 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.000072  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.002997  1607 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.005125  2173 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.009325  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:26.010094  1683 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:26.010233  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.010483  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:26.011031  1533 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.011034  1604 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:26.012557  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.013373  2173 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.013478  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:26.014922  2173 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.015403  2173 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.016805  2185 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:26.017207  2185 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:26.018920  2185 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.016036  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:26.000308  1429 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.007459  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.025694  1608 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:26.025791  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:26.026551  1526 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:26.027464  2228 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:26.027881  2228 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:26.028378  2228 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.025940  1429 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.027451  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.034564  2259 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.035200  2259 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.045691  2259 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.036283  2228 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.028401  1533 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:26.042661  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.049168  2228 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.050237  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.051019  1608 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:26.053138  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:26.054126  1600 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:25.994488  2298 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.055022  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:26.056411  1607 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:26.057381  2173 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.060060  2173 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.070881  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:26.071642  1526 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:26.073356  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:26.074126  1527 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.077448  1647 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.078056  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.078339  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.078631  1600 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.078296  2185 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.080060  2304 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.080423  2304 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.080760  2304 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.081422  2366 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.081925  2164 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:26.082621  2147 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.082944  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.083673  1607 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:57:26.081933  2366 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:26.085929  2366 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.102519  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.103181  1607 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.103997  1497 leader_election.cc:400] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:26.104452  1497 leader_election.cc:403] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:26.106684  2197 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:26.108265  1497 leader_election.cc:400] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:26.108659  1497 leader_election.cc:403] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:26.110145  2228 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:26.112562  1607 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:26.114010  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.081284  2185 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.104336  1600 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:26.115128  2185 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.084744  2147 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.116364  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.117179  2308 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.117758  2308 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:26.118722  2308 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.126436  2304 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.127856  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:26.128475  1683 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:26.129503  2304 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.129766  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.130472  1600 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.130275  2259 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.132616  2185 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:26.133637  2185 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.140098  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:26.140601  1527 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:26.141250  2197 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:26.146983  1675 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:26.147914  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:26.149286  1572 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:26.150180  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.150625  2330 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.150707  1607 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.151229  2330 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.151620  2330 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.153708  2197 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:26.154256  2197 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.158036  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.158226  2197 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.159282  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:26.159888  1677 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.161281  2330 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.161963  2259 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.164856  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:26.165618  2330 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.169039  2308 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:26.169245  1677 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:26.169668  2308 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.189312  1429 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.203683  1600 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:26.205775  1647 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.206838  2377 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.207866  2377 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:26.208663  2377 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.214998  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:26.216750  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:26.217290  2308 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.217399  1682 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.198421  1428 catalog_manager.cc:5697] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.225718  1682 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:26.216817  1527 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.224980  1428 catalog_manager.cc:5697] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.177594  1607 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:26.183758  1608 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:26.148029  1683 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:26.194648  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.233810  1603 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:26.197274  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:26.235265  1533 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.236020  2299 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:26.199430  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:26.180284  1676 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:26.238722  1647 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.240466  1532 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:26.242311  2256 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:26.244446  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:26.245306  1532 raft_consensus.cc:2393] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 2: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:26.248231  1527 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:26.250998  1572 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:26.252797  2297 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.253278  2297 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:26.254123  2297 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.256188  2299 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:26.258060  2299 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:26.258795  2299 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:26.268002  2259 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:26.269901  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:26.269981  2259 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:26.271118  2259 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.278226  1677 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:26.278462  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:26.279896  2308 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.281001  2308 raft_consensus.cc:697] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:26.283357  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:26.282763  2308 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.284122  2197 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:26.284636  2197 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:26.265300  1533 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:26.261395  2299 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.288837  2197 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.289374  2299 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.301028  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:26.343760  1497 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:26.343432  2299 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:26.350708  2185 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:26.367173  2299 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:26.374274  2299 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.378463  1428 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 3, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.406201  2185 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:26.434274  1676 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:26.425205  1431 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.437716  1533 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.450851  1429 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.453222  1429 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.428074  2185 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.445674  2297 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:57:26.464766  1608 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.470741  2297 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:26.471264  2297 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.473804  2164 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:26.473227  2297 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.475301  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:26.476090  1526 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 2: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:26.483876  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.484841  1607 raft_consensus.cc:2368] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:26.461702  2392 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.477682  2185 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.480610  2259 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.493685  1498 leader_election.cc:400] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:26.500922  1498 leader_election.cc:403] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:26.506974  2185 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.509613  2377 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.507472  2298 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:57:26.503228  2392 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.549125  2302 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.559806  2140 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.575825  2140 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.584203  2140 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.588802  2302 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.591585  2302 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.602842  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:26.603879  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:26.527305  2377 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:57:26.642310  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 162937us
I20260709 12:57:26.639596  2185 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:57:26.655700  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.656306  1607 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:26.657701  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.649945  2392 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.653360  2259 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.662709  2299 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.682993  2299 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.683389  2299 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.665925  1529 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.684268  1527 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.682363  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:26.697753  1428 catalog_manager.cc:5697] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.701716  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:26.702368  1677 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:26.704304  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:26.704797  1677 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:26.714236  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:26.714922  1681 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:26.715816  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:26.717396  2377 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:26.735090  1603 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:26.731674  2299 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.742300  1533 raft_consensus.cc:2368] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3.
W20260709 12:57:26.745620  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 136088us
I20260709 12:57:26.747908  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:26.748618  1680 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:26.750456  2299 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.758126  2147 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.758841  2147 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.774415  1604 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.789465  2147 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:26.777840  2392 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:57:26.817116  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.821260  1606 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.844190  1606 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.845256  1607 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:26.833153  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.858630  1647 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.862071  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:26.850744  2259 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:57:26.867650  1600 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.868461  2366 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:26.868927  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:26.872987  1605 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:57:26.852185  2396 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:57:26.879921  1674 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.875326  1602 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.900681  2377 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:26.901633  2377 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:26.901700  1603 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.913045  1572 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:26.915189  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:26.917411  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:26.919540  1572 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:26.923635  1606 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.917917  2377 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:26.925163  2298 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.926700  2298 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.927162  2298 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.925304  2256 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.930097  2256 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.930557  2256 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.917258  2300 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:26.931290  2300 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:57:26.931742  2300 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.933801  2164 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:26.916595  2408 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.923269  2308 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:57:26.951885  1602 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:26.967370  1533 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:26.967911  1533 pending_rounds.cc:85] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 1
I20260709 12:57:26.941273  2408 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.968181  1533 pending_rounds.cc:107] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:26.968506  1533 raft_consensus.cc:2889] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:27.003098  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:27.003988  1529 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:26.971653  2408 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:27.005589  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 81537.7us
I20260709 12:57:26.979744  2300 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.016564  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:27.039880  1529 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.039953  1649 leader_election.cc:400] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3.
I20260709 12:57:27.040968  2228 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:27.057442  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 45576us
I20260709 12:57:27.077005  2302 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.038965  2399 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:57:27.082996  2228 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:27.086687  1529 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.080964  2256 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.054220  2400 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:57:27.103820  2256 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:27.050223  2401 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:57:27.084918  2228 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.121155  2300 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:27.122400  1675 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.123185  2298 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.124617  1675 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.125519  2298 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:27.117537  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:57:27.120043  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 105729us
I20260709 12:57:27.152669  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:27.153622  1607 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.159714  1526 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.162552  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:27.163301  1528 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.188540  1607 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:27.147310  2227 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:57:27.237759  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 204739us
I20260709 12:57:27.191515  2393 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:57:27.237409  1528 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:27.295778  1429 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:27.305542  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:27.306782  1676 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 3: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:57:27.314148  1681 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.291769  2308 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:57:27.396117  2427 log.cc:927] Time spent T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:57:27.447402  2408 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.449131  1604 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:27.453943  2299 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.454777  2299 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.460167  2299 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:27.467133  2408 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:57:27.503185  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 355103us
I20260709 12:57:27.512799  2308 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.516547  2401 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.543279  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:57:27.563648  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 412474us
I20260709 12:57:27.596671  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:27.599480  2147 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.600364  2393 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:27.606019  2300 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 12:57:27.657722  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 82126.5us
I20260709 12:57:27.674062  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:27.675050  1675 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:27.679270  2434 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:27.698325  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:57:27.705240  2446 log.cc:927] Time spent T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:57:27.711927  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:57:27.719642  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 480915us
I20260709 12:57:27.726377  2424 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.729892  2393 raft_consensus.cc:3055] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:27.722884  2434 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:27.742551  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:27.743223  1679 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.734841  2393 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:57:27.750636  2447 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:57:27.750113  2434 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.803601  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:27.818084  1679 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:27.830490  1676 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:27.831183  1676 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:27.832906  1534 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
W20260709 12:57:27.834537  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 165714us
I20260709 12:57:27.814706  2147 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.842597  2147 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.881556  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:27.861735  2147 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:27.904488  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 62749.7us
I20260709 12:57:27.810571  2393 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.832494  1676 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.916266  1676 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.921036  1608 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.940505  1603 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:27.953943  1572 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:27.955842  2408 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:27.956235  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:27.956496  2408 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:27.957742  2408 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:27.959776  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:27.960795  1532 raft_consensus.cc:2368] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3.
I20260709 12:57:27.998636  1678 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:28.010993  2393 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.021957  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:28.048799  1676 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:28.056185  1676 pending_rounds.cc:85] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 1
I20260709 12:57:28.062484  1676 pending_rounds.cc:107] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:28.062933  1676 raft_consensus.cc:2889] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.025192  2147 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:28.065140  1525 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.088228  1532 raft_consensus.cc:2410] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:28.093248  1603 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:28.099030  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 136) took 1044 ms. Trace:
I20260709 12:57:28.101387  1431 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.104085  1575 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:28.104930  2408 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:28.105329  1575 leader_election.cc:400] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3.
I20260709 12:57:28.105755  1575 leader_election.cc:403] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:28.099437  1429 rpcz_store.cc:276] 0709 12:57:27.092801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.095315 (+  2514us) service_pool.cc:224] Handling call
0709 12:57:28.098949 (+1003634us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:27.691794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:27.698748 (+  6954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:27.699991 (+  1243us) write_op.cc:435] Acquired schema lock
0709 12:57:27.701216 (+  1225us) tablet.cc:662] Decoding operations
0709 12:57:27.703262 (+  2046us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:27.703339 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:27.703374 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:27.703600 (+   226us) tablet.cc:701] Row locks acquired
0709 12:57:27.703625 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:57:27.703776 (+   151us) write_op.cc:270] Start()
0709 12:57:27.703901 (+   125us) write_op.cc:276] Timestamp: P: 1783601847703722 usec, L: 0
0709 12:57:27.703920 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:57:27.704553 (+   633us) log.cc:844] Serialized 540 byte log entry
0709 12:57:27.868135 (+163582us) op_driver.cc:464] REPLICATION: finished
0709 12:57:28.094685 (+226550us) write_op.cc:301] APPLY: starting
0709 12:57:28.094777 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:28.094899 (+   122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:28.095057 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:28.095334 (+   277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:28.095529 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:28.095571 (+    42us) write_op.cc:312] APPLY: finished
0709 12:57:28.095794 (+   223us) log.cc:844] Serialized 22 byte log entry
0709 12:57:28.095985 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:28.096112 (+   127us) write_op.cc:454] Released schema lock
0709 12:57:28.096176 (+    64us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":2702,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":226260,"apply.run_cpu_time_us":1923,"apply.run_wall_time_us":1924,"num_ops":1,"prepare.queue_time_us":390614,"prepare.run_cpu_time_us":3382,"prepare.run_wall_time_us":13056,"replication_time_us":164072,"thread_start_us":444659,"threads_started":2}]]}
I20260709 12:57:28.107225  2408 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3.
I20260709 12:57:28.116798  2147 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:28.136451  1428 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 3, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.165755  1429 catalog_manager.cc:5697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:28.164002  2433 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:57:28.201464  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:28.191731  2448 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:57:28.195484  2393 consensus_queue.cc:1059] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:28.224418  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:28.204350  2458 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:57:28.262522  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:28.269870  2299 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:28.272078  2426 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:28.272539  2426 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:28.273897  2140 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.274283  2140 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:28.273337  2426 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:28.276908  2426 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.279325  2140 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:28.280478  2140 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.288946  1525 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.463109  1600 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:28.466033  2444 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:28.483819  1527 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:28.484395  1527 pending_rounds.cc:85] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 1
I20260709 12:57:28.484720  1527 pending_rounds.cc:107] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:28.485050  1527 raft_consensus.cc:2889] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.498412  2140 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:28.521337  1525 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:28.523128  2164 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:28.524588  1675 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:28.530545  2432 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:28.714524   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:46719
I20260709 12:57:28.720302  2510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:46719 every 8 connection(s)
I20260709 12:57:28.804402   431 auto_leader_rebalancer-test.cc:384] add a tserver: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:28.838819  2511 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38115
I20260709 12:57:28.839372  2511 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:28.840330  2511 heartbeater.cc:507] Master 127.0.107.254:38115 requested a full tablet report, sending...
I20260709 12:57:28.843832  1429 ts_manager.cc:194] Registered new tserver with Master: 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:57:28.846148  1429 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41270
I20260709 12:57:28.988046  1676 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:29.026880  1604 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:29.033473  2164 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:29.046941  1526 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:29.048843  2164 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:29.051066  2377 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.054045  1526 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.056684  1600 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
W20260709 12:57:29.072108  1649 consensus_peers.cc:597] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77f1e53da9e94a8e8859328c4a06b68a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:29.103197  1429 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.145005  1527 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:29.180167  1604 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:29.181686  2147 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.183177  1675 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:29.187382  2197 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.221187  2185 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.223621  1604 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
W20260709 12:57:29.245857  1500 consensus_peers.cc:597] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b00f4dc45e904f49a3231fc0c487b88d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:29.250754  1428 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.268455  1675 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:29.272670  1676 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.299731  1604 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:29.302152  1526 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:29.304236  2377 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:29.305172  2173 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:57:29.310348  1649 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22d7b940a3774b7fbb80a3a69355356b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:29.320314  2396 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.324714  1527 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.325244  1600 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.345777  1429 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.387799  1600 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:29.397281  1527 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:29.399951  2432 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:29.397434  1675 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:29.402336  2140 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:29.413654  2432 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
W20260709 12:57:29.418929  1575 consensus_peers.cc:597] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5741b07c783e4193be39d19fba6c5cec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:29.420140  1527 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.422518  1676 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.424320  2147 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.424770  2147 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:29.426592  2147 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:29.429445  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:29.430716  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:29.431382  1600 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:29.434437  1498 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:29.435432  2197 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.435797  2197 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.436125  2197 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.439503  1428 catalog_manager.cc:5697] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:29.443784  2197 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:29.454116  2197 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:29.455703  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:29.456290  1600 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.457036  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:29.464136  1600 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:57:29.465756  1498 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:29.466853  2147 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:29.467957  2147 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:29.468705  2147 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:29.506203  1431 catalog_manager.cc:5697] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:29.578696  2396 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:29.579213  2396 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:29.581141  2396 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:29.587693  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:29.588385  1604 raft_consensus.cc:2368] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:57:29.591568  1647 leader_election.cc:400] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:57:29.591876  1647 leader_election.cc:403] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:29.592465  2164 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.598730  2539 ts_tablet_manager.cc:933] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:29.599507  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:29.601975  2164 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:57:29.609122  2538 ts_tablet_manager.cc:933] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:29.619894  2539 tablet_copy_client.cc:323] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:29.622287  2538 tablet_copy_client.cc:323] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:29.650826  1693 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 77f1e53da9e94a8e8859328c4a06b68a from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:29.651503  1693 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 77f1e53da9e94a8e8859328c4a06b68a from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-77f1e53da9e94a8e8859328c4a06b68a
I20260709 12:57:29.660171  1693 tablet_copy_source_session.cc:215] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:29.664201  2539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f1e53da9e94a8e8859328c4a06b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:29.669166  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet b00f4dc45e904f49a3231fc0c487b88d from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:29.669905  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet b00f4dc45e904f49a3231fc0c487b88d from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-b00f4dc45e904f49a3231fc0c487b88d
I20260709 12:57:29.680475  1544 tablet_copy_source_session.cc:215] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:29.688102  2538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00f4dc45e904f49a3231fc0c487b88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:29.691927  2539 tablet_copy_client.cc:806] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:29.692672  2539 tablet_copy_client.cc:670] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:29.697682  2539 tablet_copy_client.cc:538] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:29.704445  2538 tablet_copy_client.cc:806] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:29.705142  2538 tablet_copy_client.cc:670] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:29.710909  2538 tablet_copy_client.cc:538] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:29.715538  2396 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:29.716081  2396 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:29.723169  2396 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:29.724713  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:29.725178  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:29.725390  1600 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:57:29.725898  1527 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:29.726519  1647 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:29.728355  2377 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.728726  2377 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:57:29.729084  2377 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.738022  2539 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:29.740707  2377 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:29.744253  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:29.744266  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:29.750524  1527 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:57:29.751029  2377 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:29.751587  2538 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:29.752455  1604 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:57:29.753629  1647 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:29.755316  2377 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:29.757879  2377 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:29.756462  2545 ts_tablet_manager.cc:933] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:29.758770  2377 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:29.775120  2545 tablet_copy_client.cc:323] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:29.777199  1693 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 22d7b940a3774b7fbb80a3a69355356b from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:29.779470  1693 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 22d7b940a3774b7fbb80a3a69355356b from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-22d7b940a3774b7fbb80a3a69355356b
I20260709 12:57:29.800884  1693 tablet_copy_source_session.cc:215] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:29.818739  1431 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 3 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:29.822537  2545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d7b940a3774b7fbb80a3a69355356b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:29.827533  2538 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:29.842512  2538 tablet_bootstrap.cc:492] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:29.843307  2538 ts_tablet_manager.cc:1403] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.093s	user 0.021s	sys 0.005s
I20260709 12:57:29.846454  2539 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:29.848696  2545 tablet_copy_client.cc:806] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:29.849166  2511 heartbeater.cc:499] Master 127.0.107.254:38115 was elected leader, sending a full tablet report...
I20260709 12:57:29.849283  2545 tablet_copy_client.cc:670] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:29.857427  2147 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.857884  2147 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:29.858461  2545 tablet_copy_client.cc:538] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:29.859704  2147 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:29.863955  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:57:29.864795  1604 raft_consensus.cc:2410] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:29.870090  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:57:29.869656  2545 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:29.877940  2539 tablet_bootstrap.cc:492] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:29.878770  2539 ts_tablet_manager.cc:1403] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.013s
I20260709 12:57:29.881769  2538 raft_consensus.cc:359] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:29.882118  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:29.883152  2539 raft_consensus.cc:359] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:29.883986  2539 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:29.884645  2539 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:29.882692  2538 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:29.885979  2538 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:29.883634  2147 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:29.901995  2539 ts_tablet_manager.cc:1434] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 12:57:29.905305  1693 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-77f1e53da9e94a8e8859328c4a06b68a received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:29.906096  1693 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-77f1e53da9e94a8e8859328c4a06b68a on tablet 77f1e53da9e94a8e8859328c4a06b68a with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:29.908080  2538 ts_tablet_manager.cc:1434] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.005s
I20260709 12:57:29.909994  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-b00f4dc45e904f49a3231fc0c487b88d received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:29.910491  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-b00f4dc45e904f49a3231fc0c487b88d on tablet b00f4dc45e904f49a3231fc0c487b88d with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:29.913923  2538 ts_tablet_manager.cc:933] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:29.954645  2475 raft_consensus.cc:1217] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:29.971391  2538 tablet_copy_client.cc:323] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:57:29.978493  1604 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.980300  2545 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:29.980912  2147 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.981277  2545 tablet_bootstrap.cc:492] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:29.982092  2545 ts_tablet_manager.cc:1403] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.113s	user 0.034s	sys 0.047s
I20260709 12:57:30.003187  1676 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:30.003866  2545 raft_consensus.cc:359] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:30.005154  2545 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:30.007411  2185 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:30.008044  2545 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:30.049289  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 5741b07c783e4193be39d19fba6c5cec from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:57:30.049902  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 5741b07c783e4193be39d19fba6c5cec from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-5741b07c783e4193be39d19fba6c5cec
I20260709 12:57:30.056764  2476 raft_consensus.cc:1217] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:30.073611  1619 tablet_copy_source_session.cc:215] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:30.080559  2538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5741b07c783e4193be39d19fba6c5cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:30.076009  2545 ts_tablet_manager.cc:1434] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.000s
I20260709 12:57:30.114603  1693 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-22d7b940a3774b7fbb80a3a69355356b received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:30.115121  1693 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-22d7b940a3774b7fbb80a3a69355356b on tablet 22d7b940a3774b7fbb80a3a69355356b with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:30.162482  1604 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:30.164702  2377 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:30.168715  2538 tablet_copy_client.cc:806] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:30.169407  2538 tablet_copy_client.cc:670] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:30.175505  2538 tablet_copy_client.cc:538] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:30.185494  2538 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:30.204026  1527 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:30.210783  2164 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:30.262977  2538 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:30.263952  2538 tablet_bootstrap.cc:492] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:30.264840  2538 ts_tablet_manager.cc:1403] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.080s	user 0.027s	sys 0.005s
I20260709 12:57:30.267927  2538 raft_consensus.cc:359] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:30.268769  2538 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:30.269383  2538 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:30.277701  2538 ts_tablet_manager.cc:1434] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:57:30.281489  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-5741b07c783e4193be39d19fba6c5cec received from {username='slave'} at 127.0.0.1:56224
I20260709 12:57:30.282013  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-5741b07c783e4193be39d19fba6c5cec on tablet 5741b07c783e4193be39d19fba6c5cec with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:30.342955  2476 raft_consensus.cc:1217] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:30.444383  2476 raft_consensus.cc:1217] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:30.479255  2377 raft_consensus.cc:1064] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:30.482849  2377 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:30.497946  2197 raft_consensus.cc:1064] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:30.501181  2197 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:30.508503  1603 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:30.510058  2164 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:30.514038  2476 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:30.517002  2173 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:30.537124  1528 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:30.544596  2475 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:30.546774  2147 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:30.553105  1603 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:30.554675  2173 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:30.559429  2197 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:30.570137  1676 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:30.577960  2197 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:30.586786  2185 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.587996  2475 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.588310  2568 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.602217  2476 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.606526  1604 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.615125  1431 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.653927  1682 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.721683  1429 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.674408  1603 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:57:30.825165  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 70026.8us
I20260709 12:57:30.842113  1527 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.892575  2432 raft_consensus.cc:1064] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
W20260709 12:57:30.894575  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.895265  2432 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:30.918418  2476 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:30.918555  1527 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:30.920207  2408 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:30.922075  2408 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:30.923466  1676 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:30.925999  2140 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:30.942024  1683 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:30.943547  2377 raft_consensus.cc:1064] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:30.948500  2475 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:30.951907  2567 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:30.957856  1527 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:30.963027  2173 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.964447  2476 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:30.965996  2579 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:30.966931  2476 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.970762  1604 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:30.974151  2197 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:30.980170  2377 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:30.981777  2197 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.987111  1428 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.990263  1604 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:30.990432  2476 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:30.992905  2568 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:30.999327  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f1e53da9e94a8e8859328c4a06b68a with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:31.010958  2583 tablet_replica.cc:333] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:31.016479  1429 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.019553  2583 raft_consensus.cc:2243] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:31.020354  2583 raft_consensus.cc:2272] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:31.027397  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b00f4dc45e904f49a3231fc0c487b88d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:31.029386  2583 ts_tablet_manager.cc:1916] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:31.028725  1600 raft_consensus.cc:2955] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.039741  1428 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet b00f4dc45e904f49a3231fc0c487b88d with cas_config_opid_index 3: aborting the task: latest config opid_index 4; task opid_index 3
I20260709 12:57:31.062505  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet b00f4dc45e904f49a3231fc0c487b88d with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:31.075680  2587 tablet_replica.cc:333] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:31.102563  2587 raft_consensus.cc:2243] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:31.089627  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77f1e53da9e94a8e8859328c4a06b68a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:31.090873  2476 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:31.093466  1527 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:31.098470  2408 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.115195  2587 raft_consensus.cc:2272] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:31.120458  2587 ts_tablet_manager.cc:1916] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:31.125413  1675 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.109413  2583 ts_tablet_manager.cc:1929] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:31.126310  2173 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:57:31.086002  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 51468.1us
I20260709 12:57:31.136175  2583 log.cc:1199] T 77f1e53da9e94a8e8859328c4a06b68a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/77f1e53da9e94a8e8859328c4a06b68a
I20260709 12:57:31.137627  2396 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:31.150727  1600 raft_consensus.cc:2955] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.162616  1603 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:31.172537  2475 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.176297  1431 catalog_manager.cc:5697] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:31.183285  2173 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:31.200734  1603 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:31.203699  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 77f1e53da9e94a8e8859328c4a06b68a (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:31.205595  1529 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.220194  2396 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.224500  1682 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:31.217516  2587 ts_tablet_manager.cc:1929] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:31.232002  2587 log.cc:1199] T b00f4dc45e904f49a3231fc0c487b88d P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/b00f4dc45e904f49a3231fc0c487b88d
I20260709 12:57:31.233769  2408 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:31.236320  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet b00f4dc45e904f49a3231fc0c487b88d (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:31.222716  1528 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.248751  2476 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.259356  2408 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.266484  2476 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:31.268538  1431 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.279542  1604 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.269872  1682 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.325084  1675 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:31.349900  2476 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:31.351887  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5741b07c783e4193be39d19fba6c5cec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:31.355772  2396 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:31.358547  1528 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:31.361822  2173 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:31.368427  2377 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.376709  1431 catalog_manager.cc:5697] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.380378  2476 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.395556  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22d7b940a3774b7fbb80a3a69355356b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:31.397379  2585 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:31.402323  1528 raft_consensus.cc:2955] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.409282  1428 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.416810  2476 raft_consensus.cc:2955] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:31.437119  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 22d7b940a3774b7fbb80a3a69355356b with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:31.440460  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 5741b07c783e4193be39d19fba6c5cec with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:31.441421  2583 tablet_replica.cc:333] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:31.469455  2591 tablet_replica.cc:333] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:31.470916  2583 raft_consensus.cc:2243] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:31.471477  2591 raft_consensus.cc:2243] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:31.471953  2583 raft_consensus.cc:2272] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:31.472275  2591 raft_consensus.cc:2272] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:31.475991  2583 ts_tablet_manager.cc:1916] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:31.489120  2591 ts_tablet_manager.cc:1916] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:31.508198  2591 ts_tablet_manager.cc:1929] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:31.508661  2591 log.cc:1199] T 22d7b940a3774b7fbb80a3a69355356b P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/22d7b940a3774b7fbb80a3a69355356b
I20260709 12:57:31.510319  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 22d7b940a3774b7fbb80a3a69355356b (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:31.520071  2583 ts_tablet_manager.cc:1929] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:31.520640  2583 log.cc:1199] T 5741b07c783e4193be39d19fba6c5cec P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/5741b07c783e4193be39d19fba6c5cec
I20260709 12:57:31.522404  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 5741b07c783e4193be39d19fba6c5cec (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:32.543717  1528 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
W20260709 12:57:32.551568  1500 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8085a85190ed479aa2fc71cd75382085. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:32.553078  1682 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:32.555140  1603 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:32.556402  2147 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:32.558519  2147 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:32.566095  2147 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.569279  1683 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.577461  1603 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.586956  1682 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:32.592463  1431 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:32.607676  1600 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:32.610956  1528 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:32.611253  2377 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:32.612926  1649 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10ddaea2d1d945b78d8286cc74a41ff9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:32.613934  2396 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:32.636179  2377 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.644837  1600 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.641528  1527 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.686679  1430 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.684561  1532 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
W20260709 12:57:32.758982  1500 consensus_peers.cc:597] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c5fb2214fbb40f0a702dbf5aa32966f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:32.760530  1600 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:32.763437  2596 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:32.783524  2147 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.788256  1675 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:32.802314  1600 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.806775  1675 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:32.813309  1430 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:32.823629  2147 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:32.846647  1600 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:32.850492  1532 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:32.852393  2606 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 12:57:32.856156  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e38d8589e334785b807e494aae5aea4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:32.861406  2606 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:32.857892  1682 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.878392  2612 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.890456  1600 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.892573  1532 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:32.919804  1431 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 4, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:33.094156  2615 ts_tablet_manager.cc:933] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:33.096904  2615 tablet_copy_client.cc:323] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:33.098737  1693 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 10ddaea2d1d945b78d8286cc74a41ff9 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:33.099313  1693 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 10ddaea2d1d945b78d8286cc74a41ff9 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-10ddaea2d1d945b78d8286cc74a41ff9
I20260709 12:57:33.107594  1693 tablet_copy_source_session.cc:215] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:33.113591  2615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ddaea2d1d945b78d8286cc74a41ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:33.133767  2615 tablet_copy_client.cc:806] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:33.134593  2615 tablet_copy_client.cc:670] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:33.196060  2615 tablet_copy_client.cc:538] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:33.198532  2617 ts_tablet_manager.cc:933] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:33.217182  2615 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:33.218063  2617 tablet_copy_client.cc:323] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:33.221963  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet 8085a85190ed479aa2fc71cd75382085 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:33.222520  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet 8085a85190ed479aa2fc71cd75382085 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-8085a85190ed479aa2fc71cd75382085
I20260709 12:57:33.231519  1544 tablet_copy_source_session.cc:215] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:33.234848  2617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8085a85190ed479aa2fc71cd75382085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:33.260463  2617 tablet_copy_client.cc:806] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:33.261109  2617 tablet_copy_client.cc:670] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:33.264956  2617 tablet_copy_client.cc:538] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:33.268667  2615 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:33.274677  2617 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:33.275035  2620 ts_tablet_manager.cc:933] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:33.274787  2615 tablet_bootstrap.cc:492] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:33.277029  2615 ts_tablet_manager.cc:1403] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.060s	user 0.027s	sys 0.007s
I20260709 12:57:33.280390  2615 raft_consensus.cc:359] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:33.281299  2615 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:33.282022  2615 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:33.313364  2620 tablet_copy_client.cc:323] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:33.315440  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet 7c5fb2214fbb40f0a702dbf5aa32966f from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:33.315972  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet 7c5fb2214fbb40f0a702dbf5aa32966f from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-7c5fb2214fbb40f0a702dbf5aa32966f
I20260709 12:57:33.373262  2623 ts_tablet_manager.cc:933] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:33.390089  2623 tablet_copy_client.cc:323] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:33.391877  1693 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 9e38d8589e334785b807e494aae5aea4 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:33.392639  1693 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 9e38d8589e334785b807e494aae5aea4 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-9e38d8589e334785b807e494aae5aea4
I20260709 12:57:33.399061  2615 ts_tablet_manager.cc:1434] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.122s	user 0.035s	sys 0.060s
I20260709 12:57:33.402045  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-10ddaea2d1d945b78d8286cc74a41ff9 received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:33.402110  1693 tablet_copy_source_session.cc:215] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:33.402607  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-10ddaea2d1d945b78d8286cc74a41ff9 on tablet 10ddaea2d1d945b78d8286cc74a41ff9 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:33.406071  2623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e38d8589e334785b807e494aae5aea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:33.433148  1544 tablet_copy_source_session.cc:215] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:33.447890  2623 tablet_copy_client.cc:806] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:33.450110  2623 tablet_copy_client.cc:670] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:33.452283  2620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5fb2214fbb40f0a702dbf5aa32966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:33.454592  2623 tablet_copy_client.cc:538] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:33.464030  2623 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:33.484511  2620 tablet_copy_client.cc:806] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:33.485121  2620 tablet_copy_client.cc:670] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:33.488095  2617 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:33.489506  2617 tablet_bootstrap.cc:492] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:33.490351  2617 ts_tablet_manager.cc:1403] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.216s	user 0.024s	sys 0.007s
I20260709 12:57:33.496742  2617 raft_consensus.cc:359] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:33.498126  2617 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:33.498885  2617 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:33.557864  2617 ts_tablet_manager.cc:1434] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.003s
I20260709 12:57:33.568557  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-8085a85190ed479aa2fc71cd75382085 received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:33.569708  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-8085a85190ed479aa2fc71cd75382085 on tablet 8085a85190ed479aa2fc71cd75382085 with peer 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:57:33.573352  2623 log.cc:927] Time spent T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 12:57:33.585912  2620 tablet_copy_client.cc:538] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:33.593425  2623 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:33.628369  2623 tablet_bootstrap.cc:492] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:33.629818  2623 ts_tablet_manager.cc:1403] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.166s	user 0.034s	sys 0.003s
I20260709 12:57:33.646777  2623 raft_consensus.cc:359] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:33.650450  2623 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:33.651497  2623 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:33.657644  2620 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:33.658249  2623 ts_tablet_manager.cc:1434] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.004s
I20260709 12:57:33.666601  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-9e38d8589e334785b807e494aae5aea4 received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:33.667057  2475 raft_consensus.cc:1217] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:33.667678  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-9e38d8589e334785b807e494aae5aea4 on tablet 9e38d8589e334785b807e494aae5aea4 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:33.691051  2475 raft_consensus.cc:1217] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:33.809537  2620 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:33.813856  2620 tablet_bootstrap.cc:492] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:33.814546  2620 ts_tablet_manager.cc:1403] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.157s	user 0.021s	sys 0.016s
I20260709 12:57:33.822578  2620 raft_consensus.cc:359] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:33.823493  2620 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:33.824184  2620 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:33.833021  2620 ts_tablet_manager.cc:1434] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:57:33.849978  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-7c5fb2214fbb40f0a702dbf5aa32966f received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:33.850543  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-7c5fb2214fbb40f0a702dbf5aa32966f on tablet 7c5fb2214fbb40f0a702dbf5aa32966f with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:33.934310  2475 raft_consensus.cc:1217] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:57:34.019305  2634 raft_consensus.cc:1064] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:34.022246  2634 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:34.038044  1604 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:34.041767  2626 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:34.046855  2475 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:34.048764  1527 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:34.058252  2634 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:34.063526  2634 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:34.096616  2626 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.101272  2596 raft_consensus.cc:1064] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:34.105870  2596 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:34.111351  2475 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.134315  1604 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.146384  1528 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.160389  1430 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.192123  2476 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:34.194290  2625 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:34.215332  1604 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:34.217938  2625 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:34.239993  1683 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:34.270388  2625 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:34.287263  2596 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.308916  2476 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.351609  1603 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.372164  1678 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.405788  2476 raft_consensus.cc:1217] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:34.441603  1678 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:34.457233  1430 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.462005  2476 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:34.464038  2396 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:34.474339  1527 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:34.481788  2626 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.488950  2634 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:34.502343  1527 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:34.505606  2476 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.508827  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10ddaea2d1d945b78d8286cc74a41ff9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:34.515580  1532 raft_consensus.cc:2955] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.522248  1432 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:34.533010  2396 raft_consensus.cc:1064] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:34.535476  2396 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:34.550801  2475 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:34.552588  2646 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:34.554749  2475 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:57:34.560128  2634 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:34.560478  1600 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:57:34.562837  2596 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.563930  2626 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:34.567813  1528 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:57:34.569758  1603 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:34.572926  2625 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:34.574162  2474 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.577998  1600 raft_consensus.cc:2955] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.586907  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8085a85190ed479aa2fc71cd75382085 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:34.596271  1430 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:34.605971  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 10ddaea2d1d945b78d8286cc74a41ff9 with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:34.609958  2654 tablet_replica.cc:333] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:34.615561  2654 raft_consensus.cc:2243] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:34.624308  2606 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:34.652344  2654 raft_consensus.cc:2272] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:34.664126  2654 ts_tablet_manager.cc:1916] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:34.687239  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet 8085a85190ed479aa2fc71cd75382085 with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:34.685257  2634 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.694059  2474 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.705936  2657 tablet_replica.cc:333] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:34.707294  2657 raft_consensus.cc:2243] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:34.708128  2657 raft_consensus.cc:2272] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:34.708197  1528 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.724922  2657 ts_tablet_manager.cc:1916] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:34.731503  1600 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.754479  1429 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:34.764663  2657 ts_tablet_manager.cc:1929] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:34.772436  2657 log.cc:1199] T 8085a85190ed479aa2fc71cd75382085 P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/8085a85190ed479aa2fc71cd75382085
I20260709 12:57:34.776127  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet 8085a85190ed479aa2fc71cd75382085 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:34.791783  1678 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:34.797640  2654 ts_tablet_manager.cc:1929] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:34.798156  2654 log.cc:1199] T 10ddaea2d1d945b78d8286cc74a41ff9 P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/10ddaea2d1d945b78d8286cc74a41ff9
I20260709 12:57:34.799853  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 10ddaea2d1d945b78d8286cc74a41ff9 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:34.802764  1528 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:34.804734  2474 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:34.808190  2626 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:34.815790  2396 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:34.835163  2634 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.843935  2474 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.844866  1528 raft_consensus.cc:2955] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:34.861385  1429 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 5 to 6, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:34.864183  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e38d8589e334785b807e494aae5aea4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:34.876966  2625 raft_consensus.cc:1064] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:34.884263  2625 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:34.892797  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e38d8589e334785b807e494aae5aea4 with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:34.893831  2654 tablet_replica.cc:333] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:34.894953  2654 raft_consensus.cc:2243] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:34.895735  2654 raft_consensus.cc:2272] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:34.902355  2654 ts_tablet_manager.cc:1916] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:34.933140  1678 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:34.934749  2474 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:34.934718  2646 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:34.943397  2646 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:34.974022  1604 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:34.984350  2654 ts_tablet_manager.cc:1929] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:57:34.984993  2654 log.cc:1199] T 9e38d8589e334785b807e494aae5aea4 P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/9e38d8589e334785b807e494aae5aea4
I20260709 12:57:34.985234  2646 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:34.986971  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 9e38d8589e334785b807e494aae5aea4 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:34.997449  2625 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.002905  2474 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.024379  1431 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.026046  1604 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.036062  1678 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.046319  1528 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:35.054530  2474 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:35.056191  2659 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:35.056403  1600 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:35.060493  2659 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:35.068768  2646 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.070526  2476 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.089496  1600 raft_consensus.cc:2955] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.089622  1430 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:35.102759  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c5fb2214fbb40f0a702dbf5aa32966f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:35.112674  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c5fb2214fbb40f0a702dbf5aa32966f with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:35.113654  2657 tablet_replica.cc:333] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:35.155458  2657 raft_consensus.cc:2243] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.156627  2657 raft_consensus.cc:2272] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.160483  2657 ts_tablet_manager.cc:1916] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:35.183655  2657 ts_tablet_manager.cc:1929] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:35.184146  2657 log.cc:1199] T 7c5fb2214fbb40f0a702dbf5aa32966f P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/7c5fb2214fbb40f0a702dbf5aa32966f
I20260709 12:57:35.186899  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet 7c5fb2214fbb40f0a702dbf5aa32966f (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
W20260709 12:57:36.214350  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 70600.5us
I20260709 12:57:36.237025  1604 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:36.243554  1683 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:57:36.247315  1575 consensus_peers.cc:597] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00631bb4062844edb73eb9b0810cc59c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:36.249161  2663 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:36.250730  1532 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:36.252116  2663 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:36.269610  2669 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.271076  1532 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.274719  1683 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.287545  1527 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:36.298239  1430 catalog_manager.cc:5697] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.318763  1603 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:36.319641  1681 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:57:36.320873  1500 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f32dbc3da8894f6cbbf52b501c537a5b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:36.324447  2646 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:36.327047  2646 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:36.344123  2665 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.346529  1603 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.354175  1681 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.373118  1429 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.389669  1603 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:36.408880  1681 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:36.411414  2663 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:36.412395  1527 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:57:36.415225  1575 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e050081dd8c146df92c3ba8d2500e7f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:36.417689  2663 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:36.421289  2408 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.423025  1683 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.458932  1683 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:36.462628  1430 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:36.474953  1527 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.495811  1603 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:36.498757  2664 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:36.504702  1527 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:36.506889  2664 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:36.508942  1649 consensus_peers.cc:597] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7340b50d876f414287d4fe7df22e3248. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:36.517693  2684 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.521438  1527 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.531678  1600 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.551761  1430 catalog_manager.cc:5697] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:36.717964  2691 ts_tablet_manager.cc:933] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:36.720168  2691 tablet_copy_client.cc:323] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:57:36.722420  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 00631bb4062844edb73eb9b0810cc59c from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:57:36.722988  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 00631bb4062844edb73eb9b0810cc59c from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-00631bb4062844edb73eb9b0810cc59c
I20260709 12:57:36.767143  1619 tablet_copy_source_session.cc:215] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:36.776085  2691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00631bb4062844edb73eb9b0810cc59c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.795374  2691 tablet_copy_client.cc:806] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:36.796149  2691 tablet_copy_client.cc:670] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:36.804812  2691 tablet_copy_client.cc:538] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:36.816162  2691 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:36.837926  2693 ts_tablet_manager.cc:933] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:36.850586  2694 ts_tablet_manager.cc:933] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:36.864691  2691 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:36.865916  2691 tablet_bootstrap.cc:492] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:36.867134  2691 ts_tablet_manager.cc:1403] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.015s
I20260709 12:57:36.870944  2691 raft_consensus.cc:359] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:36.872031  2691 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:36.872903  2691 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:36.874259  2694 tablet_copy_client.cc:323] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:36.876592  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet f32dbc3da8894f6cbbf52b501c537a5b from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:36.877319  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet f32dbc3da8894f6cbbf52b501c537a5b from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-f32dbc3da8894f6cbbf52b501c537a5b
I20260709 12:57:36.884625  2691 ts_tablet_manager.cc:1434] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.007s
I20260709 12:57:36.887140  1544 tablet_copy_source_session.cc:215] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:36.890522  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-00631bb4062844edb73eb9b0810cc59c received from {username='slave'} at 127.0.0.1:56224
I20260709 12:57:36.893831  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-00631bb4062844edb73eb9b0810cc59c on tablet 00631bb4062844edb73eb9b0810cc59c with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:36.897866  2694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32dbc3da8894f6cbbf52b501c537a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.913789  2694 tablet_copy_client.cc:806] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:36.914414  2694 tablet_copy_client.cc:670] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:36.916893  2693 tablet_copy_client.cc:323] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:57:36.919251  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet e050081dd8c146df92c3ba8d2500e7f0 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:57:36.919806  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet e050081dd8c146df92c3ba8d2500e7f0 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-e050081dd8c146df92c3ba8d2500e7f0
I20260709 12:57:36.926409  2694 tablet_copy_client.cc:538] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:36.938970  2694 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:36.939865  1619 tablet_copy_source_session.cc:215] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:36.952984  2693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e050081dd8c146df92c3ba8d2500e7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:37.017686  2693 tablet_copy_client.cc:806] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:37.018632  2693 tablet_copy_client.cc:670] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:37.029259  2693 tablet_copy_client.cc:538] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:37.039222  2693 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:37.097275  2691 ts_tablet_manager.cc:933] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:37.108242  2693 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:37.116182  2691 tablet_copy_client.cc:323] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:37.118489  2693 tablet_bootstrap.cc:492] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:37.119345  2693 ts_tablet_manager.cc:1403] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.012s
I20260709 12:57:37.119407  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 7340b50d876f414287d4fe7df22e3248 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:37.120070  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 7340b50d876f414287d4fe7df22e3248 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-7340b50d876f414287d4fe7df22e3248
I20260709 12:57:37.122963  2693 raft_consensus.cc:359] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:37.124491  2693 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:37.126001  2693 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:37.132423  2693 ts_tablet_manager.cc:1434] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:57:37.140776  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-e050081dd8c146df92c3ba8d2500e7f0 received from {username='slave'} at 127.0.0.1:56224
I20260709 12:57:37.141223  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-e050081dd8c146df92c3ba8d2500e7f0 on tablet e050081dd8c146df92c3ba8d2500e7f0 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:37.145077  1692 tablet_copy_source_session.cc:215] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:37.150053  2691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7340b50d876f414287d4fe7df22e3248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:37.194502  2691 tablet_copy_client.cc:806] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:37.195243  2691 tablet_copy_client.cc:670] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:37.207823  2694 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:37.208902  2694 tablet_bootstrap.cc:492] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:37.210441  2694 ts_tablet_manager.cc:1403] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.272s	user 0.060s	sys 0.075s
I20260709 12:57:37.209331  2691 tablet_copy_client.cc:538] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:37.223600  2691 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:37.224387  2694 raft_consensus.cc:359] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:37.225543  2694 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:37.226306  2694 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:37.234615  2694 ts_tablet_manager.cc:1434] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 12:57:37.240248  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-f32dbc3da8894f6cbbf52b501c537a5b received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:37.240790  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-f32dbc3da8894f6cbbf52b501c537a5b on tablet f32dbc3da8894f6cbbf52b501c537a5b with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:37.276078  2476 raft_consensus.cc:1217] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:37.280560  2691 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:37.281498  2691 tablet_bootstrap.cc:492] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:37.282258  2691 ts_tablet_manager.cc:1403] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.059s	user 0.036s	sys 0.005s
I20260709 12:57:37.291697  2476 raft_consensus.cc:1217] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:37.285272  2691 raft_consensus.cc:359] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:37.298280  2691 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:37.298975  2691 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:37.301456  2691 ts_tablet_manager.cc:1434] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:57:37.303318  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-7340b50d876f414287d4fe7df22e3248 received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:37.304018  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-7340b50d876f414287d4fe7df22e3248 on tablet 7340b50d876f414287d4fe7df22e3248 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:37.346498  2476 raft_consensus.cc:1217] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:37.480275  2476 raft_consensus.cc:1217] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:57:37.502663  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 69362.5us
I20260709 12:57:37.765666  2705 raft_consensus.cc:1064] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:37.768580  2705 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:37.783191  1682 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:37.786190  2476 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:37.786821  2663 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:37.788249  2408 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:37.796798  1532 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:37.799389  2408 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:37.821731  2663 raft_consensus.cc:1064] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:37.824225  2663 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:37.825217  2682 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.842942  1527 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.845660  2665 raft_consensus.cc:1064] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:37.845659  2474 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.848438  2665 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:37.861781  1678 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.863976  1430 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.873847  1682 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:37.882278  2702 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:37.874598  2474 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:37.876434  1600 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:37.891153  2702 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:37.905835  2665 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:37.908807  2684 raft_consensus.cc:1064] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:37.911460  2684 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:37.922384  2476 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:37.923202  1678 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:37.923735  2682 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:37.925849  2408 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:37.938817  1527 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:37.940160  2682 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:37.951010  2666 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.952841  2474 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.968863  2408 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.971282  1678 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:37.973815  1603 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:37.977029  2476 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:37.977047  2704 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:37.980630  2688 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:37.988740  1678 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.015503  1527 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:38.023016  1527 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.023875  2474 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.021452  2704 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:57:38.033870  1608 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.034045  2689 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.038105  1603 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.057868  2475 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.070962  1432 catalog_manager.cc:5697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:38.090857  1431 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.092981  1431 catalog_manager.cc:5697] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:38.100749  1604 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:38.131726  2475 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:38.133486  2725 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:38.137380  1527 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:38.145547  2474 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:38.147069  2665 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:38.146059  2682 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.147904  1602 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:38.159412  2475 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.161218  1528 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:38.161450  2665 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.163564  2476 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.164130  1527 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.169857  2726 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:38.171661  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e050081dd8c146df92c3ba8d2500e7f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:38.178395  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f32dbc3da8894f6cbbf52b501c537a5b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:38.179143  1678 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:38.182193  1683 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:38.186465  2665 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:38.180722  1528 raft_consensus.cc:2955] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.188822  1604 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:38.190246  2689 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:38.196108  2475 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:38.199580  1432 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:38.203431  2475 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:38.203835  1683 raft_consensus.cc:2955] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.203783  2684 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.206548  1681 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:38.206418  2688 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:38.231907  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet f32dbc3da8894f6cbbf52b501c537a5b with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:38.236447  2729 tablet_replica.cc:333] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:38.237772  2729 raft_consensus.cc:2243] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:38.237977  2682 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:38.238648  2729 raft_consensus.cc:2272] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:38.241163  2682 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:38.242138  2729 ts_tablet_manager.cc:1916] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:38.237782  1429 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.246136  2476 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.266753  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet e050081dd8c146df92c3ba8d2500e7f0 with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:38.267858  2726 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.278833  2474 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.284250  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 00631bb4062844edb73eb9b0810cc59c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:38.208765  1604 raft_consensus.cc:2955] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.293210  1431 catalog_manager.cc:5697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:38.292974  1678 raft_consensus.cc:2955] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:38.311036  1429 catalog_manager.cc:5697] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:38.314177  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7340b50d876f414287d4fe7df22e3248 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:38.317488  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 00631bb4062844edb73eb9b0810cc59c with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:38.321101  2729 ts_tablet_manager.cc:1929] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:38.321641  2729 log.cc:1199] T f32dbc3da8894f6cbbf52b501c537a5b P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/f32dbc3da8894f6cbbf52b501c537a5b
I20260709 12:57:38.324715  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet f32dbc3da8894f6cbbf52b501c537a5b (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:38.325129  2730 tablet_replica.cc:333] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:38.326306  2730 raft_consensus.cc:2243] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:38.328450  2731 tablet_replica.cc:333] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:38.334205  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 7340b50d876f414287d4fe7df22e3248 with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:38.329224  2730 raft_consensus.cc:2272] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:38.346968  2730 ts_tablet_manager.cc:1916] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:38.362049  2731 raft_consensus.cc:2243] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:38.362979  2731 raft_consensus.cc:2272] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:38.366920  2731 ts_tablet_manager.cc:1916] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:38.366927  2730 ts_tablet_manager.cc:1929] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:38.367691  2730 log.cc:1199] T e050081dd8c146df92c3ba8d2500e7f0 P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/e050081dd8c146df92c3ba8d2500e7f0
I20260709 12:57:38.369676  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet e050081dd8c146df92c3ba8d2500e7f0 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:38.379171  2731 ts_tablet_manager.cc:1929] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:38.379598  2731 log.cc:1199] T 00631bb4062844edb73eb9b0810cc59c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/00631bb4062844edb73eb9b0810cc59c
I20260709 12:57:38.381029  2731 tablet_replica.cc:333] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:38.380996  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 00631bb4062844edb73eb9b0810cc59c (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:38.382032  2731 raft_consensus.cc:2243] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:38.382676  2731 raft_consensus.cc:2272] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:38.386354  2731 ts_tablet_manager.cc:1916] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:38.399205  2731 ts_tablet_manager.cc:1929] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:38.399742  2731 log.cc:1199] T 7340b50d876f414287d4fe7df22e3248 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/7340b50d876f414287d4fe7df22e3248
I20260709 12:57:38.401266  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 7340b50d876f414287d4fe7df22e3248 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:39.402768  1683 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
W20260709 12:57:39.410660  1649 consensus_peers.cc:597] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 390bda9334de482bb1f2274e10fe5743. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:39.411084  1604 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.412164  1528 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.412364  2689 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.414309  2688 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.424329  2736 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.429934  1602 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.430682  1532 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.441526  1528 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:39.451894  1428 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:39.458463  1500 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d859537ee3eb49969dd821b3f75dd33e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:39.461237  1602 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:39.461766  1678 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:39.463028  2702 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:39.466778  2738 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:39.480574  2702 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.482945  1600 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.506844  1600 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:39.506628  1678 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.519282  1681 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.520967  2726 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.522657  1528 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:39.534881  2726 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.539986  2705 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.542061  1681 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
W20260709 12:57:39.548357  1575 consensus_peers.cc:597] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b381ac61d4149f096c7f58d4c53f925. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:39.567003  1678 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:39.567987  1431 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.569794  1431 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.589313  1528 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.614188  1600 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:39.615530  2689 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:57:39.616585  1649 consensus_peers.cc:597] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71c02c60c1a5490183c0690cd8c98176. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:39.616864  1528 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:39.618484  2689 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:39.624871  2736 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.629458  1532 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.629458  1600 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:39.643878  1428 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:39.854931  2754 ts_tablet_manager.cc:933] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:39.856941  2754 tablet_copy_client.cc:323] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:39.858938  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 390bda9334de482bb1f2274e10fe5743 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:39.859483  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 390bda9334de482bb1f2274e10fe5743 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-390bda9334de482bb1f2274e10fe5743
I20260709 12:57:39.869145  1692 tablet_copy_source_session.cc:215] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:39.873517  2754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390bda9334de482bb1f2274e10fe5743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:39.888760  2754 tablet_copy_client.cc:806] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:39.889434  2754 tablet_copy_client.cc:670] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:39.894501  2754 tablet_copy_client.cc:538] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:39.904791  2754 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:39.929100  2754 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:39.929884  2754 tablet_bootstrap.cc:492] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:39.930595  2754 ts_tablet_manager.cc:1403] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.010s
I20260709 12:57:39.933712  2754 raft_consensus.cc:359] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:39.934831  2754 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:39.935521  2754 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:39.963754  2754 ts_tablet_manager.cc:1434] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.033s	user 0.013s	sys 0.015s
I20260709 12:57:39.966744  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-390bda9334de482bb1f2274e10fe5743 received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:39.967217  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-390bda9334de482bb1f2274e10fe5743 on tablet 390bda9334de482bb1f2274e10fe5743 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:40.000690  2754 ts_tablet_manager.cc:933] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:40.002802  2754 tablet_copy_client.cc:323] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:57:40.004441  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 9b381ac61d4149f096c7f58d4c53f925 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:57:40.005007  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 9b381ac61d4149f096c7f58d4c53f925 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-9b381ac61d4149f096c7f58d4c53f925
I20260709 12:57:40.012568  1619 tablet_copy_source_session.cc:215] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:40.015486  2754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b381ac61d4149f096c7f58d4c53f925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:40.027076  2754 tablet_copy_client.cc:806] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:40.027737  2754 tablet_copy_client.cc:670] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:40.031818  2754 tablet_copy_client.cc:538] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:40.040349  2754 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:40.061900  2754 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:40.063004  2754 tablet_bootstrap.cc:492] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:40.063916  2754 ts_tablet_manager.cc:1403] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 12:57:40.067055  2754 raft_consensus.cc:359] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:40.068017  2754 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:40.075336  2754 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:40.081418  2754 ts_tablet_manager.cc:1434] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:57:40.090029  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-9b381ac61d4149f096c7f58d4c53f925 received from {username='slave'} at 127.0.0.1:56224
I20260709 12:57:40.090559  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-9b381ac61d4149f096c7f58d4c53f925 on tablet 9b381ac61d4149f096c7f58d4c53f925 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:40.097923  2754 ts_tablet_manager.cc:933] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:40.102517  2754 tablet_copy_client.cc:323] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:40.104223  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet d859537ee3eb49969dd821b3f75dd33e from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:40.104771  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet d859537ee3eb49969dd821b3f75dd33e from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-d859537ee3eb49969dd821b3f75dd33e
I20260709 12:57:40.111136  1544 tablet_copy_source_session.cc:215] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:40.114118  2754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d859537ee3eb49969dd821b3f75dd33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:40.126327  2760 ts_tablet_manager.cc:933] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:40.130905  2754 tablet_copy_client.cc:806] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:40.131515  2754 tablet_copy_client.cc:670] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:40.136046  2754 tablet_copy_client.cc:538] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:40.138861  2760 tablet_copy_client.cc:323] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:40.140615  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 71c02c60c1a5490183c0690cd8c98176 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:40.141106  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 71c02c60c1a5490183c0690cd8c98176 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-71c02c60c1a5490183c0690cd8c98176
I20260709 12:57:40.146647  2754 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:40.148453  1692 tablet_copy_source_session.cc:215] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:40.154886  2760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c02c60c1a5490183c0690cd8c98176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:40.167508  2754 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:40.168248  2754 tablet_bootstrap.cc:492] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:40.168756  2754 ts_tablet_manager.cc:1403] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:57:40.170809  2754 raft_consensus.cc:359] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:40.171360  2754 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:40.171814  2754 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:40.172829  2760 tablet_copy_client.cc:806] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:40.173584  2754 ts_tablet_manager.cc:1434] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:57:40.173413  2760 tablet_copy_client.cc:670] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:40.176353  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-d859537ee3eb49969dd821b3f75dd33e received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:40.176810  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-d859537ee3eb49969dd821b3f75dd33e on tablet d859537ee3eb49969dd821b3f75dd33e with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:40.183331  2760 tablet_copy_client.cc:538] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:40.200320  2760 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:40.228757  2760 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:40.229712  2760 tablet_bootstrap.cc:492] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:40.230369  2760 ts_tablet_manager.cc:1403] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.003s
I20260709 12:57:40.234441  2760 raft_consensus.cc:359] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:40.235112  2760 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:40.235705  2760 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:40.238166  2760 ts_tablet_manager.cc:1434] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:40.239945  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-71c02c60c1a5490183c0690cd8c98176 received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:40.240398  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-71c02c60c1a5490183c0690cd8c98176 on tablet 71c02c60c1a5490183c0690cd8c98176 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:40.438609  2474 raft_consensus.cc:1217] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:40.513659  2474 raft_consensus.cc:1217] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:40.529692  2474 raft_consensus.cc:1217] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:40.542759  2474 raft_consensus.cc:1217] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:40.902714  2735 raft_consensus.cc:1064] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:40.904819  2735 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:40.914160  1604 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.916579  2689 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:40.916785  2474 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.917724  1528 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:40.919876  2688 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:40.921437  2689 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:40.939602  2688 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:40.951771  2476 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:40.964107  1604 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:40.968044  1431 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:40.972965  1528 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:40.975334  2749 raft_consensus.cc:1064] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:40.988205  2749 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:41.028882  2476 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:41.031987  2767 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:41.037192  1681 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:41.037416  1528 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:41.042433  2774 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:41.051636  2780 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:41.061636  2743 raft_consensus.cc:1064] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:41.064119  2743 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:41.071329  1678 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:41.087158  2476 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:41.092619  1604 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:41.092943  2773 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.095245  2476 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:41.095461  2688 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.097622  2767 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.098942  2702 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.109156  2773 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.114025  1608 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:41.117079  1678 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:41.117332  1533 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.120520  1604 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.121678  2766 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.122102  2474 raft_consensus.cc:2955] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.124270  2766 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.135881  2476 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.147159  1429 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.156854  1681 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.164971  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 390bda9334de482bb1f2274e10fe5743 with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:41.170498  2689 raft_consensus.cc:1064] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:41.176023  2689 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:41.180621  1432 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.183125  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 390bda9334de482bb1f2274e10fe5743 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:41.196269  1604 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:41.198485  2476 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:41.199816  1533 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:41.200249  2785 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.203847  2788 tablet_replica.cc:333] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:41.204921  2788 raft_consensus.cc:2243] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:41.205694  2788 raft_consensus.cc:2272] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:41.210505  2788 ts_tablet_manager.cc:1916] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:41.210290  2476 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.213793  2688 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.215909  1608 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:41.217654  2772 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.218528  2773 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.229483  1533 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:41.229488  2461 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:41.232679  2780 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.234536  2780 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.244695  2774 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.246336  1681 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.249267  1528 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.250303  2461 raft_consensus.cc:2955] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.260170  1600 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.263911  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b381ac61d4149f096c7f58d4c53f925 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:41.278260  2773 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.279963  1429 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:41.281816  1431 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:41.297845  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b381ac61d4149f096c7f58d4c53f925 with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:41.314659  1532 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:41.318450  1600 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.323848  1678 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:41.324986  1528 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.326395  2476 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:41.349153  2474 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.326602  2788 ts_tablet_manager.cc:1929] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:41.350843  2788 log.cc:1199] T 390bda9334de482bb1f2274e10fe5743 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/390bda9334de482bb1f2274e10fe5743
I20260709 12:57:41.344390  2785 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:41.353591  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 390bda9334de482bb1f2274e10fe5743 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:41.354283  2702 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:41.362884  2794 tablet_replica.cc:333] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:41.364444  2794 raft_consensus.cc:2243] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:41.365253  2794 raft_consensus.cc:2272] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:41.364353  2743 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.357079  1429 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.382171  1681 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.376899  2476 raft_consensus.cc:2955] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.397957  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d859537ee3eb49969dd821b3f75dd33e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:41.405035  2794 ts_tablet_manager.cc:1916] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:41.413616  1428 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.417860  1678 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:41.423585  2476 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:41.425295  2773 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:41.431727  1600 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:41.434717  2772 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:41.440922  2773 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.443643  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet d859537ee3eb49969dd821b3f75dd33e with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:41.446024  2476 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.440395  2794 ts_tablet_manager.cc:1929] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:41.451392  2794 log.cc:1199] T 9b381ac61d4149f096c7f58d4c53f925 P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/9b381ac61d4149f096c7f58d4c53f925
I20260709 12:57:41.454301  1600 raft_consensus.cc:2955] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.456007  2795 tablet_replica.cc:333] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:41.457399  2795 raft_consensus.cc:2243] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:41.458406  2795 raft_consensus.cc:2272] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:41.461916  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet 9b381ac61d4149f096c7f58d4c53f925 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:41.462726  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71c02c60c1a5490183c0690cd8c98176 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:41.466207  2795 ts_tablet_manager.cc:1916] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:41.481621  2795 ts_tablet_manager.cc:1929] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:41.482081  2795 log.cc:1199] T d859537ee3eb49969dd821b3f75dd33e P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/d859537ee3eb49969dd821b3f75dd33e
I20260709 12:57:41.483804  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet d859537ee3eb49969dd821b3f75dd33e (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:41.487442  1431 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:41.502897  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 71c02c60c1a5490183c0690cd8c98176 with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:41.503832  2788 tablet_replica.cc:333] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:41.504897  2788 raft_consensus.cc:2243] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:41.506134  2788 raft_consensus.cc:2272] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:41.510102  2788 ts_tablet_manager.cc:1916] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:41.520857  2788 ts_tablet_manager.cc:1929] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:41.521210  2788 log.cc:1199] T 71c02c60c1a5490183c0690cd8c98176 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/71c02c60c1a5490183c0690cd8c98176
I20260709 12:57:41.522734  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 71c02c60c1a5490183c0690cd8c98176 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:42.573232  1528 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:42.580680  1681 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:42.581035  1500 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9df8036dd002479a8e558d2ce8e13e9b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:42.582207  1600 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:42.582171  2743 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.583629  2766 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.592006  1681 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.595263  1608 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.590453  2797 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.613493  1428 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.627347  1528 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:42.641994  1683 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.646405  1600 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.647585  2801 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:57:42.650951  2801 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:42.660161  1500 consensus_peers.cc:597] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32b6ee54d0d6479194b8ac687bbb1754. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:42.672911  2766 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.679975  1683 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.681862  1600 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.706084  1431 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.706363  1600 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
W20260709 12:57:42.713193  1575 consensus_peers.cc:597] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7aa902e4626a464fabe120fcad834ad0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:42.714277  1683 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.714557  1528 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:42.715528  2774 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.716403  2767 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.742952  2774 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.783670  1683 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.798918  1532 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.801138  1429 catalog_manager.cc:5697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.812328  1600 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:42.828114  1532 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:42.829392  1681 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:42.830760  2767 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:42.832818  2814 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:57:42.834854  1575 consensus_peers.cc:597] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1805a53fe3fc412094cd75832a6e1208. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:42.841463  2814 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.843307  1681 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.845110  1532 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:42.860431  1429 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:43.011212  2819 ts_tablet_manager.cc:933] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:43.013427  2819 tablet_copy_client.cc:323] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:43.014917  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet 9df8036dd002479a8e558d2ce8e13e9b from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:43.015494  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet 9df8036dd002479a8e558d2ce8e13e9b from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-9df8036dd002479a8e558d2ce8e13e9b
I20260709 12:57:43.021983  1544 tablet_copy_source_session.cc:215] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:43.024621  2819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df8036dd002479a8e558d2ce8e13e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:43.038877  2819 tablet_copy_client.cc:806] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:43.039433  2819 tablet_copy_client.cc:670] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:43.042825  2819 tablet_copy_client.cc:538] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:43.049489  2819 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:43.066849  2819 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:43.067629  2819 tablet_bootstrap.cc:492] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:43.068220  2819 ts_tablet_manager.cc:1403] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.012s
I20260709 12:57:43.071027  2819 raft_consensus.cc:359] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:43.071668  2819 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:43.072337  2819 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:43.078084  2819 ts_tablet_manager.cc:1434] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:57:43.081032  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-9df8036dd002479a8e558d2ce8e13e9b received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:43.081653  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-9df8036dd002479a8e558d2ce8e13e9b on tablet 9df8036dd002479a8e558d2ce8e13e9b with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:43.139763  2819 ts_tablet_manager.cc:933] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:43.141611  2819 tablet_copy_client.cc:323] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:43.143273  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet 32b6ee54d0d6479194b8ac687bbb1754 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:43.143754  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet 32b6ee54d0d6479194b8ac687bbb1754 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-32b6ee54d0d6479194b8ac687bbb1754
I20260709 12:57:43.150095  1544 tablet_copy_source_session.cc:215] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:43.154495  2819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b6ee54d0d6479194b8ac687bbb1754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:43.171885  2819 tablet_copy_client.cc:806] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:43.172581  2819 tablet_copy_client.cc:670] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:43.176209  2819 tablet_copy_client.cc:538] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:43.183948  2819 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:43.202118  2825 ts_tablet_manager.cc:933] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:43.210726  2825 tablet_copy_client.cc:323] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:57:43.213693  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 7aa902e4626a464fabe120fcad834ad0 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:57:43.214231  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 7aa902e4626a464fabe120fcad834ad0 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-7aa902e4626a464fabe120fcad834ad0
I20260709 12:57:43.221997  2819 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:43.222975  2819 tablet_bootstrap.cc:492] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:43.223632  2819 ts_tablet_manager.cc:1403] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.021s
I20260709 12:57:43.228475  2819 raft_consensus.cc:359] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:43.229420  2819 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:43.230189  2819 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:43.234160  2819 ts_tablet_manager.cc:1434] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 12:57:43.237819  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-32b6ee54d0d6479194b8ac687bbb1754 received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:43.238281  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-32b6ee54d0d6479194b8ac687bbb1754 on tablet 32b6ee54d0d6479194b8ac687bbb1754 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:43.240149  1619 tablet_copy_source_session.cc:215] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:43.246270  2825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa902e4626a464fabe120fcad834ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:43.265408  2825 tablet_copy_client.cc:806] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:43.266064  2825 tablet_copy_client.cc:670] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:43.269610  2825 tablet_copy_client.cc:538] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:43.280596  2825 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:43.305797  2825 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:43.306692  2825 tablet_bootstrap.cc:492] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:43.307389  2825 ts_tablet_manager.cc:1403] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.000s
I20260709 12:57:43.310281  2825 raft_consensus.cc:359] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:43.311113  2825 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:43.311741  2825 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:43.314023  2825 ts_tablet_manager.cc:1434] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:57:43.315625  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-7aa902e4626a464fabe120fcad834ad0 received from {username='slave'} at 127.0.0.1:56224
I20260709 12:57:43.316031  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-7aa902e4626a464fabe120fcad834ad0 on tablet 7aa902e4626a464fabe120fcad834ad0 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:43.333069  2825 ts_tablet_manager.cc:933] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:43.336146  2825 tablet_copy_client.cc:323] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:57:43.338336  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 1805a53fe3fc412094cd75832a6e1208 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:57:43.338912  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 1805a53fe3fc412094cd75832a6e1208 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-1805a53fe3fc412094cd75832a6e1208
I20260709 12:57:43.345889  1619 tablet_copy_source_session.cc:215] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:43.359731  2825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1805a53fe3fc412094cd75832a6e1208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:43.378726  2825 tablet_copy_client.cc:806] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:43.379405  2825 tablet_copy_client.cc:670] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:43.388633  2825 tablet_copy_client.cc:538] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:43.397614  2825 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:43.418948  2825 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:43.419931  2825 tablet_bootstrap.cc:492] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:43.420686  2825 ts_tablet_manager.cc:1403] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.012s
I20260709 12:57:43.423902  2825 raft_consensus.cc:359] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:43.424845  2825 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:43.425513  2825 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:43.427939  2825 ts_tablet_manager.cc:1434] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:57:43.430621  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-1805a53fe3fc412094cd75832a6e1208 received from {username='slave'} at 127.0.0.1:56224
I20260709 12:57:43.431098  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-1805a53fe3fc412094cd75832a6e1208 on tablet 1805a53fe3fc412094cd75832a6e1208 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:43.483191  2476 raft_consensus.cc:1217] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:57:43.567467  2476 raft_consensus.cc:1217] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:43.758349  2476 raft_consensus.cc:1217] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:43.936781  2476 raft_consensus.cc:1217] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:43.973832  2801 raft_consensus.cc:1064] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:43.977432  2801 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:43.997339  1681 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:43.998234  2476 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:44.001238  1604 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:44.002665  2801 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:44.005777  2766 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.014426  2840 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.051020  2800 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.053256  1604 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.053515  1681 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.076483  1428 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.083940  2743 raft_consensus.cc:1064] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:44.083472  2476 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.087146  2743 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:44.141264  2461 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.149292  2766 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.151250  1682 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.153594  2766 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.162101  1604 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.164260  2766 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:44.165509  2800 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.169921  1681 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.180944  1528 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:44.187793  1682 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:44.189121  2476 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:44.189260  2743 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.191854  2801 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.193918  1604 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.205263  2475 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.211067  1429 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:44.225396  2743 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.230301  1682 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.243589  2474 raft_consensus.cc:2955] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.249289  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9df8036dd002479a8e558d2ce8e13e9b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:44.256103  1431 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:44.278632  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 9df8036dd002479a8e558d2ce8e13e9b with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:44.295696  2853 tablet_replica.cc:333] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:44.296871  2838 raft_consensus.cc:1064] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:44.299875  2838 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:44.296941  2853 raft_consensus.cc:2243] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:44.302201  2853 raft_consensus.cc:2272] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:44.306716  2853 ts_tablet_manager.cc:1916] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:44.312556  1682 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:44.314409  2475 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:44.316851  2835 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.317907  2812 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.324657  1528 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:44.326653  2838 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.328375  2853 ts_tablet_manager.cc:1929] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:57:44.329006  2853 log.cc:1199] T 9df8036dd002479a8e558d2ce8e13e9b P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/9df8036dd002479a8e558d2ce8e13e9b
I20260709 12:57:44.334674  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 9df8036dd002479a8e558d2ce8e13e9b (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:44.350183  2835 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.352869  1528 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.352869  2476 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.375349  1431 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.376221  1683 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.396950  1608 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:44.406850  2475 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:44.407362  1528 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:44.411048  2834 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:44.411855  2815 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:44.427834  2815 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.438323  2475 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.442447  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1805a53fe3fc412094cd75832a6e1208 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:44.447070  1528 raft_consensus.cc:2955] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.455056  1431 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:44.457691  2839 raft_consensus.cc:1064] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:44.463723  2839 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:44.468284  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet 1805a53fe3fc412094cd75832a6e1208 with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:44.514463  2858 tablet_replica.cc:333] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:44.515580  2858 raft_consensus.cc:2243] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:44.519228  2858 raft_consensus.cc:2272] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:44.522751  1683 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.524616  1529 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.524986  2475 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:44.527573  2835 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.528081  2858 ts_tablet_manager.cc:1916] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:44.529836  2835 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:44.535410  2834 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.554602  2834 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.556475  1528 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.558617  2858 ts_tablet_manager.cc:1929] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:44.560030  2858 log.cc:1199] T 1805a53fe3fc412094cd75832a6e1208 P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/1805a53fe3fc412094cd75832a6e1208
I20260709 12:57:44.562783  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet 1805a53fe3fc412094cd75832a6e1208 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:44.563095  1683 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.576110  2475 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.584969  1431 catalog_manager.cc:5697] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.602931  1604 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:44.612557  2475 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.614854  2839 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.618386  1683 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.620543  2839 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:44.627925  2839 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.634522  2475 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.640739  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7aa902e4626a464fabe120fcad834ad0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:44.645464  1681 raft_consensus.cc:2955] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.650189  1428 catalog_manager.cc:5697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:44.672196  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 7aa902e4626a464fabe120fcad834ad0 with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:44.683377  2863 tablet_replica.cc:333] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:44.684770  2863 raft_consensus.cc:2243] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:44.685606  2863 raft_consensus.cc:2272] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:44.689818  2863 ts_tablet_manager.cc:1916] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:44.711450  2863 ts_tablet_manager.cc:1929] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:44.711988  2863 log.cc:1199] T 7aa902e4626a464fabe120fcad834ad0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/7aa902e4626a464fabe120fcad834ad0
I20260709 12:57:44.714754  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 7aa902e4626a464fabe120fcad834ad0 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:44.787425  1528 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:44.791953  2475 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.792227  1608 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:44.793506  2801 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.795514  2743 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.804370  2840 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.808146  2475 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.811014  1604 raft_consensus.cc:2955] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.821192  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 32b6ee54d0d6479194b8ac687bbb1754 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:44.829548  1428 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:44.842562  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet 32b6ee54d0d6479194b8ac687bbb1754 with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:44.844241  2858 tablet_replica.cc:333] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:44.845366  2858 raft_consensus.cc:2243] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:44.846232  2858 raft_consensus.cc:2272] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:44.852056  2858 ts_tablet_manager.cc:1916] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:44.869635  2858 ts_tablet_manager.cc:1929] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:44.869951  2858 log.cc:1199] T 32b6ee54d0d6479194b8ac687bbb1754 P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/32b6ee54d0d6479194b8ac687bbb1754
I20260709 12:57:44.871346  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet 32b6ee54d0d6479194b8ac687bbb1754 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:45.918843  1681 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:45.929292  1604 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.930867  1529 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.930744  2869 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:45.932816  1649 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 525f0b170c13486a8942f69d40971d8f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:45.933926  2869 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:45.938951  2866 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:45.941063  1604 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:45.943571  1529 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:45.957170  1431 catalog_manager.cc:5697] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:45.958245  1681 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
W20260709 12:57:45.966512  1649 consensus_peers.cc:597] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3edf2cc020b14bb0b4aebbbdfd3e4a8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:45.966836  1604 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.967146  1529 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:45.968600  2864 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:45.970070  2869 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:45.979684  2831 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:45.981416  1604 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:45.982455  1528 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.000447  1532 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.014541  1431 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.021229  1608 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:57:46.022105  1500 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1760e23cca344b0a0ed3ed897bae95f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:46.022907  2867 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:46.026027  1681 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:46.028775  2867 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:46.041790  2867 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.045668  1683 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.049979  1604 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.069231  1428 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.076581  1528 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
W20260709 12:57:46.088932  1500 consensus_peers.cc:597] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2b55a7fa2a04544a73c2fa785686919. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:46.097414  1604 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:46.099116  2867 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:46.097662  1680 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:46.103289  2881 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:46.119136  2867 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.122967  1604 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.126837  1681 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:46.137323  1428 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:46.388413  2887 ts_tablet_manager.cc:933] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:46.391677  2887 tablet_copy_client.cc:323] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:46.393801  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 525f0b170c13486a8942f69d40971d8f from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:46.394376  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 525f0b170c13486a8942f69d40971d8f from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-525f0b170c13486a8942f69d40971d8f
I20260709 12:57:46.400399  1692 tablet_copy_source_session.cc:215] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:46.403821  2887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525f0b170c13486a8942f69d40971d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.418228  2887 tablet_copy_client.cc:806] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:46.418798  2887 tablet_copy_client.cc:670] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:46.422446  2887 tablet_copy_client.cc:538] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:46.430595  2887 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:46.455286  2887 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:46.456106  2887 tablet_bootstrap.cc:492] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:46.456780  2887 ts_tablet_manager.cc:1403] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260709 12:57:46.459961  2887 raft_consensus.cc:359] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.460743  2887 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:46.461349  2887 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.464306  2887 ts_tablet_manager.cc:1434] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:57:46.466462  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-525f0b170c13486a8942f69d40971d8f received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:46.466897  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-525f0b170c13486a8942f69d40971d8f on tablet 525f0b170c13486a8942f69d40971d8f with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:46.501622  2887 ts_tablet_manager.cc:933] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:46.503654  2887 tablet_copy_client.cc:323] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:46.505357  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet e1760e23cca344b0a0ed3ed897bae95f from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:46.505841  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet e1760e23cca344b0a0ed3ed897bae95f from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-e1760e23cca344b0a0ed3ed897bae95f
I20260709 12:57:46.511950  1544 tablet_copy_source_session.cc:215] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:46.512810  2892 ts_tablet_manager.cc:933] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:46.515112  2887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1760e23cca344b0a0ed3ed897bae95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.518708  2892 tablet_copy_client.cc:323] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:46.520417  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet a2b55a7fa2a04544a73c2fa785686919 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:46.520959  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet a2b55a7fa2a04544a73c2fa785686919 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-a2b55a7fa2a04544a73c2fa785686919
I20260709 12:57:46.528242  1544 tablet_copy_source_session.cc:215] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:46.531775  2892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b55a7fa2a04544a73c2fa785686919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.531834  2887 tablet_copy_client.cc:806] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:46.532775  2887 tablet_copy_client.cc:670] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:46.539273  2887 tablet_copy_client.cc:538] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:46.552944  2892 tablet_copy_client.cc:806] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:46.553508  2892 tablet_copy_client.cc:670] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:46.553932  2887 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:46.568326  2892 tablet_copy_client.cc:538] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:46.574709  2894 ts_tablet_manager.cc:933] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:46.579276  2894 tablet_copy_client.cc:323] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:46.579962  2892 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:46.581120  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:46.581818  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-3edf2cc020b14bb0b4aebbbdfd3e4a8d
I20260709 12:57:46.590617  1692 tablet_copy_source_session.cc:215] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:46.594872  2894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.622725  2887 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:46.626169  2887 tablet_bootstrap.cc:492] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:46.630461  2887 ts_tablet_manager.cc:1403] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.020s
I20260709 12:57:46.634728  2887 raft_consensus.cc:359] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.643170  2887 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:46.643951  2887 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.647244  2887 ts_tablet_manager.cc:1434] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:57:46.652230  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-e1760e23cca344b0a0ed3ed897bae95f received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:46.652706  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-e1760e23cca344b0a0ed3ed897bae95f on tablet e1760e23cca344b0a0ed3ed897bae95f with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:46.656781  2892 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:46.657622  2892 tablet_bootstrap.cc:492] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:46.658229  2892 ts_tablet_manager.cc:1403] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.078s	user 0.036s	sys 0.024s
I20260709 12:57:46.660815  2892 raft_consensus.cc:359] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.661585  2892 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:46.662245  2892 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.666218  2892 ts_tablet_manager.cc:1434] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:46.665232  2894 tablet_copy_client.cc:806] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:46.667739  2894 tablet_copy_client.cc:670] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:46.669149  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-a2b55a7fa2a04544a73c2fa785686919 received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:46.669649  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-a2b55a7fa2a04544a73c2fa785686919 on tablet a2b55a7fa2a04544a73c2fa785686919 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:46.671926  2894 tablet_copy_client.cc:538] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:46.681761  2894 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:46.702032  2894 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:46.702833  2894 tablet_bootstrap.cc:492] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:46.703377  2894 ts_tablet_manager.cc:1403] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.005s
I20260709 12:57:46.706015  2894 raft_consensus.cc:359] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.706869  2894 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:46.707491  2894 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:46.709998  2894 ts_tablet_manager.cc:1434] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:57:46.713048  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-3edf2cc020b14bb0b4aebbbdfd3e4a8d received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:46.713514  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-3edf2cc020b14bb0b4aebbbdfd3e4a8d on tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:46.808629  2476 raft_consensus.cc:1217] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:46.956367  2476 raft_consensus.cc:1217] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:46.995796  2476 raft_consensus.cc:1217] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:47.101461  2476 raft_consensus.cc:1217] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:47.405086  2899 raft_consensus.cc:1064] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:47.407516  2899 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:47.414785  2476 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:47.416121  2881 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:47.418798  1604 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:47.419239  1681 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:47.422127  2881 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:47.424070  2881 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:47.428169  2901 raft_consensus.cc:1064] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:47.430913  2901 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:47.451617  1608 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.454030  2474 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.455785  2831 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.457026  2864 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.470212  1528 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.476233  2903 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.481022  1608 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.505224  1431 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.512647  2901 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.512727  2476 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.563442  1681 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.563938  2901 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.582036  2474 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.588025  1528 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.598899  2881 raft_consensus.cc:1064] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:47.597962  1604 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.604982  2881 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:47.614246  2908 raft_consensus.cc:1064] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:47.618839  2908 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:47.637985  2474 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:47.641336  1608 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:47.642504  2867 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:47.645838  2899 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:47.636716  1429 catalog_manager.cc:5697] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:57:47.667147  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 67480.6us
I20260709 12:57:47.672737  1678 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:47.678642  2881 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.686777  2474 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.691813  1532 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:47.698537  2476 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:47.700837  2867 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:47.707685  2899 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:47.708515  1602 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.712658  1681 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:47.716950  2903 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.720183  1678 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:47.737862  2900 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:47.747831  2475 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.759038  2474 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.762056  2831 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:47.762660  1429 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:47.766391  1682 raft_consensus.cc:2955] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.771981  1608 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.774487  2864 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:47.776340  2461 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.783268  1529 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:47.789728  2866 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:47.792147  2901 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.794570  2461 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.799942  1532 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:47.817234  2831 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:47.826509  2866 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:47.827658  1528 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:47.828157  1429 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.836128  1532 raft_consensus.cc:2955] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.841002  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1760e23cca344b0a0ed3ed897bae95f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:47.845126  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 525f0b170c13486a8942f69d40971d8f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:47.858407  2475 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:47.860093  1602 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:47.863431  2900 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:47.865404  2867 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:47.866714  1678 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.878893  2900 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.882088  1428 catalog_manager.cc:5697] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 3 to 4, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.900446  2475 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.905743  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet e1760e23cca344b0a0ed3ed897bae95f with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:47.906762  1608 raft_consensus.cc:2955] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.934084  1595 tablet_service.cc:1558] Processing DeleteTablet for tablet 525f0b170c13486a8942f69d40971d8f with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:47.937121  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2b55a7fa2a04544a73c2fa785686919 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:47.944887  2831 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.946959  1529 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.948477  1429 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.958494  2929 tablet_replica.cc:333] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:47.959576  2929 raft_consensus.cc:2243] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:47.957877  2475 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.965438  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b55a7fa2a04544a73c2fa785686919 with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:47.975876  2929 raft_consensus.cc:2272] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:47.976611  1608 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:47.979804  2929 ts_tablet_manager.cc:1916] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:47.983301  1428 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:48.010480  2930 tablet_replica.cc:333] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:48.013625  2930 raft_consensus.cc:2243] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:48.014410  2930 raft_consensus.cc:2272] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:48.018899  2930 ts_tablet_manager.cc:1916] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:48.020985  2929 ts_tablet_manager.cc:1929] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:48.021485  2929 log.cc:1199] T e1760e23cca344b0a0ed3ed897bae95f P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/e1760e23cca344b0a0ed3ed897bae95f
I20260709 12:57:48.023598  2929 tablet_replica.cc:333] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:48.024206  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet e1760e23cca344b0a0ed3ed897bae95f (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:48.024621  2929 raft_consensus.cc:2243] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:48.025341  2929 raft_consensus.cc:2272] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:48.029716  2929 ts_tablet_manager.cc:1916] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:48.039492  2930 ts_tablet_manager.cc:1929] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:48.040159  2930 log.cc:1199] T a2b55a7fa2a04544a73c2fa785686919 P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/a2b55a7fa2a04544a73c2fa785686919
I20260709 12:57:48.050622  1681 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:48.057358  2929 ts_tablet_manager.cc:1929] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:48.057963  2929 log.cc:1199] T 525f0b170c13486a8942f69d40971d8f P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/525f0b170c13486a8942f69d40971d8f
I20260709 12:57:48.059548  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 525f0b170c13486a8942f69d40971d8f (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:48.060814  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet a2b55a7fa2a04544a73c2fa785686919 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:48.080273  1602 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:48.083227  2475 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:48.086504  2831 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:48.090231  2831 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:48.096344  2866 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:48.099625  1602 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:48.119589  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:48.123256  1429 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:48.126291  2476 raft_consensus.cc:2955] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:48.138075  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:48.151458  2931 tablet_replica.cc:333] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:48.152760  2931 raft_consensus.cc:2243] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:48.153712  2931 raft_consensus.cc:2272] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:48.164939  2931 ts_tablet_manager.cc:1916] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:48.191493  2931 ts_tablet_manager.cc:1929] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:48.191931  2931 log.cc:1199] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/3edf2cc020b14bb0b4aebbbdfd3e4a8d
I20260709 12:57:48.193881  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 3edf2cc020b14bb0b4aebbbdfd3e4a8d (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:48.806802   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:48.863137  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:48.863977  1681 raft_consensus.cc:606] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:48.878347  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:48.879026  1608 raft_consensus.cc:606] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:48.881673  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:48.882228  1682 raft_consensus.cc:606] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:48.885335  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:48.885901  1682 raft_consensus.cc:606] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:48.888598  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:48.889161  1682 raft_consensus.cc:606] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:48.892406  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:48.893859  1682 raft_consensus.cc:606] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:48.908689  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:48.909201  1528 raft_consensus.cc:606] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:48.910342   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:57:48.911641   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:49.180980  2932 raft_consensus.cc:993] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.181589  2932 raft_consensus.cc:1081] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.183314  2461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36908
I20260709 12:57:49.183916  2461 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.184267  2461 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.191213  2461 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.194940  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:49.195104  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:49.195973  1682 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:49.196280  1682 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:49.197225  2461 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:49.197088  1682 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.197791  1528 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.198354  1682 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.205119  1528 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:57:49.206252  1682 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:57:49.206494  2344 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:49.208161  2937 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:49.209173  2937 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:49.210134  2937 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.220679  1431 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 4 to 5, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.229539  1528 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:49.241098  1682 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:57:49.241551  1500 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cdb1450b85664ac0a6fa149c1f105679. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:49.242470  2881 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:49.244674  1602 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:49.245967  2881 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:49.253523  2864 raft_consensus.cc:993] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:49.254107  2932 raft_consensus.cc:1081] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Signalling peer fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:49.257658  2900 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.264436  1604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:60668
I20260709 12:57:49.265060  1604 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.265457  1604 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.266170  1682 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.277262  1604 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:49.284201  1608 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:49.287858  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:49.288514  1529 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.288388  1431 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:49.292877  1604 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:49.296435  2864 raft_consensus.cc:993] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.296885  2866 raft_consensus.cc:1081] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.297516  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:49.298105  1682 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:49.298252  2866 raft_consensus.cc:993] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.298446  1682 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:49.298719  2866 raft_consensus.cc:1081] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.300734  1529 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:57:49.299916  1682 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:49.310999  1682 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.312381  1575 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:49.313534  2922 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:49.314170  2922 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:49.308351  1604 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.315361  2922 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:49.300347  2461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36908
I20260709 12:57:49.317934  2461 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.318475  2461 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.299940  2475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36908
I20260709 12:57:49.319335  2475 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.319689  2475 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:49.322942  1682 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:57:49.335963  2866 raft_consensus.cc:993] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.336629  2864 raft_consensus.cc:1081] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.339416  2476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36908
I20260709 12:57:49.340116  2476 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.340488  2476 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.350186  2476 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.357191  2475 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.358493  2461 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.359782  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:49.359969  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:49.360373  1529 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:49.360522  1681 raft_consensus.cc:3055] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:49.360900  1681 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:49.359817  2475 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:49.361650  1681 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.363478  2476 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:49.365952  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:49.366725  1682 raft_consensus.cc:3055] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:49.367084  1682 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:49.368438  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:49.369053  1529 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:57:49.368396  1681 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:49.371302  1682 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.372812  1682 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.376585  1604 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.388622  1681 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:57:49.379432  2344 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:49.392129  2461 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:49.392285  2937 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:49.392836  2937 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:49.393731  2937 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.394390  1604 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:57:49.396220  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:49.396211  2342 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:49.397122  1529 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.397601  2938 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:49.403260  1683 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:49.405530  1431 catalog_manager.cc:5697] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 4, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:49.409642  1682 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:57:49.423771  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:49.424594  1682 raft_consensus.cc:3055] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:49.424988  1682 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:49.427111  1529 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:49.428092  2900 raft_consensus.cc:993] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.432132  1532 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:49.433306  2947 raft_consensus.cc:1081] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:49.438707  2476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36912
I20260709 12:57:49.439467  2476 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.439930  2476 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.426129  1682 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.457626  1682 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.462716  2954 raft_consensus.cc:993] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:49.431670  2950 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:49.464977  2951 raft_consensus.cc:1081] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
W20260709 12:57:49.465652  1575 consensus_peers.cc:597] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74265c5d23584d47a1a5cca905a68876. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:49.469048  2922 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.474994  2476 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.477303  2938 raft_consensus.cc:697] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:49.478780  2344 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:49.480370  2957 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:49.480324  2938 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.484454  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:49.485229  1529 raft_consensus.cc:3055] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:49.485646  1529 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:57:49.485742  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 75636.5us
I20260709 12:57:49.487758  2476 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:49.490998  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:57:49.491536  1678 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.491640  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:49.491935  1678 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:49.492314  1681 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.488986  1529 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.493479  1529 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.498867  1678 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:49.502465  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:49.503095  1533 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:49.504159  1682 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:49.506197  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:49.506764  1608 raft_consensus.cc:3055] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:49.507028  1608 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:49.507601  1681 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:57:49.507665  1608 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:49.513875  1608 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:49.512988  2955 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.514166  2339 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:57:49.518235  2937 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:49.518895  2937 raft_consensus.cc:697] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:49.520114  1529 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:57:49.519845  2937 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.523088  1608 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:49.523921  1678 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:49.524883  1647 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:49.525831  2932 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:49.526348  2932 raft_consensus.cc:697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:49.527316  2932 consensus_queue.cc:237] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:49.534420  2957 raft_consensus.cc:697] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:49.535760  2957 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:49.541121  1431 catalog_manager.cc:5697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 2 to 3, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.516633  1532 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.550642  1533 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:49.569073  1431 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.573016  1681 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:49.573817  1429 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:49.575659  1678 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.578770  1431 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 4, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.584285  1431 catalog_manager.cc:5697] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.597644  1608 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:49.599653  2866 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:49.604468  1529 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:57:49.605218  1649 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d5c791dce8144e7886b1312c2b6200b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:49.606531  2932 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:49.613857  2932 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.617671  1604 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.618095  1432 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 4, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.629490  1529 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:57:49.629937  1533 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.633380  2957 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:49.634426  1681 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:49.641359  1428 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:49.655704  1649 consensus_peers.cc:597] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bc9c2ff15b642d3b2b7f9e5317a1617. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:49.658300  1533 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:49.659920  1604 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:49.660130  2970 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:49.661311  2932 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.683591  2864 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.685770  1608 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.701511  1533 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.718781  1681 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:57:49.720597  2961 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:49.753024  2979 ts_tablet_manager.cc:933] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:49.759501  1428 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:49.791666  2979 tablet_copy_client.cc:323] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:49.793503  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet cdb1450b85664ac0a6fa149c1f105679 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:49.794090  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet cdb1450b85664ac0a6fa149c1f105679 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-cdb1450b85664ac0a6fa149c1f105679
I20260709 12:57:49.795224  1681 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:49.799862  1544 tablet_copy_source_session.cc:215] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:49.800472  2950 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:49.808205  2979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb1450b85664ac0a6fa149c1f105679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:49.814330  1529 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:49.815943  2950 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:49.829418  2979 tablet_copy_client.cc:806] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:49.830142  2979 tablet_copy_client.cc:670] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:49.835036  2979 tablet_copy_client.cc:538] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:49.846033  2979 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:49.863886  1533 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:49.866745  2937 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:49.894716  2986 ts_tablet_manager.cc:933] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:49.895614  2979 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:49.896869  2979 tablet_bootstrap.cc:492] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:49.897863  2979 ts_tablet_manager.cc:1403] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.022s
I20260709 12:57:49.906803  2979 raft_consensus.cc:359] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:49.907696  2979 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:49.913094   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:49.913724  1681 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:49.919094  2938 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:49.913101  2986 tablet_copy_client.cc:323] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:57:49.926573  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 74265c5d23584d47a1a5cca905a68876 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:57:49.927127  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 74265c5d23584d47a1a5cca905a68876 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-74265c5d23584d47a1a5cca905a68876
I20260709 12:57:49.928040  1681 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:49.929780  2938 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:49.908350  2979 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:49.945050  1682 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:49.946848  2938 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:49.948297  1532 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:49.950484  1619 tablet_copy_source_session.cc:215] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:49.951902  2938 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:49.959399  2986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74265c5d23584d47a1a5cca905a68876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:49.967916  2979 ts_tablet_manager.cc:1434] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.070s	user 0.002s	sys 0.005s
I20260709 12:57:50.002454  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-cdb1450b85664ac0a6fa149c1f105679 received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:50.002914  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-cdb1450b85664ac0a6fa149c1f105679 on tablet cdb1450b85664ac0a6fa149c1f105679 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:50.006826  1608 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:50.008519  2937 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:50.010648  2986 tablet_copy_client.cc:806] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:50.011220  2986 tablet_copy_client.cc:670] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:50.013989  1533 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:50.014539  1529 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:50.016129  2864 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:57:50.019251  2961 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:50.023389  2986 tablet_copy_client.cc:538] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:50.031158  1681 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:50.032040  2986 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:50.034858  2937 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:50.077296  1608 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:50.097517  2864 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:50.097954  2986 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:50.098978  2986 tablet_bootstrap.cc:492] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:50.099639  2986 ts_tablet_manager.cc:1403] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.068s	user 0.029s	sys 0.021s
I20260709 12:57:50.107419  2986 raft_consensus.cc:359] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:50.108505  2986 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:50.109180  2986 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:50.111644  2986 ts_tablet_manager.cc:1434] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:57:50.113454  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-74265c5d23584d47a1a5cca905a68876 received from {username='slave'} at 127.0.0.1:56224
I20260709 12:57:50.113948  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-74265c5d23584d47a1a5cca905a68876 on tablet 74265c5d23584d47a1a5cca905a68876 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:50.119287  2979 ts_tablet_manager.cc:933] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:50.142608  2979 tablet_copy_client.cc:323] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:50.153533  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:50.154129  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-0bc9c2ff15b642d3b2b7f9e5317a1617
I20260709 12:57:50.168349   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:50.176998  1692 tablet_copy_source_session.cc:215] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:50.181739  2979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.203861  2979 tablet_copy_client.cc:806] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:50.204515  2979 tablet_copy_client.cc:670] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:50.211318  2986 ts_tablet_manager.cc:933] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:50.214180  2986 tablet_copy_client.cc:323] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:50.216720  2979 tablet_copy_client.cc:538] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:50.217444  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 1d5c791dce8144e7886b1312c2b6200b from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:50.218165  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 1d5c791dce8144e7886b1312c2b6200b from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-1d5c791dce8144e7886b1312c2b6200b
I20260709 12:57:50.225447  1692 tablet_copy_source_session.cc:215] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:50.226250  2979 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:50.228628  2986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5c791dce8144e7886b1312c2b6200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.255298  2979 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:50.256529  2979 tablet_bootstrap.cc:492] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:50.257458  2979 ts_tablet_manager.cc:1403] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.004s
I20260709 12:57:50.258483  2986 tablet_copy_client.cc:806] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:50.259096  2986 tablet_copy_client.cc:670] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:50.264179  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:50.263772  2979 raft_consensus.cc:359] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:50.264828  1681 raft_consensus.cc:606] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:50.264954  2986 tablet_copy_client.cc:538] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:50.264890  2979 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:50.266239  2979 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:50.268131  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57ee981b108d48998c03e57930745dce"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:50.268824  1529 raft_consensus.cc:606] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:50.275566  2979 ts_tablet_manager.cc:1434] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:57:50.278083  2461 raft_consensus.cc:1217] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:50.280435  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-0bc9c2ff15b642d3b2b7f9e5317a1617 received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:50.280908  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-0bc9c2ff15b642d3b2b7f9e5317a1617 on tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:50.287093  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:50.287729  1529 raft_consensus.cc:606] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:50.291069  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:50.291602  1532 raft_consensus.cc:606] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:50.298089  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:50.298957  1604 raft_consensus.cc:606] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:50.301093  2986 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:50.311527  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:50.312220  1532 raft_consensus.cc:606] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:50.313592   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:57:50.315317   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:50.334350  2986 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:50.335227  2986 tablet_bootstrap.cc:492] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:50.335844  2986 ts_tablet_manager.cc:1403] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.003s
I20260709 12:57:50.338941  2986 raft_consensus.cc:359] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:50.339757  2986 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:50.340378  2986 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:50.343253  2986 ts_tablet_manager.cc:1434] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:57:50.345103  1692 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-1d5c791dce8144e7886b1312c2b6200b received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:50.345497  1692 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-1d5c791dce8144e7886b1312c2b6200b on tablet 1d5c791dce8144e7886b1312c2b6200b with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:50.352883  2881 raft_consensus.cc:993] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:50.353427  2959 raft_consensus.cc:1081] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:50.354991  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57ee981b108d48998c03e57930745dce"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38994
I20260709 12:57:50.355471  1681 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:50.355837  1681 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.362512  1681 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.365975  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:50.366523  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:50.366542  1608 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.367017  1681 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:50.367293  1532 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:50.367846  2959 raft_consensus.cc:993] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:50.373031  1532 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:50.373345  1608 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:50.374256  2959 raft_consensus.cc:1081] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:50.376516  1647 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:50.377367  2970 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:50.377880  2970 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:50.378947  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38994
I20260709 12:57:50.378867  2970 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.379503  1678 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:50.379906  1678 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.384425  2881 raft_consensus.cc:993] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:50.384920  2881 raft_consensus.cc:1081] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:50.386735  1678 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.374109  1532 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.387825  1532 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.390012  2461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36912
I20260709 12:57:50.391100  2461 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:50.391665  2461 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.389509  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:50.393131  1678 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:50.393393  1533 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:50.393772  1533 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:50.394315  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:50.394433  1533 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.394876  1608 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.395629  1533 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.399729  1532 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:50.403313  2461 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.406677  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:50.407262  1529 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:50.407603  1529 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:50.408605  1608 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:50.408310  1529 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.409217  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:50.409399  1529 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.409814  1681 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.410039  1533 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:50.415786  1681 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:57:50.417054  2339 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:57:50.419026  1647 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:50.419626  2938 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:50.420158  2938 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:50.421480  2866 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:50.422003  2866 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:50.422758  2866 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.421092  2938 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.431068  1529 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:57:50.430485  1432 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:50.422784  2461 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:50.447877  1431 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 2 to 3, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:50.477303  2461 raft_consensus.cc:1217] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:50.487517  1431 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 2 to 3, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:50.502497  2959 raft_consensus.cc:993] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:50.503232  2959 raft_consensus.cc:1081] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:50.506142  2461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36912
I20260709 12:57:50.506729  2461 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:50.507910  2461 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.514493  2461 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.517310  2461 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:50.518648  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:50.519124  1608 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.521337  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:50.521958  1529 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:50.522574  1529 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:50.523710  1529 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.524817  1529 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.529089  2461 raft_consensus.cc:1217] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:50.531867  1529 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:50.536231  1608 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:50.538967  2342 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:50.539893  2961 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:50.540380  2961 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:50.541153  2961 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.550971  1428 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:50.567099  2950 raft_consensus.cc:993] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:50.567567  2958 raft_consensus.cc:1081] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:50.569078  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:57:50.569523  1529 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:50.569890  1529 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.575525  1529 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.577696  1529 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:50.578090  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:50.578945  1608 raft_consensus.cc:3055] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:50.579249  1608 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:50.579972  1608 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.581112  1608 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.587523  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:50.588207  1678 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.588394  1608 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:50.589867  1498 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:50.592274  2881 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:50.596019  2881 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:50.596897  2881 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:50.611212  1678 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:50.644732  1428 catalog_manager.cc:5697] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:50.703655  2970 raft_consensus.cc:993] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:50.704234  2970 raft_consensus.cc:1081] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:50.706182  2461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36908
I20260709 12:57:50.706724  2461 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:50.707199  2461 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.711517  2959 raft_consensus.cc:1064] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:50.714356  2461 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.717157  2461 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:50.717975  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:50.718235  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:50.718629  1604 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.718820  1678 raft_consensus.cc:3055] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:50.719211  1678 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:50.719900  1678 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.721128  1678 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:50.720674  2959 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.727492  1604 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:50.728562  2342 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:50.729401  2961 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:50.729964  2961 raft_consensus.cc:697] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:50.730772  2961 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.733307  1678 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:50.747251  1428 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:50.756968  2476 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:50.759717  1678 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:50.761801  3012 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:50.764601  2900 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:50.765924  1604 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:50.767542  2959 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:50.789109  2881 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:50.790720  2476 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:50.800815  2461 raft_consensus.cc:1217] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:50.816636  1608 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:50.817008  1678 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:50.818966  1608 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:50.820859  1431 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:50.822124  3010 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:50.823518  3010 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:50.808858  1604 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:50.846280  1529 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.854540  1532 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:50.855973  2961 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:50.859874  2461 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:50.861531  2881 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:50.869443  2881 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:50.871794  1608 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:50.872025  2461 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:50.873857  3012 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:50.880872  1608 raft_consensus.cc:2955] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:50.885984  1533 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:50.891171  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cdb1450b85664ac0a6fa149c1f105679 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:50.892657  1533 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:50.897173  3010 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:57:50.902397  2970 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:50.904388  1432 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:50.916817  2866 raft_consensus.cc:1064] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:50.924350  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet cdb1450b85664ac0a6fa149c1f105679 with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:50.925987  2866 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:50.939971  3027 tablet_replica.cc:333] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:50.941323  3027 raft_consensus.cc:2243] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:50.942384  3027 raft_consensus.cc:2272] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:50.943862  1683 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:50.947844  3027 ts_tablet_manager.cc:1916] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:50.948803  2938 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:50.979461  2958 raft_consensus.cc:1064] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:50.983217  2958 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:51.031275  2461 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:51.038345  3027 ts_tablet_manager.cc:1929] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:51.039326  3027 log.cc:1199] T cdb1450b85664ac0a6fa149c1f105679 P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/cdb1450b85664ac0a6fa149c1f105679
I20260709 12:57:51.043028  1533 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:51.044358  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet cdb1450b85664ac0a6fa149c1f105679 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:51.047861  2866 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:51.056128  3010 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:51.062777  1604 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:51.070554  3010 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:51.075228  1678 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:51.077839  3012 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:51.153940  2866 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.171842  2461 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.178364  1608 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:51.178598  1683 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:57:51.182024  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 111938us
I20260709 12:57:51.184026  2476 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:51.192319  2950 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:51.201232  1429 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.202706  1529 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.215178  1532 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:51.221500  1600 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:51.248421  1532 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:51.249459  1683 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:51.250962  3044 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:51.251117  2961 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:51.266523  2938 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:51.286653  2938 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:51.318614   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:51.322935  2950 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:51.332728  1600 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:51.361002  2938 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:51.372700  2950 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:51.377507  1678 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:51.388497  2461 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:51.395522  2864 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:51.405020  1600 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.415062  3024 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.416360  1603 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:51.419541  3034 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.424998  2476 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.434630  2970 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:51.438804  2475 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.458072  3010 raft_consensus.cc:1064] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:51.486020  1600 raft_consensus.cc:2955] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.498445  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:51.461738  3010 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:51.515413  1532 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.519652  1431 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:51.531427  1608 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:51.535503  1678 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.541350  2866 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:51.537842  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:51.538163  2476 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:51.539700  1529 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:51.548149  3010 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:51.549695  2864 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:51.548496  1430 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.578369  3056 tablet_replica.cc:333] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:51.584035  3056 raft_consensus.cc:2243] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:51.582024  1600 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:51.591264  2475 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:51.593184  3010 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.593850  3056 raft_consensus.cc:2272] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:51.600152  1678 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:51.601940  2950 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:51.602717  1532 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.604168  2950 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:51.606483  3056 ts_tablet_manager.cc:1916] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:51.613904  2950 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.617697   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:51.631614  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 74265c5d23584d47a1a5cca905a68876 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:51.641470  1678 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.641620  2474 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.650023  1600 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.652146  1429 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:51.630086  2476 raft_consensus.cc:2955] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.663363  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 74265c5d23584d47a1a5cca905a68876 with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:51.663132  1430 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:51.697178  1678 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:51.710851  3056 ts_tablet_manager.cc:1929] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:51.711311  3056 log.cc:1199] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/0bc9c2ff15b642d3b2b7f9e5317a1617
I20260709 12:57:51.713135  3056 tablet_replica.cc:333] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:51.713742  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 0bc9c2ff15b642d3b2b7f9e5317a1617 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:51.714391  3056 raft_consensus.cc:2243] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:51.714507  2476 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:51.715180  3056 raft_consensus.cc:2272] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:51.716398  1532 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:51.720932  3010 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:51.729347  3010 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:51.732909  3056 ts_tablet_manager.cc:1916] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:51.736083  2864 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.739923  2476 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.758441  3056 ts_tablet_manager.cc:1929] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:51.758882  3056 log.cc:1199] T 74265c5d23584d47a1a5cca905a68876 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/74265c5d23584d47a1a5cca905a68876
I20260709 12:57:51.762512  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 74265c5d23584d47a1a5cca905a68876 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:51.777220  1532 raft_consensus.cc:2955] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.785600  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d5c791dce8144e7886b1312c2b6200b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:51.787869  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:51.788476  1678 raft_consensus.cc:606] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:51.792243  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:51.792788  1678 raft_consensus.cc:606] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:51.796604  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:51.797214  1600 raft_consensus.cc:606] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:51.796175  1427 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:51.799957  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:51.800520  1529 raft_consensus.cc:606] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:51.803402  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:51.803872  1600 raft_consensus.cc:606] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:51.805512   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:57:51.807086   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:51.814520  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d5c791dce8144e7886b1312c2b6200b with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:51.831012  3060 tablet_replica.cc:333] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:51.832072  3060 raft_consensus.cc:2243] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:51.832780  3060 raft_consensus.cc:2272] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:51.836416  3060 ts_tablet_manager.cc:1916] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:51.852427  3060 ts_tablet_manager.cc:1929] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:51.852716  3060 log.cc:1199] T 1d5c791dce8144e7886b1312c2b6200b P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/1d5c791dce8144e7886b1312c2b6200b
I20260709 12:57:51.854066  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 1d5c791dce8144e7886b1312c2b6200b (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:52.022450  3038 raft_consensus.cc:993] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:52.023010  3042 raft_consensus.cc:1081] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:52.024714  2476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36912
I20260709 12:57:52.025269  2476 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:52.025651  2476 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:52.027328  3010 raft_consensus.cc:993] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:52.027781  2864 raft_consensus.cc:1081] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:52.030200  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60884
I20260709 12:57:52.030712  1529 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:52.031034  1529 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.032049  2476 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:52.034207  2476 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:52.034547  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:52.035168  1533 raft_consensus.cc:3055] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:52.035471  1533 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:52.036193  1533 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:52.038110  1533 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:52.038739  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:52.039291  1600 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:52.045145  3010 raft_consensus.cc:993] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:52.045780  3024 raft_consensus.cc:1081] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:52.048641  2476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36908
I20260709 12:57:52.051585  2476 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:52.044454  1529 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:52.050144  1600 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:57:52.052147  2476 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.053494  1529 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:52.054370  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:52.054900  1681 raft_consensus.cc:3055] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.055122  1533 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:57:52.055209  1681 raft_consensus.cc:740] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:52.056071  1681 consensus_queue.cc:260] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:52.057030  1681 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.056082  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:52.058461  2961 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:52.058990  2961 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:52.059986  2961 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:52.060968  2476 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:52.063472  2476 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:52.065115  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:52.065660  1678 raft_consensus.cc:3055] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.066015  1678 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:52.066946  1678 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:52.068353  1678 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.070127  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:52.070698  1600 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.074733  1681 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:52.076642  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:52.085800  1529 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.086535  1600 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:52.077454  1497 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:52.080094  1427 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 4, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.087697  3042 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.088240  3042 raft_consensus.cc:697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:52.081219  2950 raft_consensus.cc:993] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:52.089075  3042 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:52.089721  2950 raft_consensus.cc:1081] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:52.085227  1678 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:52.093328  2339 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:57:52.094329  2961 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.094656  1529 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:52.095134  2961 raft_consensus.cc:697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:52.096141  2961 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:52.099427  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:57:52.100152  1681 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:52.100538  1681 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.106307  1681 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:52.108601  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:52.108780  1681 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:52.108907  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:52.109468  1529 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.109583  1600 raft_consensus.cc:3055] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.110013  1600 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:52.110813  1600 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:52.111928  1600 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.115216  1529 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:52.117285  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:52.117449  1427 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.119079  1600 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:52.119975  2864 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.122846  2864 raft_consensus.cc:697] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:52.122960  1432 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.123720  2864 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } }
I20260709 12:57:52.143131  1427 catalog_manager.cc:5697] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.199925  3034 raft_consensus.cc:993] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:52.200408  3034 raft_consensus.cc:1081] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:52.201948  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:57:52.202395  1681 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:52.202642  1681 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.206936  1681 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:52.208410  1681 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:52.209292  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:52.209414  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:52.210011  1529 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.210181  1600 raft_consensus.cc:3055] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.210862  1600 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:52.211843  1600 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:52.213099  1600 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.217535  1529 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:52.218986  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:52.219697  2864 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.220069  2864 raft_consensus.cc:697] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:52.219921  1600 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:52.221035  2864 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:52.232306  1427 catalog_manager.cc:5697] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.478138  1681 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:52.480163  3044 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.493690  1602 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:52.495077  3042 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.515528  1681 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:52.516745  2961 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:52.530581  1533 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:52.532917  2961 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:52.554481  1600 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:52.555655  2961 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:52.570546  1533 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:52.572116  2961 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:52.607661  1533 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:52.608954  2864 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.619092  1600 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:52.620625  3010 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.758117  1533 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:52.759514  3010 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.775207  1602 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:52.777763  3010 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.808096   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:52.879216   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:52.916025  1678 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:52.920975  1602 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:57:52.921375  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 954aeabfbeda41f39cf0433b861851fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:52.922262  2864 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:52.945205  1533 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:52.947362  2864 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:52.951516  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:52.952086  1600 raft_consensus.cc:606] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:52.954641  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:52.955272  1678 raft_consensus.cc:606] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:52.953724  3010 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:52.956377  1602 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:52.958900  1533 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:52.962142  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:52.962697  1529 raft_consensus.cc:606] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:52.975646   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:57:52.978338   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:52.981628  1427 catalog_manager.cc:5697] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:52.987524  1600 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
W20260709 12:57:52.997956  1575 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d7a515ee1ef4faca822cc4e1083ab3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:52.998203  1678 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:52.999557  1533 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:52.999987  2955 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:53.002086  2955 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:53.011749  2955 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.016187  1678 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.018927  1529 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.031874  1683 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.034715  1432 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.050419  1600 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:57:53.052062  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bcbd7c7333145a3836ea9b6def4d286. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:53.052522  1529 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:53.052656  3010 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:53.054105  3024 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:53.061126  3024 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.063650  1602 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.087826  1683 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.087033  1529 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.091248  1427 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.112125  1602 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:53.113628  3091 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:57:53.114647  1649 consensus_peers.cc:597] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 062a0e40b92a4b4f9763c2dd8d13aa5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:53.119135  1533 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:53.121801  3091 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:53.131796  3010 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.133507  1602 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.148741  1533 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.154486  1429 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:53.185348  2955 raft_consensus.cc:993] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:53.185855  2955 raft_consensus.cc:1081] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:53.187400  1533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:57:53.187922  1533 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:53.188242  1533 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.195744  1533 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.197728  1533 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:57:53.199070  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:57:53.199640  2476 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.200305  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:53.200990  1602 raft_consensus.cc:3055] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:53.201314  1602 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:53.202216  1602 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.205650  1602 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.206066  3042 raft_consensus.cc:993] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:53.206622  3044 raft_consensus.cc:1081] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:53.207957  2476 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:53.209064  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38994
I20260709 12:57:53.209208  1500 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:53.209611  1683 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:53.210000  1683 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.210166  3042 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:53.210862  3042 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:53.211699  3042 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.213960  1602 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:53.223050  1683 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.228695  1683 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:57:53.230057  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:57:53.230238  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:53.230664  2476 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.230827  1533 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:53.231184  1533 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:53.231897  1533 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.232933  1533 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.237952  2476 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:53.240173  1533 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:57:53.240949  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:57:53.241990  3010 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:53.242854  3010 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:53.243644  3010 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.251144  1427 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 3, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.264454  1432 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 2 to 3, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.347258  3096 ts_tablet_manager.cc:933] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:53.348942  3096 tablet_copy_client.cc:323] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:53.350626  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 954aeabfbeda41f39cf0433b861851fc from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:53.351153  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 954aeabfbeda41f39cf0433b861851fc from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-954aeabfbeda41f39cf0433b861851fc
I20260709 12:57:53.361730  1692 tablet_copy_source_session.cc:215] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:53.365283  3096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954aeabfbeda41f39cf0433b861851fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:53.372502  3010 raft_consensus.cc:993] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:53.372995  2864 raft_consensus.cc:1081] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Signalling peer fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:53.374769  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:60668
I20260709 12:57:53.375250  1600 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:53.375563  1600 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.386566  3096 tablet_copy_client.cc:806] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:53.387257  3096 tablet_copy_client.cc:670] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:53.396637  1600 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.397617  3096 tablet_copy_client.cc:538] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:53.410413  3096 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:53.420359  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:57:53.420954  2476 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.432520  2476 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:53.433988  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:53.435004  2950 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:53.435814  2950 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:53.437110  2950 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.440467  1600 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:57:53.442065  3098 ts_tablet_manager.cc:933] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:53.443186  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:53.443710  1681 raft_consensus.cc:3055] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:53.444027  1681 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:53.444722  1681 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:53.446126  1681 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.451009  3098 tablet_copy_client.cc:323] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:57:53.452723  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 0d7a515ee1ef4faca822cc4e1083ab3a from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:57:53.453462  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 0d7a515ee1ef4faca822cc4e1083ab3a from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-0d7a515ee1ef4faca822cc4e1083ab3a
I20260709 12:57:53.467432  1681 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:53.475620  3102 ts_tablet_manager.cc:933] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:53.471781  1432 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.474231  1619 tablet_copy_source_session.cc:215] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:53.481124  3098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7a515ee1ef4faca822cc4e1083ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:53.497318  3102 tablet_copy_client.cc:323] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:53.499174  1692 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 1bcbd7c7333145a3836ea9b6def4d286 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:53.499820  1692 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 1bcbd7c7333145a3836ea9b6def4d286 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-1bcbd7c7333145a3836ea9b6def4d286
I20260709 12:57:53.508216  3096 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:53.509224  3096 tablet_bootstrap.cc:492] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:53.511612  3098 tablet_copy_client.cc:806] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:53.511991  3096 ts_tablet_manager.cc:1403] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.102s	user 0.042s	sys 0.017s
I20260709 12:57:53.512265  3098 tablet_copy_client.cc:670] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:53.516541  3096 raft_consensus.cc:359] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.517401  3096 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:53.518088  3096 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.520465  3098 tablet_copy_client.cc:538] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:53.530882  3096 ts_tablet_manager.cc:1434] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:57:53.531664  3098 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:53.532750  1693 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-954aeabfbeda41f39cf0433b861851fc received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:53.533223  1693 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-954aeabfbeda41f39cf0433b861851fc on tablet 954aeabfbeda41f39cf0433b861851fc with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:53.539371  3096 ts_tablet_manager.cc:933] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:53.594808  3096 tablet_copy_client.cc:323] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:53.596658  1693 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:53.597172  1693 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 062a0e40b92a4b4f9763c2dd8d13aa5f from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-062a0e40b92a4b4f9763c2dd8d13aa5f
I20260709 12:57:53.538905  1692 tablet_copy_source_session.cc:215] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:53.602113  3102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcbd7c7333145a3836ea9b6def4d286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:53.620371  1693 tablet_copy_source_session.cc:215] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:53.626492  3102 tablet_copy_client.cc:806] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:53.627069  3102 tablet_copy_client.cc:670] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:53.630896  3096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:53.631537  3102 tablet_copy_client.cc:538] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:53.633296  3098 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:53.634269  3098 tablet_bootstrap.cc:492] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:53.634963  3098 ts_tablet_manager.cc:1403] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.104s	user 0.061s	sys 0.024s
I20260709 12:57:53.638197  3098 raft_consensus.cc:359] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.639035  3098 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:53.639717  3098 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.641964  3102 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:53.645747  3098 ts_tablet_manager.cc:1434] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:57:53.647693  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-0d7a515ee1ef4faca822cc4e1083ab3a received from {username='slave'} at 127.0.0.1:56224
I20260709 12:57:53.648121  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-0d7a515ee1ef4faca822cc4e1083ab3a on tablet 0d7a515ee1ef4faca822cc4e1083ab3a with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:53.661056  2476 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:53.663090  3038 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:53.664263  3096 tablet_copy_client.cc:806] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:53.664989  3096 tablet_copy_client.cc:670] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:53.672344  3102 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:53.673390  3102 tablet_bootstrap.cc:492] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:53.674571  3102 ts_tablet_manager.cc:1403] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.010s
I20260709 12:57:53.675868  3096 tablet_copy_client.cc:538] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:53.678107  3102 raft_consensus.cc:359] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.679054  3102 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:53.679730  3102 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.692230  3102 ts_tablet_manager.cc:1434] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:57:53.694607  1693 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-1bcbd7c7333145a3836ea9b6def4d286 received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:53.695058  1693 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-1bcbd7c7333145a3836ea9b6def4d286 on tablet 1bcbd7c7333145a3836ea9b6def4d286 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:53.700441  3096 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:53.710491  1602 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:53.714087  3038 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:53.715940  1529 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:53.720186  3010 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:53.773531  2474 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:53.779163  2474 raft_consensus.cc:1217] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:53.781118  3024 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:53.795432  3096 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:53.796459  3096 tablet_bootstrap.cc:492] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:53.797127  3096 ts_tablet_manager.cc:1403] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.013s
I20260709 12:57:53.801303  3096 raft_consensus.cc:359] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.802065  3096 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:53.802711  3096 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:53.804669  3096 ts_tablet_manager.cc:1434] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:53.841904  1693 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-062a0e40b92a4b4f9763c2dd8d13aa5f received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:53.848608  1693 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-062a0e40b92a4b4f9763c2dd8d13aa5f on tablet 062a0e40b92a4b4f9763c2dd8d13aa5f with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:53.933097  2476 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:53.979816   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:57:54.042126  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 47396.6us
I20260709 12:57:54.069242  2475 raft_consensus.cc:1217] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:54.069782  2461 raft_consensus.cc:1217] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:54.056865  2474 raft_consensus.cc:1217] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:54.083079  3120 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:54.204816  1681 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:54.250301  2955 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:54.311133  3130 raft_consensus.cc:1064] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:54.319463  3130 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:54.339272   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:54.348647  1602 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:54.352494  3010 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:54.375283  2476 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:54.378437  3129 raft_consensus.cc:1064] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:54.387152  3129 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:54.396248  1533 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:54.400797  3130 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:54.406808  3131 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:54.408922  2476 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:54.410247  1533 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:54.412869  3120 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:54.414980  3120 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:54.415540  1678 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:54.417160  3034 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:54.417692  3130 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.432150  2476 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.480008  1429 catalog_manager.cc:5697] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:54.486670  1608 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.522584  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:54.523561  1678 raft_consensus.cc:606] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:54.529040  3130 raft_consensus.cc:1064] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:54.532101  3130 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:54.536379  3120 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.538723  1683 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.546504  1533 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.554318  3010 raft_consensus.cc:993] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:54.555122  3127 raft_consensus.cc:1081] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Signalling peer fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:54.565222  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:60668
I20260709 12:57:54.565894  1602 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.566226  1602 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:54.574793  1526 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.593149  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:54.606884  2476 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.616119  3127 raft_consensus.cc:1064] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:54.620198  3127 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:54.643014  1432 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.644593  1529 raft_consensus.cc:606] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:54.655026  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:54.655632  1608 raft_consensus.cc:606] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:54.657683   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:57:54.659415   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:54.659538  2476 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:54.660523  1526 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:54.661280  3024 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:54.666388  1608 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:54.667984  1604 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:54.669413  3130 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:54.674176  1526 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:54.674196  2461 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:54.676347  3129 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:54.677728  3034 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:54.678323  1602 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:54.681864  3024 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:54.683832  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:54.684473  1678 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:54.684731  1678 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:54.685537  1678 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:54.686632  1678 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:54.686072  1681 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:54.692955  2461 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:54.696578  1678 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:54.701639  1527 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:54.703871  3119 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:57:54.705658  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 74690.7us
I20260709 12:57:54.708699  1602 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:54.697011  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:54.712193  1529 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:54.717892  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d7a515ee1ef4faca822cc4e1083ab3a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:54.731535  1572 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:54.732470  3129 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:54.732935  3129 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:54.733174  3130 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:54.733951  3129 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:54.740711  1432 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:54.743302  2461 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.746399  2476 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.738740  3024 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:57:54.761724  1604 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.756683  3131 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.740531  3010 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.774286  1529 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:57:54.774194  1527 raft_consensus.cc:2955] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.783820  1600 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:54.784904  1427 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.787137  2461 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:54.790620  3156 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:54.793999  1526 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:54.793954  2461 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.808924  3131 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:54.810789  3127 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:54.820834  1432 catalog_manager.cc:5697] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:54.835114  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d7a515ee1ef4faca822cc4e1083ab3a with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:54.835938  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 954aeabfbeda41f39cf0433b861851fc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:54.839048  1428 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.843189  1529 raft_consensus.cc:2955] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.853076  1528 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.862907  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 954aeabfbeda41f39cf0433b861851fc with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:54.874480  3123 raft_consensus.cc:993] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:54.875178  3122 raft_consensus.cc:1081] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:54.890635  3163 tablet_replica.cc:333] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:54.890440  3127 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.897720  3163 raft_consensus.cc:2243] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:54.898707  3163 raft_consensus.cc:2272] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:54.900435  3160 tablet_replica.cc:333] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:54.892304  2474 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.904877  3163 ts_tablet_manager.cc:1916] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:54.894366  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38994
I20260709 12:57:54.905798  1683 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.906196  1683 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.924839  3160 raft_consensus.cc:2243] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:54.925832  3160 raft_consensus.cc:2272] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:54.932281  3160 ts_tablet_manager.cc:1916] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:54.933468  1528 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.942543  1681 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:54.948468  3129 raft_consensus.cc:993] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:54.949008  3129 raft_consensus.cc:1081] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:54.944656  1600 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.952523  2461 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:54.954278  3131 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:54.960186  3163 ts_tablet_manager.cc:1929] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:54.960796  3163 log.cc:1199] T 954aeabfbeda41f39cf0433b861851fc P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/954aeabfbeda41f39cf0433b861851fc
I20260709 12:57:54.962738  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 954aeabfbeda41f39cf0433b861851fc (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:54.964167  3024 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.974005  1528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:57:54.974599  1528 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.974907  1528 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:54.973907  3160 ts_tablet_manager.cc:1929] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:54.977860  2461 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.979032  3160 log.cc:1199] T 0d7a515ee1ef4faca822cc4e1083ab3a P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/0d7a515ee1ef4faca822cc4e1083ab3a
I20260709 12:57:54.983968  1528 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:54.984072  1432 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:54.986449  1528 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:54.989331  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:54.991310  1681 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:54.992235  1608 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:54.972069  1683 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:54.995658  1683 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:54.999217  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:55.000321  1600 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:55.000909  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet 0d7a515ee1ef4faca822cc4e1083ab3a (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:55.002789  1600 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:55.009863  1600 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:55.011343  1600 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:55.011941  3131 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:57:55.016062  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:55.016695  1528 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:55.017143  1528 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:55.018064  1528 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:55.019599  1528 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:55.022550  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:55.023161  1604 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:55.024767  1600 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:57:55.026232  1498 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:55.027108  3123 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:55.027616  3123 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:55.029131  3123 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:55.030588  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:55.033418  1680 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:55.036763  1681 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:57:55.029798  1428 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:55.029973  1604 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:55.043049  1608 raft_consensus.cc:2955] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:55.049685  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:55.050650  3131 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:55.051208  3131 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:55.052107  3131 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:55.059212  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet 062a0e40b92a4b4f9763c2dd8d13aa5f with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:55.064620  2476 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:55.066797  1527 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:55.073412  3156 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:55.077970  3156 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:55.082084  1528 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:57:55.091315  3156 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:55.092084  1429 catalog_manager.cc:5697] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 5, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 5 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:55.096668  3166 tablet_replica.cc:333] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:57:55.097957  3166 raft_consensus.cc:2243] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:55.098932  3166 raft_consensus.cc:2272] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:55.097296  2476 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:55.106025  3166 ts_tablet_manager.cc:1916] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:55.103426  1428 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:55.120330  1528 raft_consensus.cc:2955] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:55.128760  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1bcbd7c7333145a3836ea9b6def4d286 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:55.141881  1429 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:55.145233  3166 ts_tablet_manager.cc:1929] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:55.145804  3166 log.cc:1199] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/062a0e40b92a4b4f9763c2dd8d13aa5f
I20260709 12:57:55.147718  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet 062a0e40b92a4b4f9763c2dd8d13aa5f (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:55.163522  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bcbd7c7333145a3836ea9b6def4d286 with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:55.164444  3163 tablet_replica.cc:333] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:55.166556  3163 raft_consensus.cc:2243] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:55.167512  3163 raft_consensus.cc:2272] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:55.171578  3163 ts_tablet_manager.cc:1916] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:55.184939  3163 ts_tablet_manager.cc:1929] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:55.185325  3163 log.cc:1199] T 1bcbd7c7333145a3836ea9b6def4d286 P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/1bcbd7c7333145a3836ea9b6def4d286
I20260709 12:57:55.186836  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 1bcbd7c7333145a3836ea9b6def4d286 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:55.295580  1528 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:55.297125  3120 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:55.321157  1681 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:55.322686  3119 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:55.487954  1681 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:55.489672  3122 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:55.502991  1608 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:55.504702  3122 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:57:55.587667  1528 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.589129  3156 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.600589  1608 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.606827  3159 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.660461   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:55.724038   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:57:56.608934  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.012s	sys 0.006s
W20260709 12:57:56.609356  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.014s	sys 0.006s
W20260709 12:57:56.609669  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 588383us
I20260709 12:57:56.689503  3213 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:57:56.690074  3213 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:56.692505  3213 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:57:56.702649  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:57:56.706293  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:56.706916  1678 raft_consensus.cc:606] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:56.715888  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:57:56.716284  3204 raft_consensus.cc:993] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:56.720675  3204 raft_consensus.cc:1081] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:56.738858  2475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36908
I20260709 12:57:56.739553  2475 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:56.739955  2475 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.746460  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:56.746871  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:56.747457  1676 raft_consensus.cc:606] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:56.747437  3212 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:56.751030  2475 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:56.752683  3204 raft_consensus.cc:993] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:56.756515  3204 raft_consensus.cc:1081] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:56.759601  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:56.760180  1602 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.762111  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:56.762591  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60884
I20260709 12:57:56.762703  1527 raft_consensus.cc:606] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:56.763116  1526 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:56.763463  1526 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.768864  1602 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:57:56.769526  1526 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:56.770386  2342 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:56.770869  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:56.771466  1676 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:56.771763  1676 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:56.772079  1526 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:56.774997  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:56.775636  1681 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:56.775967  1681 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:56.776784  1681 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:56.777233  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:56.778124  1600 raft_consensus.cc:606] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:56.778228  1681 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.771476  3186 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:56.779152  3186 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:56.780097  3186 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:56.784176   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:57:56.786128   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:56.786300  1681 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:56.772475  1676 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:56.789970  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:56.790904  1676 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.791006  3214 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:56.791525  3214 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:56.792357  3214 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:56.801975  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:56.804329  1602 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.803270  2475 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:56.816478  1676 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:57:56.825716  1429 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:56.830617  1602 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:57:56.833654  1427 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:56.855321  1526 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:56.866415  1676 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:57:56.867113  1500 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d08227f27afa422683d506a582939c6d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:56.867169  1602 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:56.867769  3214 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:56.869077  3183 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:56.880050  3181 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:56.881865  1602 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:56.883807  1676 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:56.899780  1681 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:56.901140  1427 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:56.932283  1527 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:57:56.934453  1649 consensus_peers.cc:597] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf4ba581fa344d64b772795f456096bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:56.938230  3204 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:56.959007  1602 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:56.966758  3156 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:56.981977  3183 raft_consensus.cc:993] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:56.982470  3214 raft_consensus.cc:1081] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Signalling peer fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:56.986428  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:60682
I20260709 12:57:56.987098  1602 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:56.987030  3131 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:56.993793  1602 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:56.995743  1528 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:57.011505  1604 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:57.027309  1429 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:57.029923  1602 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:57.033583  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:57.034242  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:57:57.034253  1527 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:57.034825  2475 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.035151  1602 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:57:57.037981  1527 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:57.038488  1681 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:57.040439  1527 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:57.045953  1527 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:57.053635  1527 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:57.059556  2475 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:57:57.059881  1602 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:57.061163  1527 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:57:57.061816  1649 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57ee981b108d48998c03e57930745dce. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.064818  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:57.065440  3131 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:57.067286  3216 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:57.067852  3216 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:57.068620  3204 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:57.068848  3216 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:57.098721  1432 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:57.106523  3156 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
W20260709 12:57:57.113511  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6680 after lost signal to thread 434
I20260709 12:57:57.113454  1600 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
W20260709 12:57:57.114693  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800098d60 after lost signal to thread 1466
W20260709 12:57:57.115972  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2800 after lost signal to thread 1558
W20260709 12:57:57.117007  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6c60 after lost signal to thread 1633
W20260709 12:57:57.118036  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800374780 after lost signal to thread 1707
I20260709 12:57:57.120009  3212 raft_consensus.cc:993] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:57.120500  3212 raft_consensus.cc:1081] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
W20260709 12:57:57.121038  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080032d9a0 after lost signal to thread 2510
W20260709 12:57:57.121549  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080012dd60 after lost signal to thread 3151
W20260709 12:57:57.121877  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800310860 after lost signal to thread 3154
I20260709 12:57:57.124091  1676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:57:57.124680  1676 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:57.125028  1676 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:57.131801  1676 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:57.131429  1527 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:57.133977  1676 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:57.134539  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:57.135090  1528 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:57.138044  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:57.138715  1605 raft_consensus.cc:3055] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:57.139027  1605 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:57.139860  1605 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:57.141182  1605 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:57.146659  1528 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:57:57.149509  1432 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:57.152581  1528 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:57.161046  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:57:57.163810  3156 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:57.164829  3156 raft_consensus.cc:697] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:57.179598  3156 consensus_queue.cc:237] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:57.197754  1600 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:57.201136  3210 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:57.202500  1676 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:57:57.202670  1500 consensus_peers.cc:597] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 555751dc108841d481db7da6ccbf13d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.205029  3210 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:57.206058  1602 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:57.209079  3181 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:57.217803  1605 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:57:57.222077  1429 catalog_manager.cc:5697] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 3 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:57.226985  3210 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:57.228760  1602 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:57.249819  1429 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:57.277473  1676 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:57.278079  1681 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:57:57.279134  3172 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:57.293220  1681 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:57.295136  3183 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:57.339336  1600 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:57.342708  3150 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:57.359046  3245 ts_tablet_manager.cc:933] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:57.368767  3246 ts_tablet_manager.cc:933] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:57.387820  3245 tablet_copy_client.cc:323] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:57.389854  1693 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet bf4ba581fa344d64b772795f456096bf from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:57.390609  1693 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet bf4ba581fa344d64b772795f456096bf from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-bf4ba581fa344d64b772795f456096bf
I20260709 12:57:57.437971  3246 tablet_copy_client.cc:323] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:57.442860  1693 tablet_copy_source_session.cc:215] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:57:57.452003  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 56191.6us
I20260709 12:57:57.464999  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet d08227f27afa422683d506a582939c6d from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:57.465579  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet d08227f27afa422683d506a582939c6d from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-d08227f27afa422683d506a582939c6d
I20260709 12:57:57.480682  3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4ba581fa344d64b772795f456096bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:57.494588  1544 tablet_copy_source_session.cc:215] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:57.504594  3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08227f27afa422683d506a582939c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:57.510831  2475 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:57.512579  3212 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:57.547521  3245 tablet_copy_client.cc:806] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:57.550034  3245 tablet_copy_client.cc:670] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:57.578485  1528 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:57.580062  3212 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:57.601967  3245 tablet_copy_client.cc:538] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:57.606284  1527 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:57.611763  3176 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:57.632279  3245 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:57.682613  3255 ts_tablet_manager.cc:933] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:57.685881  3245 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:57.686988  3245 tablet_bootstrap.cc:492] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:57.687757  3245 ts_tablet_manager.cc:1403] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.056s	user 0.026s	sys 0.015s
I20260709 12:57:57.690941  3245 raft_consensus.cc:359] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:57.691844  3245 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:57.692540  3245 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:57.693720  3255 tablet_copy_client.cc:323] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:57:57.708315  3245 ts_tablet_manager.cc:1434] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:57:57.717496  1602 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:57.725608  2461 raft_consensus.cc:1217] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:57.743193  1693 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 57ee981b108d48998c03e57930745dce from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:57:57.743932  1693 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 57ee981b108d48998c03e57930745dce from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-57ee981b108d48998c03e57930745dce
I20260709 12:57:57.754230  1693 tablet_copy_source_session.cc:215] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:57.759989  1693 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-bf4ba581fa344d64b772795f456096bf received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:57.760541  1693 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-bf4ba581fa344d64b772795f456096bf on tablet bf4ba581fa344d64b772795f456096bf with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:57.763201  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ee981b108d48998c03e57930745dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:57.769496  3176 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:57.775535  3257 ts_tablet_manager.cc:933] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:57:57.787066   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:57.832433  3246 tablet_copy_client.cc:806] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:57.833210  3246 tablet_copy_client.cc:670] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:57.839560  3246 tablet_copy_client.cc:538] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:57.848217  3255 tablet_copy_client.cc:806] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:57.848971  3255 tablet_copy_client.cc:670] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:57.856624  3255 tablet_copy_client.cc:538] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:57.860383  3257 tablet_copy_client.cc:323] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:57:57.862386  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet 555751dc108841d481db7da6ccbf13d5 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:57:57.862972  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet 555751dc108841d481db7da6ccbf13d5 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-555751dc108841d481db7da6ccbf13d5
I20260709 12:57:57.869036  3255 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:57.874410  1544 tablet_copy_source_session.cc:215] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:57.880837  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 555751dc108841d481db7da6ccbf13d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:57.881664  3246 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:57.938333  3257 tablet_copy_client.cc:806] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:57.938941  3257 tablet_copy_client.cc:670] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:57.943670  3257 tablet_copy_client.cc:538] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:58.011170  3255 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:58.014060  3246 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:58.017979  3246 tablet_bootstrap.cc:492] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:58.017975  3255 tablet_bootstrap.cc:492] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:58.019905  3255 ts_tablet_manager.cc:1403] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.014s
I20260709 12:57:58.021996  3246 ts_tablet_manager.cc:1403] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.141s	user 0.035s	sys 0.006s
I20260709 12:57:58.027607  3257 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:57:58.023092  3255 raft_consensus.cc:359] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.030659  3255 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:58.031431  3255 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.032559  3246 raft_consensus.cc:359] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.033419  3246 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:58.034344  3246 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.041342  3246 ts_tablet_manager.cc:1434] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:57:58.043336  3255 ts_tablet_manager.cc:1434] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 12:57:58.045595  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-d08227f27afa422683d506a582939c6d received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:58.046116  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-d08227f27afa422683d506a582939c6d on tablet d08227f27afa422683d506a582939c6d with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:58.046190  1693 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-57ee981b108d48998c03e57930745dce received from {username='slave'} at 127.0.0.1:45362
I20260709 12:57:58.046680  1693 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-57ee981b108d48998c03e57930745dce on tablet 57ee981b108d48998c03e57930745dce with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:58.065294   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:58.109387  3257 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:58.113261  3257 tablet_bootstrap.cc:492] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:57:58.114046  3257 ts_tablet_manager.cc:1403] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.093s	user 0.029s	sys 0.000s
I20260709 12:57:58.117156  3257 raft_consensus.cc:359] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.118062  3257 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:57:58.119135  3257 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.121949  3257 ts_tablet_manager.cc:1434] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:57:58.125200  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-555751dc108841d481db7da6ccbf13d5 received from {username='slave'} at 127.0.0.1:34406
I20260709 12:57:58.125653  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-555751dc108841d481db7da6ccbf13d5 on tablet 555751dc108841d481db7da6ccbf13d5 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:58.138592  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:58.139235  1602 raft_consensus.cc:606] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:57:58.155108  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:58.155742  1527 raft_consensus.cc:606] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:58.160902   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:57:58.167995   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:58.189807  2475 raft_consensus.cc:1217] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:57:58.245486  3159 raft_consensus.cc:1064] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:58.248809  3159 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:58.260294  1602 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:58.261978  3159 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.264583  1528 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:58.265165  2475 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:58.268018  3176 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.269997  3176 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.270269  2475 raft_consensus.cc:1217] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:57:58.327104  3212 raft_consensus.cc:993] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:58.327558  3212 raft_consensus.cc:1081] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:57:58.329185  1528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:57:58.329710  1528 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:58.330046  1528 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.333719  3176 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.334817  1602 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.342761  2475 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.362170  1527 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.370728  1427 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.358572  1528 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:58.397604  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:58.398272  1605 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:58.398633  1605 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:58.399799  1528 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:58.399501  1605 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:58.400512  1605 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.410823  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:58.411460  1681 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:58.413802  1605 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:58.418144  1681 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:57:58.418349  1498 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:58.421123  3183 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:58.422269  3183 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:58.423297  3183 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:58.459545  3210 raft_consensus.cc:993] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:58.460040  3210 raft_consensus.cc:1081] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:58.463589  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38994
I20260709 12:57:58.464124  1681 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:58.464440  1681 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.476341  1681 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.482324  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:58.483112  1605 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.484901  1432 catalog_manager.cc:5697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 2, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.480762  1681 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:58.489661  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:58.490223  1527 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:58.490500  1527 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:58.491219  1527 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.492610  1527 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.496996  1676 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:58.500041  1605 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:57:58.501358  1647 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:58.502581  3176 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:58.503064  3176 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:58.503957  3176 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:58.508602  1605 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:58.510442  3258 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:58.508802  1527 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:57:58.519524  2475 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:58.526110  3258 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:58.539314  3258 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.549268  1428 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 3 to 4, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.550081  1605 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.579563  1428 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.584767  2475 raft_consensus.cc:2955] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.595136  1519 tablet_service.cc:1558] Processing DeleteTablet for tablet bf4ba581fa344d64b772795f456096bf with delete_type TABLET_DATA_TOMBSTONED (TS 5a2554c3dead4fcfa5f51708a9ecd5ac not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60874
I20260709 12:57:58.598479  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf4ba581fa344d64b772795f456096bf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:58.602577  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:58.603319  1682 raft_consensus.cc:606] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:57:58.613735  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:58.614351  1681 raft_consensus.cc:606] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:57:58.614830  3275 tablet_replica.cc:333] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
W20260709 12:57:58.616086  1416 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for d08227f27afa422683d506a582939c6d already in progress [suppressed 24 similar messages]
I20260709 12:57:58.616485  3275 raft_consensus.cc:2243] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:58.617316  3275 raft_consensus.cc:2272] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:58.641880  3275 ts_tablet_manager.cc:1916] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:58.643215  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38972
I20260709 12:57:58.643900  1682 raft_consensus.cc:606] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Received request to transfer leadership
W20260709 12:57:58.648306  1480 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:57:58.648725  1480 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d08227f27afa422683d506a582939c6d already in progress
W20260709 12:57:58.648979  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d08227f27afa422683d506a582939c6d already in progress
I20260709 12:57:58.666854  3176 raft_consensus.cc:1064] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:58.669795  3176 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:58.674226  3275 ts_tablet_manager.cc:1929] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:58.674791  3275 log.cc:1199] T bf4ba581fa344d64b772795f456096bf P 5a2554c3dead4fcfa5f51708a9ecd5ac: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-0-root/wals/bf4ba581fa344d64b772795f456096bf
I20260709 12:57:58.681897  1419 catalog_manager.cc:5028] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): tablet bf4ba581fa344d64b772795f456096bf (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:58.685650  1602 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:58.687529  2475 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:58.689953  1528 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:58.690857  3159 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.693241  3159 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.694139  3274 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.721341  3274 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.724666  1605 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.771726  1428 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.777742  1526 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.751633  2475 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.815555  1682 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:58.821805  1526 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:58.823043  2461 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:58.823127  3274 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:58.827831  3159 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:58.847635  3159 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.861069  2461 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.864315  1526 raft_consensus.cc:2955] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:58.865962  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57ee981b108d48998c03e57930745dce with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:58.878022  1432 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 4 to 5, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.884268  3183 raft_consensus.cc:1064] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:57:58.886969  3183 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:58.892650  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 57ee981b108d48998c03e57930745dce with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60652
I20260709 12:57:58.920197  3281 tablet_replica.cc:333] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:57:58.933153  2475 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:58.935082  3194 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.949085  1682 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:58.950840  3281 raft_consensus.cc:2243] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:58.951675  3281 raft_consensus.cc:2272] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:58.955317  3281 ts_tablet_manager.cc:1916] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:58.972419  3281 ts_tablet_manager.cc:1929] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:57:58.973115  3281 log.cc:1199] T 57ee981b108d48998c03e57930745dce P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/57ee981b108d48998c03e57930745dce
I20260709 12:57:58.975075  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 57ee981b108d48998c03e57930745dce (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:58.983701  1682 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:58.981225  3210 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:57:58.989776  1605 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:58.991391  3258 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.009476  3194 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:59.042256  1602 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:59.059406  3287 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.070989  3258 raft_consensus.cc:993] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:59.071563  3258 raft_consensus.cc:1081] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Signalling peer fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:59.076659  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:60668
I20260709 12:57:59.077526  1605 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.086320  1600 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:59.088136  2475 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Advancing to term 4
I20260709 12:57:59.098106  1605 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:59.116266  2475 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEARNER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:59.118484  3258 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:59.122812  3287 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.131016  1526 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:59.135517  3159 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:59.162130  1681 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.169085   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:59.181316  3284 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:59.192261  1605 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:59.197762  1602 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:59.202314  3176 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.203447  3176 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:59.203801  3176 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:59.204656  3176 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:57:59.210196  3176 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:59.215705  1602 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.217087  2461 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.263420  1605 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:59.265827  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:59.273155  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:59.276836  1681 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:57:59.298347  1572 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:59.299647  3212 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:59.300446  3212 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:59.301542  3212 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
W20260709 12:57:59.305043  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 69246.5us
I20260709 12:57:59.307912  1432 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.351562  1428 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 4 to 5, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.410840  1526 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:59.418524  2475 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:59.420339  3289 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:59.421051  1602 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:59.422380  3287 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:59.427107   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:59.435426  3284 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.438199  2475 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.449726  1604 raft_consensus.cc:2955] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.455622  1432 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 5, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:57:59.461826  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 555751dc108841d481db7da6ccbf13d5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:59.535979  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet 555751dc108841d481db7da6ccbf13d5 with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38972
W20260709 12:57:59.538695  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 53498.5us
I20260709 12:57:59.558471  3302 tablet_replica.cc:333] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:57:59.578286  3302 raft_consensus.cc:2243] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:59.580068  3302 raft_consensus.cc:2272] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:59.584266  3302 ts_tablet_manager.cc:1916] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:59.616050  3302 ts_tablet_manager.cc:1929] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:57:59.616479  3302 log.cc:1199] T 555751dc108841d481db7da6ccbf13d5 P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/555751dc108841d481db7da6ccbf13d5
I20260709 12:57:59.618242  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet 555751dc108841d481db7da6ccbf13d5 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:57:59.622059  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:57:59.622536  1682 raft_consensus.cc:606] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:57:59.625073  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:57:59.625701  1526 raft_consensus.cc:606] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:57:59.628772  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a61da57488ec46278703e8204e8ab905"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:57:59.629328  1602 raft_consensus.cc:606] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:57:59.631657   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:57:59.633354   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:59.665223  3285 raft_consensus.cc:993] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:59.665877  3284 raft_consensus.cc:1081] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Signalling peer fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:57:59.667814  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:60682
I20260709 12:57:59.668315  1602 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.668643  1602 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.673378  1602 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:59.675176  1602 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:57:59.676177  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:57:59.676079  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:59.676837  2475 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.676931  1526 raft_consensus.cc:3055] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:59.677299  1526 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:57:59.678063  1526 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:59.679517  1526 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.686501  2475 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:57:59.687148  1526 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:57:59.687984  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:59.688737  3119 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:59.689203  3119 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:59.689972  3119 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:59.702369  1432 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 4, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.734310  3176 raft_consensus.cc:993] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:59.735100  3176 raft_consensus.cc:1081] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:57:59.736867  2475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36908
I20260709 12:57:59.737334  2475 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.737648  2475 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.742267  2475 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:59.745385  2475 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:57:59.745667  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:59.746286  1602 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.746739  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:57:59.747476  1682 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:59.747826  1682 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:59.748610  1682 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:59.749997  1682 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.751497  1602 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:59.752712  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:59.753602  3303 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:59.754042  3303 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:57:59.754878  3303 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:57:59.757884  1682 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:57:59.777501  1432 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 1 to 2, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:59.827379  1682 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:59.829650  3212 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:59.896740  3310 raft_consensus.cc:993] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:59.897672  3310 raft_consensus.cc:1081] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:57:59.900014  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a61da57488ec46278703e8204e8ab905"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:57:59.900681  1681 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.901087  1681 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.916565  1526 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:59.918185  2461 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEARNER]: Advancing to term 5
I20260709 12:57:59.930264  2461 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:59.937321  1681 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:59.928959  1526 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:59.964648  1681 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:57:59.969488  3313 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:59.971223  3313 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:59.976152  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:57:59.979007  1526 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.983536  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:57:59.984151  1605 raft_consensus.cc:3055] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:59.984416  1605 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:57:59.985095  1605 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:57:59.986299  1605 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.989081  1526 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:57:59.993405  1605 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:57:59.995620  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:57:59.997612  3176 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:59.998138  3176 raft_consensus.cc:697] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:57:59.999097  3176 consensus_queue.cc:237] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:00.014959  3313 raft_consensus.cc:1064] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:58:00.019052  3313 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:00.034277  1681 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:00.034938  2461 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:00.038538  1528 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:00.039484  3315 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:00.041954  3313 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:00.044085  3315 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:00.051870  1432 catalog_manager.cc:5697] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 3 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:00.060599  3119 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:00.066200  2461 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:00.073974  1528 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:00.086429  1682 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:00.088435  1432 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 3 to 6, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:00.107143  1602 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:00.121040  2461 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:00.126514  1526 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:00.128085  3313 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:00.130417  3315 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:00.138888  1681 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:00.141327  3150 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:00.152154  3312 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:00.160267  2461 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:00.174132  1526 raft_consensus.cc:2955] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:00.178836  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d08227f27afa422683d506a582939c6d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:00.182669  1427 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 6 to 7, VOTER 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) evicted. New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:00.209465  1669 tablet_service.cc:1558] Processing DeleteTablet for tablet d08227f27afa422683d506a582939c6d with delete_type TABLET_DATA_TOMBSTONED (TS 3cabc5110903443ba3beb5cbb14afa91 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:38972
I20260709 12:58:00.215263  1605 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:00.221791  1526 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:00.228649  2475 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:00.228518  3312 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:00.231319  3320 tablet_replica.cc:333] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 12:58:00.233435  3320 raft_consensus.cc:2243] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:00.233950  3150 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:00.234369  3320 raft_consensus.cc:2272] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:00.244843  3313 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:00.249137  3320 ts_tablet_manager.cc:1916] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:00.315147  3320 ts_tablet_manager.cc:1929] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:58:00.315675  3320 log.cc:1199] T d08227f27afa422683d506a582939c6d P 3cabc5110903443ba3beb5cbb14afa91: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-2-root/wals/d08227f27afa422683d506a582939c6d
I20260709 12:58:00.318112  1416 catalog_manager.cc:5028] TS 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): tablet d08227f27afa422683d506a582939c6d (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:58:00.554433  1602 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:00.558938  1526 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:00.569713  3297 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:00.573446  3176 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:00.634285   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:00.757462  1604 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:00.799970  1682 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:00.802402  3327 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:00.804257  1526 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:58:00.804513  1575 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 172d54128ab740c980d9c27aa0ff1761. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:00.808068  3313 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:00.816913  3315 raft_consensus.cc:2955] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:00.819922  1682 raft_consensus.cc:2955] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:00.834754  1526 raft_consensus.cc:2955] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:00.839123  1428 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: config changed from index -1 to 4, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:00.845304  1528 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:00.854561   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:00.880898  1682 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:00.881207  1604 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:00.882808  3287 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:58:00.884460  1500 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5297d7a3ab0a4faeaf7d74c4c5296b15. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:00.884641  3287 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:00.896692  3287 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:00.901654  1682 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:00.912341  1604 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:00.941345  1429 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:00.945365  1604 consensus_queue.cc:237] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:00.991189  1680 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:00.993023  1575 consensus_peers.cc:597] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 049eb4ac8c3a4cb896b8b236a384b04d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:00.993023  3315 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:00.996191  1528 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:00.998793  3315 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:01.011674  3315 raft_consensus.cc:2955] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:01.013774  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:36440
I20260709 12:58:01.014957  1680 raft_consensus.cc:606] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:01.013507  1528 raft_consensus.cc:2955] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:01.021239  1680 raft_consensus.cc:2955] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:01.032392  1681 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:01.032143  1428 catalog_manager.cc:5697] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 2, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:01.032097  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:58:01.089291  1604 raft_consensus.cc:606] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Received request to transfer leadership to TS 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:01.095948  1602 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:01.097241  3297 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:01.097884   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:01.099915   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:58:01.104485  1649 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Couldn't send request to peer 1e45ac8b66854c2f905bf2c4114cb489. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c3ea752cffa4a138dd2984b56316ae5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:01.107900  1528 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:01.113138  3159 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:01.115056  3159 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:01.116966  1602 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:01.133930  1428 catalog_manager.cc:5697] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:01.158577  3176 raft_consensus.cc:993] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:58:01.159075  3176 raft_consensus.cc:1081] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:58:01.160487  1527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60884
I20260709 12:58:01.161049  1527 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:01.161410  1527 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.170063  1527 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:01.172648  1527 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:01.173552  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:01.174129  1681 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:01.170768  1528 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } } }
I20260709 12:58:01.176142  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:01.176721  2475 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.174415  1681 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:01.185214  1681 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:01.187521  1681 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.194196  2475 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:01.195673  1500 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:01.198508  3287 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:01.199025  3287 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:01.199846  3287 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:01.206871  1681 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:01.218274  1428 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 4, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:01.261487  3344 ts_tablet_manager.cc:933] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:01.263443  3344 tablet_copy_client.cc:323] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:58:01.265240  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 172d54128ab740c980d9c27aa0ff1761 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:58:01.265837  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 172d54128ab740c980d9c27aa0ff1761 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-172d54128ab740c980d9c27aa0ff1761
I20260709 12:58:01.270260  3315 raft_consensus.cc:993] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:58:01.270825  3315 raft_consensus.cc:1081] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:58:01.272441  2461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36924
I20260709 12:58:01.272994  2461 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:01.273324  2461 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.277629  1619 tablet_copy_source_session.cc:215] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:01.282563  3344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172d54128ab740c980d9c27aa0ff1761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:01.283243  2461 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:01.286430  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:01.287017  1528 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.287528  2461 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:01.288453  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:01.289029  1602 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:01.289341  1602 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:01.290057  1602 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:01.291391  1602 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.297989  1528 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:01.319882  3344 tablet_copy_client.cc:806] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:01.320544  3344 tablet_copy_client.cc:670] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:01.328733  3344 tablet_copy_client.cc:538] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:01.335619  2344 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:01.336696  3150 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:01.364657  1602 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:01.384536  3348 ts_tablet_manager.cc:933] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:58:01.381318  3344 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:58:01.386965  3150 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:01.388159  3150 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:01.392405  3348 tablet_copy_client.cc:323] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:40197
I20260709 12:58:01.394402  1544 tablet_copy_service.cc:140] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Received BeginTabletCopySession request for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:34406)
I20260709 12:58:01.394960  1544 tablet_copy_service.cc:161] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Beginning new tablet copy session on tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:34406: session id = 1e45ac8b66854c2f905bf2c4114cb489-5297d7a3ab0a4faeaf7d74c4c5296b15
I20260709 12:58:01.403663  1544 tablet_copy_source_session.cc:215] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:01.413226  1428 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 5 to 6, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:01.423812  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:01.446864  3348 tablet_copy_client.cc:806] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:01.447523  3348 tablet_copy_client.cc:670] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:01.453907  3348 tablet_copy_client.cc:538] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:01.457527  3344 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:01.458655  3344 tablet_bootstrap.cc:492] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:58:01.459635  3344 ts_tablet_manager.cc:1403] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.079s	user 0.037s	sys 0.008s
I20260709 12:58:01.471698  3348 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:58:01.477017  3344 raft_consensus.cc:359] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:01.478020  3344 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:58:01.478761  3344 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:01.481673  3344 ts_tablet_manager.cc:1434] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:58:01.490440  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-172d54128ab740c980d9c27aa0ff1761 received from {username='slave'} at 127.0.0.1:56224
I20260709 12:58:01.490988  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-172d54128ab740c980d9c27aa0ff1761 on tablet 172d54128ab740c980d9c27aa0ff1761 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:01.531337  3344 ts_tablet_manager.cc:933] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:01.548882  3344 tablet_copy_client.cc:323] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:35057
I20260709 12:58:01.550768  1619 tablet_copy_service.cc:140] P fc6fbca2eb8d4bec997c51003e277180: Received BeginTabletCopySession request for tablet 049eb4ac8c3a4cb896b8b236a384b04d from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:56224)
I20260709 12:58:01.551350  1619 tablet_copy_service.cc:161] P fc6fbca2eb8d4bec997c51003e277180: Beginning new tablet copy session on tablet 049eb4ac8c3a4cb896b8b236a384b04d from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:56224: session id = 1e45ac8b66854c2f905bf2c4114cb489-049eb4ac8c3a4cb896b8b236a384b04d
I20260709 12:58:01.562242  1619 tablet_copy_source_session.cc:215] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:01.562502  3348 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:01.563503  3348 tablet_bootstrap.cc:492] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:58:01.564570  3348 ts_tablet_manager.cc:1403] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.008s
I20260709 12:58:01.565781  3344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049eb4ac8c3a4cb896b8b236a384b04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:01.567787  3348 raft_consensus.cc:359] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:01.569016  3348 raft_consensus.cc:740] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:58:01.569695  3348 consensus_queue.cc:260] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:01.583632  3348 ts_tablet_manager.cc:1434] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:58:01.597420  3344 tablet_copy_client.cc:806] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:01.598042  3344 tablet_copy_client.cc:670] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:01.598626  1544 tablet_copy_service.cc:342] P 5a2554c3dead4fcfa5f51708a9ecd5ac: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-5297d7a3ab0a4faeaf7d74c4c5296b15 received from {username='slave'} at 127.0.0.1:34406
I20260709 12:58:01.599112  1544 tablet_copy_service.cc:434] P 5a2554c3dead4fcfa5f51708a9ecd5ac: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-5297d7a3ab0a4faeaf7d74c4c5296b15 on tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:01.608304  3344 tablet_copy_client.cc:538] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:01.617303  2475 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:01.619017  3344 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:58:01.627328  3284 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:01.634738  3348 ts_tablet_manager.cc:933] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Initiating tablet copy from peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:01.646988  3348 tablet_copy_client.cc:323] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35399
I20260709 12:58:01.648737  1693 tablet_copy_service.cc:140] P 3cabc5110903443ba3beb5cbb14afa91: Received BeginTabletCopySession request for tablet 7c3ea752cffa4a138dd2984b56316ae5 from peer 1e45ac8b66854c2f905bf2c4114cb489 ({username='slave'} at 127.0.0.1:45362)
I20260709 12:58:01.649247  1693 tablet_copy_service.cc:161] P 3cabc5110903443ba3beb5cbb14afa91: Beginning new tablet copy session on tablet 7c3ea752cffa4a138dd2984b56316ae5 from peer 1e45ac8b66854c2f905bf2c4114cb489 at {username='slave'} at 127.0.0.1:45362: session id = 1e45ac8b66854c2f905bf2c4114cb489-7c3ea752cffa4a138dd2984b56316ae5
I20260709 12:58:01.654311  3344 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:01.655330  3344 tablet_bootstrap.cc:492] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:58:01.656013  3344 ts_tablet_manager.cc:1403] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.010s
I20260709 12:58:01.668715  1693 tablet_copy_source_session.cc:215] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:01.673454  3344 raft_consensus.cc:359] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:01.674427  3344 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:58:01.675097  3344 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:01.676220  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3ea752cffa4a138dd2984b56316ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:01.676942  3344 ts_tablet_manager.cc:1434] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:58:01.678630  1619 tablet_copy_service.cc:342] P fc6fbca2eb8d4bec997c51003e277180: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-049eb4ac8c3a4cb896b8b236a384b04d received from {username='slave'} at 127.0.0.1:56224
I20260709 12:58:01.679081  1619 tablet_copy_service.cc:434] P fc6fbca2eb8d4bec997c51003e277180: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-049eb4ac8c3a4cb896b8b236a384b04d on tablet 049eb4ac8c3a4cb896b8b236a384b04d with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:01.705593  3348 tablet_copy_client.cc:806] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:01.706300  3348 tablet_copy_client.cc:670] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:01.737246  2475 raft_consensus.cc:1217] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:58:01.739589  3348 tablet_copy_client.cc:538] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:01.749888  3348 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap starting.
I20260709 12:58:01.851584  1682 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:02.787359  3150 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:02.788057  3150 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:02.822721  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.008s	sys 0.048s
W20260709 12:58:02.823160  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.008s	sys 0.048s
I20260709 12:58:02.954871  3150 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:02.957492  3150 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:02.958177  3150 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:03.168079  3150 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:03.147795  3368 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:03.387465  3150 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:03.155246  3347 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:03.163800  3370 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:03.393158  3150 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:03.148420  3346 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:03.475359  3150 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:03.394157  3342 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:03.418197  3368 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.036037  3371 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:03.687986  3346 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.126116  3346 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:04.589188  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.536s	user 0.076s	sys 0.114s
I20260709 12:58:03.447841  3347 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:04.172186  3348 log.cc:927] Time spent T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:58:04.221764  3368 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:03.590983  3370 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:04.899379  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.097s	user 0.013s	sys 0.008s
W20260709 12:58:04.899849  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.097s	user 0.013s	sys 0.008s
I20260709 12:58:04.900769  3370 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:04.080992  3371 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.904004  3371 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:03.925446  3342 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:04.680405  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.550s	user 0.018s	sys 0.021s
W20260709 12:58:04.907203  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.777s	user 0.020s	sys 0.021s
W20260709 12:58:04.711695  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.757s	user 0.067s	sys 0.161s
I20260709 12:58:04.912261  3327 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:04.778357  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.734s	user 0.010s	sys 0.022s
W20260709 12:58:04.913888  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.870s	user 0.011s	sys 0.022s
W20260709 12:58:04.778718  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.774s	user 0.004s	sys 0.019s
W20260709 12:58:04.909292  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.956s	user 0.067s	sys 0.162s
I20260709 12:58:04.787541  3383 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.790686  3384 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:04.795408  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.839s	user 0.077s	sys 0.114s
I20260709 12:58:04.796240  3385 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.799055  3386 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.803831  3387 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.808456  3388 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:04.812065  3389 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:04.868690  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.013s	sys 0.059s
I20260709 12:58:04.875765  3358 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:04.878679  2343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.447s	user 0.003s	sys 0.015s
W20260709 12:58:04.928225  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.924s	user 0.005s	sys 0.020s
W20260709 12:58:04.929216  2343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.498s	user 0.004s	sys 0.015s
I20260709 12:58:04.886646  3347 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:04.905875  3297 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:04.780189  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.859s	user 0.056s	sys 0.102s
I20260709 12:58:04.909214  3342 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:04.941962  3150 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:04.942729  3380 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.942947  3150 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.944769  3378 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:04.945643  3378 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.947093  3361 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.947363  3342 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.948648  3159 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:04.948292  3342 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.949324  3159 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:04.949703  3346 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:04.950040  3176 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.950681  3346 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:04.951691  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.031s	user 0.058s	sys 0.102s
I20260709 12:58:04.950839  3358 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:04.950704  3176 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:04.952664   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:04.964762  3358 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:04.970431  1528 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:04.971653  3368 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:04.965026  3385 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.992355  3385 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:04.992929  3385 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:04.982280  3150 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.002820  3397 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.010576  3358 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:04.964226  3383 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.947963  3361 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.948292  3378 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:04.972116  3342 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:04.972064  3346 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:04.965840  3297 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:04.967957  3388 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.023147  3388 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.023226  3297 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:04.965621  3389 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.913079  3327 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:04.953833  3384 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:04.967015  3386 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.013748  3370 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.043115  3159 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.016846  3371 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.044992  3150 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.013263  3391 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.011617  3358 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.013588  3385 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.018070  3347 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.003968  3397 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:04.931071  3387 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:05.054360  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.892s	user 0.013s	sys 0.079s
I20260709 12:58:05.108000  1603 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:05.115821  3176 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.030081  3342 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:04.943671  3380 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.144790  3150 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.111212  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.150403  3378 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.151748  3378 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.110366  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.154017  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.154469  3393 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.153826  3347 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.153867  3342 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.116779  3370 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.111891  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.157770  3284 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:05.114872  3361 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.111837  3394 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.113009  3382 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.046029  3297 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.046988  3388 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.115303  3400 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.155376  3393 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:05.168604  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.141839  3346 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.112718  3368 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.168897  3401 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.171288  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.174718  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.174949  1605 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:05.174718  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.180405  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.178229  3361 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.180946  1527 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:05.181272  1526 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:05.181505  3399 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.182255  3399 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.183012  3347 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.184126  3382 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.166471  3371 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.177851  3400 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.275935  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.221346  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.191231  3150 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.194346  3384 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.238720  3386 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.237797  3360 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:05.313009  3393 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.229692  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.315591  1607 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 1.
W20260709 12:58:05.317188  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800035660 after lost signal to thread 434
I20260709 12:58:05.317744  3385 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:05.318542  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800035d40 after lost signal to thread 1466
I20260709 12:58:05.318606  3368 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.319232  3390 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.275481  3348 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:05.322048  3159 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.276743  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.276245  3397 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.239425  3392 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:05.320163  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800331800 after lost signal to thread 1558
I20260709 12:58:05.331001  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:05.278324  2342 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.882s (SENT)
I20260709 12:58:05.375118  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.335006  1528 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:05.239200  3383 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.230316  3389 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.334405  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.391397  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.388744  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.329877  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.331552  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.181494  3361 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:05.276968  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 57384.9us
I20260709 12:58:05.394343  1680 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 1.
I20260709 12:58:05.332062  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.396747  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:05.389245  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800091a20 after lost signal to thread 1559
I20260709 12:58:05.400585  1602 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:05.400585  1609 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:05.403153  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.320293  3390 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.177068  3391 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.340000  3393 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.190959  3284 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.334949  3387 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.185990  3297 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.437680  3159 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.439960  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.275429  3346 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.214421  3388 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:05.437920  1527 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 1.
I20260709 12:58:05.441242  1604 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:05.454685  3398 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.455451  3370 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.455880  3159 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.397578  3399 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.313331  3360 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.455967  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:05.458093  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 137952us
I20260709 12:58:05.308732  3401 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:05.458210  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 180105us
I20260709 12:58:05.469785  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.484442  1676 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 1.
I20260709 12:58:05.308883  3394 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.456254  3378 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.492399  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.501233  3387 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.508340  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.444885  3327 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.512712  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.512753  3387 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.516364  1682 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:05.517475  3371 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.518421  3387 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.519290  3358 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.519552  3348 tablet_bootstrap.cc:492] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Bootstrap complete.
I20260709 12:58:05.520740  3348 ts_tablet_manager.cc:1403] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent bootstrapping tablet: real 3.771s	user 0.062s	sys 0.060s
I20260709 12:58:05.521128  3284 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.500967  3398 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.517468  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:05.513777  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080025dfa0 after lost signal to thread 1633
I20260709 12:58:05.495599  3389 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.536332  2475 raft_consensus.cc:1217] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:05.537101  3391 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.521767  3342 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.400620  3392 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.517549  3285 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.543313  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.547252  1682 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:05.537114  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.521826  3380 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:05.549810  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 47303.3us
I20260709 12:58:05.534762  3402 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:05.552522  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080031dcc0 after lost signal to thread 1707
I20260709 12:58:05.507019  3407 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.501147  3405 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.548292  3313 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.548532  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.552376  3398 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.518433  3393 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.558965  1527 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:05.557837  3405 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:05.542264  3400 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.553213  3402 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.547114  3397 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.550750  3390 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.577826  3403 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.553995  3386 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.555367  3391 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.564790  3389 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:05.592425  3313 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.590224  1529 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
W20260709 12:58:05.581051  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080025aa80 after lost signal to thread 2510
I20260709 12:58:05.598277  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.573616  3284 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.589318  3410 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.601820  3297 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.606446  3393 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.606564  3361 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.609659  1607 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:05.613464  3346 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.615310  3389 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.615631  3380 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:05.601217  3386 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.608275  3388 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.618681  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.606106  3397 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:05.617864  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:05.626456  3397 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.626734  3150 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.627105  3150 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.627471  3150 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.628124  3313 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.601775  3347 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.629897  3347 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.637070  3382 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.582429  3403 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.642165  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.622208  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.620534  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.622908  3284 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.564427  3407 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.643790  3394 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.646931  2342 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:05.593187  3285 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.648299  3392 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.619792  3386 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.621671  3361 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:58:05.607302  3401 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.653877  3284 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.654322  3405 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.648522  1532 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 1.
I20260709 12:58:05.655069  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.660136  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.667219  3285 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.667768  3407 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.672752  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.671023  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.646418  3402 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.662395  3382 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:05.645360  3391 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.691910  3391 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.681906  3382 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.685063  3347 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.660741  3348 raft_consensus.cc:359] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:05.695956  3348 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Initialized, Role: LEARNER
I20260709 12:58:05.696499  3403 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.677687  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:05.697067  3382 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.696729  3348 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:05.697872  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:05.698814  3346 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:05.699244  3346 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.699687  3346 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.688858  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.699740  3348 ts_tablet_manager.cc:1434] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent starting tablet: real 0.178s	user 0.002s	sys 0.009s
I20260709 12:58:05.701650  3371 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:05.704892  3371 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.705474  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.705760  2339 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:05.712540  2344 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:05.722396  3150 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.727098  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.728420  3380 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:05.731568  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.724396  3346 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.713958  3371 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.734560  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.735422  3150 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.736632  2344 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:05.726202  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.736215  2475 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:58:05.739625  3396 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:05.740001  3360 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.727131  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.742627  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.740092  3396 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.744378  3347 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.744629  3396 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:05.744867  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:05.745791  3368 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.751336  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.752079  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.756078  1682 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 1.
I20260709 12:58:05.753247  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.753345  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.753716  3411 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.756101  1678 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:05.753975  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.754305  3403 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.760763  3403 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.760017  3401 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.762151  3401 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.762850  3403 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:05.759526  3407 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.759979  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.755694  3368 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.763592  3407 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.764158  3401 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.766004  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.767073  3346 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.768155  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.768843  2455 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:05.763994  3368 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:05.797253  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 78095.3us
I20260709 12:58:05.782466  3407 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.782383  3391 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.744846  3347 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.800738  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:05.808650  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.815261  1678 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:05.792261  3346 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.782213  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.682694  3410 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:05.830181  3414 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.830324  3391 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.826963  3378 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.831538  3378 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.831911  3378 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.832599  3391 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.835709  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.836314  2435 raft_consensus.cc:2410] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:05.837517  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.837872  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.838084  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.838164  1683 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:05.816947  3347 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.830855  3414 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.816648  3284 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.857350  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.851509  2344 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:05.865597  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.855916  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.823038  3346 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.869501  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.872793  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.875226  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.875464  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.875909  1678 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:05.875653  3284 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.875509  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.882901  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.825881  3407 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.839058  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.894254  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.889310  3405 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.898488  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:05.898630  3380 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:05.902854  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.900731  3413 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:05.905720  3360 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.906225  3360 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.898581  1693 tablet_copy_service.cc:342] P 3cabc5110903443ba3beb5cbb14afa91: Request end of tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-7c3ea752cffa4a138dd2984b56316ae5 received from {username='slave'} at 127.0.0.1:45362
I20260709 12:58:05.907269  1693 tablet_copy_service.cc:434] P 3cabc5110903443ba3beb5cbb14afa91: ending tablet copy session 1e45ac8b66854c2f905bf2c4114cb489-7c3ea752cffa4a138dd2984b56316ae5 on tablet 7c3ea752cffa4a138dd2984b56316ae5 with peer 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:05.908058  3414 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.880434  3346 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.903283  3380 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:05.909511  1601 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:05.898540  3405 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.888744  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:05.910823  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:05.913920  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 62557us
I20260709 12:58:05.914701  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:05.825314  3411 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.918855  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.919545  2435 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:05.920008  3405 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.922683  3284 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.924317  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.926393  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.927239  1681 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:58:05.932307  1604 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 1.
I20260709 12:58:05.910808  3380 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.925021  1679 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:05.943646  3411 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:05.925904  3285 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.904663  3407 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:05.954337  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.950686  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.951762  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.956110  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.956297  3150 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:05.956727  3150 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:05.957113  3150 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.962159  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.963402  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.964174  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.966292  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.905336  3413 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:05.972064  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.972164  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.973214  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.974342  1602 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:58:05.973021  2423 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:05.977039  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.977669  1609 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:05.975250  1607 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:05.981524  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.982335  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.985023  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.020300  3410 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:05.994941  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:05.986142  3413 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.021708  3399 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.022119  3399 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.022468  3399 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.987389  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:05.991498  3368 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.009009  1647 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:06.202255  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 252588us
I20260709 12:58:06.202931  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.203214  3368 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.204106  2461 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:06.204495  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.017385  3407 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.205420  3403 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:06.205832  3403 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.206004  3387 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:06.206198  3403 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.206404  3387 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.206826  3387 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:06.210089  3383 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.210388  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.211205  3402 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:06.210031  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:06.211572  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 203151us
I20260709 12:58:06.211844  3402 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.212250  3402 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.212666  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:05.960467  3285 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.214072  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.215080  3285 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.031844  2475 raft_consensus.cc:1217] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:58:06.216760  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.032805  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:06.034904  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:06.035379  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:06.220472  2475 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:06.036177  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:06.036649  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:05.986981  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.038266  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:06.223165  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 184951us
I20260709 12:58:06.039441  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:06.040274  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:06.051474  3360 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.053881  3346 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.059067  2423 raft_consensus.cc:1217] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:58:06.225344  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.053051  3382 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.226899  3346 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.063252  3347 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.228278  3382 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.064641  3399 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.229033  3347 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.230461  3402 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.053028  3380 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.231779  2476 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:06.232703  3380 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:06.068079  3378 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.072373  3150 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.234709  3378 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:06.235100  3150 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.088321  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.235446  3383 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.235922  3383 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.236305  3383 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.094915  2455 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:06.237771  3414 raft_consensus.cc:1064] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:58:06.099509  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.144208  2344 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:06.239449  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 95317.8us
I20260709 12:58:06.240314  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.240535  2344 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.241981  3378 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.242358  3378 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:06.242712  3378 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.245743  3150 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:06.246161  3150 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:06.246724  3150 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.247646  2421 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.152153  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.249920  1605 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:06.252364  3411 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.252812  3411 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:06.253203  3411 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.215554  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.258170  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.266069  3407 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.266501  3407 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.266855  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.270334  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.266868  3407 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:05.981760  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.275547  1530 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:58:06.277063  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.278447  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.279428  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.223268  3386 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.224532  1649 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.282580  3386 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:58:06.282734  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 276110us
I20260709 12:58:06.283008  3386 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:06.044641  3371 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:06.282927  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 58477.1us
I20260709 12:58:06.285225  3371 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.230804  3399 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:06.036931  3396 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.287545  3396 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:06.093621  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:06.288493  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 195011us
I20260709 12:58:06.288643  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.289189  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.290277  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:06.291035  3398 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:06.291241  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.291469  3398 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.291841  3398 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.292654  3368 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.250653  3403 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.293745  3399 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:06.294198  3399 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.294566  3399 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.295784  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.297916  3411 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.293300  3368 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.299752  3368 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:06.300087  3368 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:06.300017  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.300647  3368 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.303222  2435 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:06.304953  2461 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:06.305545  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:06.307109  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.308610  3382 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:06.309015  3382 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.309355  3382 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.283555  3386 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.313036  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.327364  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.328512  3400 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.329383  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.328982  3400 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.331089  3400 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.298331  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.406118  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.408069  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:06.409691  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 82585.4us
I20260709 12:58:06.415793  1572 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.416726  1572 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.418830  3420 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:06.419466  3420 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.419837  3420 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:06.418146  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.426720  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.456210  3423 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.456786  3423 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.457230  3423 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:06.464134  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 162798us
W20260709 12:58:06.468632  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.466359  3285 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.470595  3285 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.479517  3284 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.507881  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.514488  3424 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.515209  3424 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.516227  3423 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.518921  3423 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.520133  3399 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.510831  3427 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.521965  3427 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.512814  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.513717  3420 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.480594  3284 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.524118  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.524718  3420 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.525894  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.526563  1533 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.522601  3399 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.529803  3405 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.530459  3405 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.530929  3284 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.532666  3405 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.545989  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:06.546332  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 80996us
I20260709 12:58:06.554143  3424 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.558494  3427 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.559399  3285 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.562103  1533 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:06.563109  3386 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.563437  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.564826  3285 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.565371  3285 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.566211  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.567346  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.567466  3285 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.565377  3386 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.568423  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.572824  3420 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.573379  3420 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.575053  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:06.575366  3420 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.576483  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:06.576411  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.577608  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.577895  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:06.578191  1531 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.580029  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:06.581367  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:06.583063  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:06.583462  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:06.585407  1531 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:06.586395  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.587004  1531 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:06.587862  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.588435  1531 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:58:06.589185  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.590332  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.591100  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:06.591333  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.592083  2344 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.592346  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.593376  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.593812  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.594025  3401 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:06.594466  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.594481  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.595320  3399 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:06.595875  3399 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:06.596285  3399 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.596692  3401 consensus_queue.cc:1059] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:06.597693  3420 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:06.597893  3423 raft_consensus.cc:3055] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:06.598098  3420 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:06.598296  3423 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:06.595701  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.599912  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:06.589354  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 256627us
I20260709 12:58:06.600867  2344 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:06.608489  2344 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.610631  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.599252  3408 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.615774  3380 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.616464  1500 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.617283  3405 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.618153  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.620085  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.622493  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.613065  3396 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:06.625530  3285 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.599095  3423 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.625735  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.625907  3414 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.626559  3423 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.627069  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.625907  3396 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:06.628082  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.599107  3371 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:06.628943  3396 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.629879  3371 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:06.630743  3371 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.599098  3420 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.634433  3420 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.609611  3386 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:06.649688  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 116014us
I20260709 12:58:06.654137  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:06.660168  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.661149  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:06.663192  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:06.665813  1575 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:06.672109  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.672866  1609 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:06.673076  1607 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.672453  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.666404  3427 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.666841  3405 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.666844  3426 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:06.683952  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.687649  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.688658  2428 raft_consensus.cc:1240] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:06.691093  3368 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.693748  2455 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:06.692863  3400 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.693348  3368 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.698920  1601 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.699906  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.666117  3386 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.671408  3430 consensus_queue.cc:1059] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:58:06.720073  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.684940  2435 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:06.727646  3420 raft_consensus.cc:1064] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
W20260709 12:58:06.722344  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 62201.7us
I20260709 12:58:06.723869  3425 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:06.745898  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 75609.6us
I20260709 12:58:06.747308  1500 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.741309  3427 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:06.760861  3400 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.742044  3285 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:58:06.763878  3438 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:06.784757  3437 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:06.784646  3438 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.788218  3438 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.790450  3399 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.309356  3403 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:06.794576  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.800267  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.804924  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.810961  3386 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.802260  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.818158  3285 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:06.819386  3285 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:06.819994  3420 consensus_queue.cc:237] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:06.823663  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 598336us
I20260709 12:58:06.820581  3285 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.824908  3441 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.828675  3441 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.829262  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.832054  3399 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.832996  3386 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:06.833590  3386 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.834745  3441 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.835959  3386 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:06.837023  3387 consensus_meta.cc:287] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.001s
I20260709 12:58:06.837528  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:06.843178  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 177694us
I20260709 12:58:06.845129  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:06.837113  3378 consensus_meta.cc:287] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.002s
I20260709 12:58:06.846086  3423 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.846341  3378 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.848719  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:06.849929  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.850087  3423 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:06.851807  3423 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.854319  3423 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.854960  3414 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:06.855523  3382 consensus_meta.cc:287] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.003s
I20260709 12:58:06.856061  3382 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.861012  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.864248  3382 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:06.838068  3387 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.869772  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.871510  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.875138  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.855950  3414 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:06.881644  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.882395  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.888393  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.889278  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:06.869808  3387 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:06.881441  3423 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.890666  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.893200  1531 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:06.895138  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.895386  2451 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:06.897221  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.898517  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:06.898887  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.903270  3378 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.909626  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.909300  3430 consensus_queue.cc:1059] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:06.909911  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.911712  1681 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:06.910307  3398 consensus_meta.cc:287] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.005s
I20260709 12:58:06.916105  3445 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:58:06.922057  3398 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.917593  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.925318  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.917100  3405 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:58:06.927174  1604 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:06.923043  3440 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:06.927923  3405 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:06.928489  3405 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:06.929785  3405 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.930866  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.927935  3440 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:06.940224  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:06.945118  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:06.961987  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.962700  3347 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:06.963133  3347 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.963542  3347 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.964829  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:06.965279  1647 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:06.966017  3387 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:06.966233  2421 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:06.966892  3407 consensus_meta.cc:287] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.001s
I20260709 12:58:06.969411  3411 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:06.967061  1647 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.967344  3407 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.970451  3387 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:06.970880  3387 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.971310  3387 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.971297  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.972623  3386 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.973021  3386 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.973402  3386 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.975977  1608 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.978760  1601 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:06.979902  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:06.980530  3411 consensus_queue.cc:1059] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:58:06.981928  3346 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.006s	sys 0.005s
I20260709 12:58:06.982184  1647 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:06.983778  3403 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:06.984165  3403 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:06.984543  3403 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.986847  2461 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:06.987618  3387 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.979974  3434 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:06.982424  3346 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.006s	sys 0.005s
I20260709 12:58:06.989727  3434 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.940011  3438 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:06.991335  3438 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.992307  3434 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:06.993254  3438 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:07.000891  3402 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:06.981514  3411 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:58:07.001708  3403 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:06.982504  3394 raft_consensus.cc:3055] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:06.970873  1681 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:07.003162  3394 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:06.999734  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 47093.7us
I20260709 12:58:07.004212  3401 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.004719  3401 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:07.004287  3394 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:06.982301  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.006304  3394 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:06.945430  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:06.937952  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.000s	sys 0.007s
I20260709 12:58:06.939321  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:07.022785  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 1675) took 1048 ms. Trace:
I20260709 12:58:07.023150  3401 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.023243  1525 rpcz_store.cc:276] 0709 12:58:05.973883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.977864 (+  3981us) service_pool.cc:224] Handling call
0709 12:58:06.939044 (+961180us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:07.022700 (+ 83656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586497792}
I20260709 12:58:07.024432  3401 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.021884  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:06.931123  3405 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.917769  3430 raft_consensus.cc:3055] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:58:07.026681  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.000s	sys 0.018s
I20260709 12:58:07.010151  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:07.030473  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 744746us
I20260709 12:58:07.027807  3387 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:07.031718  1649 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:07.035444  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.035307  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:07.016383  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 71405.9us
I20260709 12:58:07.039799  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.039984  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:07.037155  3382 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.046439  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.045907  2461 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:07.046311  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:07.060894  1526 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:07.048753  1527 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:07.049175  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.048108  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.024956  3347 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.046054  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.029928  3430 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:07.038324  3414 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:07.066555  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:07.040614  3407 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:07.067591  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:07.069450  2423 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:07.059432  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:07.062934  3387 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:07.040354  3420 consensus_queue.cc:1059] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:58:07.041304  3402 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:58:07.039095  3438 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:58:07.081187  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.037787  3442 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:58:07.081432  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.073036  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:07.076727  1530 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:07.080838  3387 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:07.092319  3387 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.080991  3396 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:07.081497  2455 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:07.086576  3421 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:07.085342  3386 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:07.086760  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.060425  3400 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:58:07.089697  2451 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 2: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:07.080709  3428 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:07.091773  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 47107.4us
I20260709 12:58:07.109856  2342 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.111920  3399 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.113471  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.116837  3399 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:07.118206  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.118590  3403 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:07.120797  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.123371  3396 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.124336  3386 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:07.125022  2342 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.126570  3387 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.127282  3396 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:07.128945  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.111086  3421 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:07.071339  3440 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:07.134287  2342 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:07.133520  3150 consensus_meta.cc:287] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.000s
I20260709 12:58:07.120183  3399 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:07.145156  3150 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.147822  2474 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:07.145874  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.129413  3387 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:07.150938  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 81415.8us
I20260709 12:58:07.152045  3150 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:07.142515  3396 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:07.152632  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.156140  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:07.156715  3399 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:07.156980  2451 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:07.157881  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:07.159854  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.160781  3150 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:07.142277  3421 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.161928  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:07.162621  3150 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:07.163189  3150 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:07.163951  3150 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.148265  3440 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:07.168347  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 109112us
I20260709 12:58:07.169621  3436 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.172789  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1553) took 1197 ms. Trace:
I20260709 12:58:07.173218  1532 rpcz_store.cc:276] 0709 12:58:05.979711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.979846 (+   135us) service_pool.cc:224] Handling call
0709 12:58:07.171985 (+1192139us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:07.172210 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:07.172401 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:07.172430 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:07.172475 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:07.172540 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.172600 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:07.172710 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171528064}
I20260709 12:58:07.176348  2451 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:07.178932  2423 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.181612  3453 consensus_queue.cc:1059] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:07.184468  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:07.185863  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:07.188656  3383 consensus_meta.cc:287] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.952s	user 0.006s	sys 0.005s
I20260709 12:58:07.202857  2421 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEARNER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:07.205163  3438 raft_consensus.cc:3055] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.207131  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:07.207448  3430 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:07.208644  3430 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:07.214190  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.217200  3445 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:07.219846  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:07.223213  3429 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:58:07.224550  3420 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.225026  3420 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:07.225075  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:07.226949  3420 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.228402  3420 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.222760  3383 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:07.231822  3427 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:07.232491  3427 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.241281  2455 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:07.246374  2461 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:07.247653  3383 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:07.250412  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:07.233582  3445 consensus_queue.cc:1059] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:58:07.221580  3438 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:07.250768  3441 consensus_queue.cc:1059] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:07.254266  3398 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:07.254806  3438 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.256171  3438 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.254297  3347 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:07.252760  2451 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:07.260561  3285 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.234746  3440 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:58:07.231181   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:07.268121  2342 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.271785  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.272310  1575 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:07.273301  3150 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:07.270723  3429 consensus_queue.cc:1059] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:58:07.264106  3428 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:07.303849  1575 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:07.304423  3394 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:07.305153  3442 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:07.305595  3442 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:07.306016  3442 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.269793  3405 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:07.307462  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.308751  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.274705  3368 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.293700  3441 raft_consensus.cc:3055] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:07.318161  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 421) took 1016 ms. Trace:
I20260709 12:58:07.297928  3398 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:07.318781  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:07.320359  2474 rpcz_store.cc:276] 0709 12:58:06.301791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.306710 (+  4919us) service_pool.cc:224] Handling call
0709 12:58:06.307011 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:07.148282 (+841271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.317931 (+169649us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b540056b8d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:07.318099 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932905344}
I20260709 12:58:07.324344  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:07.321215  2421 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.303186  3428 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:07.326506  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:07.336679  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.337733  3394 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:07.338260  3394 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:07.338792  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.338582  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.340533  3394 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.341523  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:07.338157  3445 raft_consensus.cc:3055] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.342079  3445 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:07.342252  1603 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:07.343365  3445 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:07.344468  3414 consensus_queue.cc:1059] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:07.320266  3441 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:07.329046  3434 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:58:07.325832  3426 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:07.327958  3407 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:07.321226  3411 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:58:07.322307  3398 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:07.313457  3405 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.323568  3413 consensus_queue.cc:1059] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:58:07.366479  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.348501  3414 raft_consensus.cc:3055] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:07.379273  3428 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.380698  3428 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:07.367969  3398 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:07.388664  3360 raft_consensus.cc:3055] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.391160  1681 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.392315  1681 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:07.393028  1681 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.393937  1681 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.378222  3414 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:07.405767  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 152421us
I20260709 12:58:07.390496  3360 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:07.425226  3458 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:58:07.429400  3360 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.432605  3360 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:07.418540  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08000acec0 after lost signal to thread 434
W20260709 12:58:07.445726  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:07.489285  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.430938  3284 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:07.500123  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.502303  1427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 313) took 1326 ms. Trace:
I20260709 12:58:07.504912  1427 rpcz_store.cc:276] 0709 12:58:06.169246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.169401 (+   155us) service_pool.cc:224] Handling call
0709 12:58:07.495373 (+1325972us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":482175,"reported_tablets":2}
I20260709 12:58:07.536192  3442 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:07.538249  1602 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.507272  3284 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:07.541365  3284 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.541946  3442 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:07.543418  3284 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:07.408183  3441 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:07.550515  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:07.575604  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 184577us
I20260709 12:58:07.499064  3427 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.588256  1533 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:58:07.584863  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 92927.4us
I20260709 12:58:07.591056  3463 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:07.595412  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.596865  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:07.597440  1605 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:07.598677  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:07.588768  1678 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:07.600356  1678 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:07.496105  3414 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.615631  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.582369  3382 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:07.599205  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:07.586501  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08001cade0 after lost signal to thread 1466
I20260709 12:58:07.553661  1681 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:07.610369  1532 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:07.610507  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.611336  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.630263  1601 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:07.573139  3437 raft_consensus.cc:3055] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:07.634487  3437 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:07.634721  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.635623  3437 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.637259  3437 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.630263  1531 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.632745  1528 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:07.631166  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.635170  1526 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:07.578986  3448 raft_consensus.cc:3055] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:07.614117  1678 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.639456  2461 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:07.618234  3405 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:07.648308  1678 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:07.644284  3448 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:07.651036  3429 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:07.654389  3448 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.656423  3448 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:07.656764  3445 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.659171  3414 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:07.659204  3427 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:07.681816  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:07.690307  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 383903us
I20260709 12:58:07.696398  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:07.663329  3421 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:07.651458  3429 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:07.706476  3429 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:07.707810  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.704777  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.639784  3382 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.710336  3368 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:58:07.693929  3427 consensus_queue.cc:1059] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:58:07.705549  3402 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:58:07.726442  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:07.728826  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.740900  1678 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:07.743966  1497 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:07.713009  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08000d43a0 after lost signal to thread 1558
I20260709 12:58:07.754669  3451 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:07.748715  3284 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.752043  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.753775  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:07.763783  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:07.765883  1497 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.767354  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:07.761720  1531 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:07.770844  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:07.778676  1606 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
W20260709 12:58:07.787622  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 195118us
I20260709 12:58:07.784556  3284 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:07.794579  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:07.796897  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.800581  3284 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:07.794130  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.810611  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:07.792088  3419 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:07.802242  2421 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:07.812088  1649 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.822257  3284 raft_consensus.cc:1064] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:58:07.829217  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:07.817143  1630 debug-util.cc:398] Leaking SignalData structure 0x7b0800350880 after lost signal to thread 1633
I20260709 12:58:07.811851  3459 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:07.816977  3457 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:07.842422  3284 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.820323  3463 consensus_queue.cc:1243] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:07.818325  1530 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:07.814432  3458 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:07.855894  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 256759us
I20260709 12:58:07.840989  3459 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:07.864815  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:07.867182  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 100162us
W20260709 12:58:07.865036  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.848045  3424 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:07.876724  3150 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:07.862389  3407 raft_consensus.cc:3055] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:07.883298  1429 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:07.892483  3407 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:07.893328  1429 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 4, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:07.894057  3407 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.896219  3407 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:07.874185  1630 debug-util.cc:398] Leaking SignalData structure 0x7b0800373940 after lost signal to thread 1707
I20260709 12:58:07.870047  3459 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:07.899953  1630 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3640 after lost signal to thread 2510
W20260709 12:58:07.900600  1630 debug-util.cc:398] Leaking SignalData structure 0x7b080030d4e0 after lost signal to thread 3391
I20260709 12:58:07.886227  3461 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:07.886737  3455 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.887873  3398 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:07.906451  3428 consensus_meta.cc:287] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.008s
W20260709 12:58:07.907480  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.908499  2344 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:07.906451  3285 consensus_meta.cc:287] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.003s
I20260709 12:58:07.915287  3461 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:07.915829  3461 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:07.923895  3347 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:07.911417  3448 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:07.929692  3429 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.931067  3398 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:07.931831  3368 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:07.932761  3405 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:07.933238  3405 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:07.932040  3429 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:07.933903  1600 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:07.934653  1532 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:07.940544  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:07.932889  3368 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:07.948201  1681 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:58:07.949462  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:07.955428  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.976195  1602 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:07.957715  3368 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:07.978865  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.979625  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:07.962983  3449 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:07.963692  3408 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:07.983888  1528 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
W20260709 12:58:07.985550  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 156445us
I20260709 12:58:07.929544  3448 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:07.988804  2344 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:07.994251  3150 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:07.994684  3150 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:07.995040  3150 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:07.979310  3382 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:58:07.987986  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.990453  1647 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:07.991207  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.016076  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.024366  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.026572  1649 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.030912  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:07.971673  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:58:08.065451  1532 raft_consensus.cc:606] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:08.076357  3428 consensus_queue.cc:1059] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:58:07.997289  3399 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:58:08.065346  3430 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.984472  3405 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.066236  3424 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:08.082057  3448 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.066008  3387 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:08.082161  3405 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.083354  3387 raft_consensus.cc:3055] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:08.083801  3387 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:08.048029  3419 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:08.086216  3150 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:08.087255  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56695.1us
W20260709 12:58:08.087819  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 98355.9us
I20260709 12:58:08.091542  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:08.092665  3150 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:58:08.092976  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:08.093894  1528 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:08.094318  2461 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:08.003324  3347 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:58:08.031423  3473 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:07.993782  3449 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.095911  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.082203  3424 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:08.086258  3456 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.104058  3456 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:08.102281  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.111572  3456 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:08.081429  3430 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.126659  3449 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.129359  3461 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:08.106065  3473 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:08.134610  3473 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.137032  1528 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
W20260709 12:58:08.163053  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 132222us
I20260709 12:58:08.164142  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.165635  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:08.178944  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:08.179971  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.179971  1605 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:08.182652  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:08.182220  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:08.139654  3407 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.186445  3424 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:08.186666  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:08.197288  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:08.198112  1600 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:08.187292  3449 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:08.187837  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.185133  3386 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:08.173362  3461 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:08.201467  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.202004  3448 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:08.199724  3407 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.207275  3407 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.158419  3387 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:08.212666  3455 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:08.215047  3430 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.201681  3403 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:08.220283  3403 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:08.220902  3403 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:08.222028  3461 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:58:08.224759  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.249960  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.250775  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.251096  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.253687  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50940.6us
I20260709 12:58:08.213061  3459 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:08.257754  3453 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:08.258206  3453 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:08.257506  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.259056  3453 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:08.260257  3459 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:08.260462  3453 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:08.266870  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:08.270183  1649 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.271093  1428 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 4, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:08.275049  3386 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:08.276110  3441 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:08.278111  2461 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEARNER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:08.283788  3346 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:08.284382  3346 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.285984  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:08.286746  2451 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:08.298040  2344 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:08.309437  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:08.365175  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64216.5us
I20260709 12:58:08.372803  1527 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:58:08.370764  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 68423.7us
I20260709 12:58:08.363410  3370 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:08.291131  3459 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:08.370579   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:58:08.382202   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:08.388870  1500 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:08.389487  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 80148.8us
I20260709 12:58:08.390275  1649 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.391223  3284 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:08.391673  3284 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.391981  3284 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.392722  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.395541  1675 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:08.394974  3486 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:08.395069  3405 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:08.397104  3486 raft_consensus.cc:697] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:08.398087  3486 consensus_queue.cc:237] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:08.396198  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.398756  3387 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.405609  1679 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:08.417330  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.418144  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:08.418707  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.420966  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.423918  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.420251  1647 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:08.391327  3370 raft_consensus.cc:697] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:08.431547  1683 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:08.432145  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.437541  1608 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:58:08.433837  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.395213  3402 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:08.427860  1575 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:08.438608  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 61652.6us
I20260709 12:58:08.439054  1675 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:08.440019  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.440903  1680 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:08.441949  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:08.444605  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:08.445128  1607 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:08.445163  1682 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:08.446499  1676 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:08.444334  3414 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:08.456979  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.449239  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.462162  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:08.443079  3473 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:08.470260  1682 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:08.477876  3284 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.489701  3284 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.489938  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:08.490626  1526 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
W20260709 12:58:08.494199  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.401070  3368 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.464563  3402 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:08.465991  3473 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:08.466713  3414 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:08.505934  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.509716  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.523664  1498 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:08.518860  3284 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:08.497712  3483 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:58:08.550041  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.516321  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:08.568622  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:08.570914  1609 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.498103  3399 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:58:08.535558  3470 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:08.563843  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.574353  1682 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:08.523553  3473 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:08.584465  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.588784  1676 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:08.521957  3346 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:08.566406  3398 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:08.575410  3470 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.572518  3405 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:08.530754  3370 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.602728  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.598315  3429 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.623191  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.600939  3470 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.595130  3426 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:08.600400  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.644723  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.598706  3398 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.630807  3430 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.650660  1680 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:08.604972  3405 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.654654  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.660849  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:08.661545  2461 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:08.663997  1682 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:08.670511  1602 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:08.634649  3429 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:08.604050  3402 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:08.684239  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:08.685393  1682 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:08.638005  3414 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:08.687456  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.690722  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:08.692803  3284 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:08.693341  3284 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:08.690450  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.570039  3407 raft_consensus.cc:2955] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:08.567523  3421 raft_consensus.cc:2955] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:08.653923  3430 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.696681  3284 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.650837  3426 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:08.702916  1609 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:08.702104  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.704689  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.706072  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.707013  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.708259  1681 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
W20260709 12:58:08.709455  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.712831  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.720333  1683 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:08.728878  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.737124  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.737056  1529 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:08.766942  1681 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:08.781965  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 272) took 1197 ms. Trace:
I20260709 12:58:08.782573  1529 rpcz_store.cc:276] 0709 12:58:07.584906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.587319 (+  2413us) service_pool.cc:224] Handling call
0709 12:58:08.781730 (+1194411us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003f5cd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:08.781879 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485441792}
W20260709 12:58:08.810169  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 81287.4us
W20260709 12:58:08.812258  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.819155  1675 raft_consensus.cc:1217] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 12:58:08.819748  1675 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:58:08.808239  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 273491us
I20260709 12:58:08.822009  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:08.828536  3150 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.829121  3150 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:08.832168  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.830824  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.835564  1677 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:08.836406  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.840061  3150 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:08.842723  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 152064us
I20260709 12:58:08.844465  1498 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:08.841251  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:08.847316  2461 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.849713  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:08.850482  1609 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:08.856432  3441 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:08.837863  3398 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:08.861068  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.847738  3405 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.858500  3441 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:08.865962  1674 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:08.864087  3430 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.874521  1680 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:58:08.885777  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.889348  3501 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:08.894764  3501 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.895152  3426 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:08.895774  3501 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:08.895998  3426 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.896659  3426 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.857254  3429 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:08.900955  3398 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.884760  3470 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:08.901674  3398 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.903697  3470 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:08.904253  3398 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.855333  3492 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.910399  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:08.910984  3368 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.911129  2455 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:08.912227  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:08.912340  1500 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:08.913019  2421 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:08.913304  3405 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:08.913740  3405 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.914193  3405 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.918066  3473 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.919340  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.920210  3473 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.920416  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.920820  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41270 (request call id 225) took 1760 ms. Trace:
W20260709 12:58:08.869251  3403 consensus_meta.cc:287] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.006s
I20260709 12:58:08.922500  3403 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.923998  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.925041  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.904281  1675 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:08.929831  3492 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.934338  3403 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.934489  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.935114  1678 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:08.935796  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.936486  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:08.936856  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.937052  1600 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:08.937758  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.921175  1429 rpcz_store.cc:276] 0709 12:58:07.146975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.147128 (+   153us) service_pool.cc:224] Handling call
0709 12:58:08.907640 (+1760512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:08.097945 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:08.104539 (+  6594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:08.104592 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:58:08.104628 (+    36us) tablet.cc:662] Decoding operations
0709 12:58:08.105234 (+   606us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:08.109855 (+  4621us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:08.109900 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:58:08.110375 (+   475us) tablet.cc:701] Row locks acquired
0709 12:58:08.110428 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:58:08.110648 (+   220us) write_op.cc:270] Start()
0709 12:58:08.110812 (+   164us) write_op.cc:276] Timestamp: P: 1783601888110563 usec, L: 0
0709 12:58:08.110862 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:58:08.111634 (+   772us) log.cc:844] Serialized 919 byte log entry
0709 12:58:08.404373 (+292739us) op_driver.cc:464] REPLICATION: finished
0709 12:58:08.436276 (+ 31903us) write_op.cc:301] APPLY: starting
0709 12:58:08.436391 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:08.436580 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:08.436742 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:08.437236 (+   494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:08.505640 (+ 68404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:08.534936 (+ 29296us) write_op.cc:312] APPLY: finished
0709 12:58:08.600119 (+ 65183us) log.cc:844] Serialized 29 byte log entry
0709 12:58:08.624870 (+ 24751us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:08.630851 (+  5981us) write_op.cc:454] Released schema lock
0709 12:58:08.642476 (+ 11625us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:08.720056 (+ 77580us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b540012e900. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d5302161 00007f25d53d733d 00007f25d53d03c2 00007f25d53cfb53 00007f25d53d3d61 00007f25d53d3d19 00007f25d53d3ca9 00007f25d53d3c71 00007f25d53d2e9d 000000000038f354 000000000038f199
0709 12:58:08.720315 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:08.720345 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106446,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":31514,"apply.run_cpu_time_us":6509,"apply.run_wall_time_us":283997,"mutex_wait_us":122,"num_ops":2,"prepare.queue_time_us":125019,"prepare.run_cpu_time_us":22102,"prepare.run_wall_time_us":165291,"raft.queue_time_us":136183,"raft.run_cpu_time_us":39246,"raft.run_wall_time_us":215392,"replication_time_us":293311,"spinlock_wait_cycles":16866432,"thread_start_us":306935,"threads_started":4,"wal-append.queue_time_us":143867}]]}
I20260709 12:58:08.941941  3441 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.947520  2461 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:08.935161  1680 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:08.921447  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.958973  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.958973  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.960671  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.961835  1675 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:08.963327  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:08.967988  1600 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.968232  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.968914  1677 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 3: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:08.970037  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.964869  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:08.969667  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.982275  3429 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:08.982877  3429 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:08.983354  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:08.984858  3426 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.985849  3347 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:08.986405  3347 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:08.979588  3501 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.989137  3451 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.989946  3501 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:08.990850  1677 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:08.989670  3451 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.983347  3429 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:08.992022  1677 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:08.992868  3451 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:08.993271  1677 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:08.993752  3493 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.987766  3347 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:08.995035  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:09.004215  1530 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:09.006304  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:09.007584  3368 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.007992  3368 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.008319  3368 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.998576  1678 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:09.000537  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:08.949397  3492 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.001297  3493 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.001101  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:08.999285  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:08.981031  3387 consensus_meta.cc:287] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.003s
I20260709 12:58:09.028118  1676 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:09.037734  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.038091  1682 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:09.026804  3470 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.041608  3470 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.042275  3470 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.024355  3371 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.025218  3430 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:09.048828  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.051124  1600 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:09.058152  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:09.092542  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.092335  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.093113  1678 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:09.097146  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.097890  1675 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:09.100750  3429 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.103160  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:09.106746  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.056708  3371 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.112608  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.115948  1680 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:09.116200  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:09.117115  1532 raft_consensus.cc:2368] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:58:09.117352  1528 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:09.064481  3430 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.126216  3150 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:09.129619  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.131985  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.132843  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:09.133076  2455 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:09.128733  3150 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.134004  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:09.135404  3150 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.133435  1534 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:09.139891  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 317926us
I20260709 12:58:09.140015  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.140823  1678 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:09.152763  3284 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.110793  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:09.154181  1683 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.153367  3284 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.157519  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.158085  1674 raft_consensus.cc:3055] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:09.158318  1680 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:09.158591  1674 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:09.159533  1674 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.160737  1674 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.164530  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:09.165614  3150 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:09.165961  3150 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.166263  3150 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:09.173610  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.174394  3470 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:09.176221  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 46735.4us
I20260709 12:58:09.140985  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.177778  2461 raft_consensus.cc:1240] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:09.180521  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.182991  3150 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.182117  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:09.186599  3150 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.131245  3493 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.109184  3405 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.125795  3508 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:09.191826  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:09.187578  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 46723.7us
I20260709 12:58:09.195180  1675 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.196520  2475 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:09.214449  3284 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:09.225704  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.192301  2451 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:09.192492  3451 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:09.196372  3493 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.214653  2421 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:09.191668  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.245189  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.247303  3284 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.247748  1497 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:09.227252  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.186975  3503 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:09.238005  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.192359  3502 consensus_queue.cc:1059] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:58:09.241211  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.239619  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.226794  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:09.256199  3150 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.269979  3150 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.231119  1649 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.233896  3451 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.271130  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.271538  3451 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.271701  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.271929  2451 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:09.272468  3486 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:09.264739  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:09.273208  3486 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:09.265334  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.251192  2476 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:09.266249  3284 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.250265  1572 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.274978  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.267717  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:09.266474  2475 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:09.276124  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.280766  3402 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.287755  3382 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.288337  3382 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.289039  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:09.289412  3398 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.289875  3398 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.290283  1572 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.290467  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:09.291132  2461 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.291692  3414 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.292290  3394 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.292742  1534 raft_consensus.cc:2410] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:58:09.198206  3508 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.302073  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.302754  1682 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:09.303439  3508 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:09.304154  3508 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:09.305691  1500 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:09.292554  3284 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:09.301007  3430 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:09.236336  3516 consensus_queue.cc:1059] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:58:09.243570  3493 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.318923  3516 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:09.319981  3493 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.320714  2474 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:09.320869  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.291774  3398 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:09.321528  1601 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:09.308096  3150 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.309540  3470 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.309433  3414 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:09.237720  3509 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:58:09.323104  3414 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.323526  3414 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.307754  2423 raft_consensus.cc:2368] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3.
I20260709 12:58:09.326767  3503 raft_consensus.cc:3055] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:09.327178  3503 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:09.327705  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.328109  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.294668  3382 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.328509  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.328742  2476 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:09.328949  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.329402  2421 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:09.313953  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.315835  3405 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:09.316840  3284 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:09.317449  3429 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:09.317965  3511 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:09.330297  3503 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:09.332312  3503 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.321632  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.330325  3284 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.333307  3284 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.323135  3371 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:09.330825  3511 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:09.337971  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.337704  3451 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.338047  3511 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:09.338765  1606 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:09.339265  3511 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.340090  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.340494  3451 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:09.340746  1606 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:09.342007  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:09.342561  1606 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.314679  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.343155  1600 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:09.305357  3368 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:09.344220  3523 log.cc:927] Time spent T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:58:09.350334  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.351042  1600 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 1.
I20260709 12:58:09.356609  1606 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:09.328116  2339 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:09.359514  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:09.350502  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 74441.1us
I20260709 12:58:09.362901  1600 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:09.366231  2461 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:09.367802  1683 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:09.369994  1675 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:09.370721  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.371167  1500 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:09.371308  1600 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:09.373862  3284 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.375172  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:09.375732  1600 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.358516  3368 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:09.379257  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:09.373958  3452 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:09.388630  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:09.407853  2461 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:09.397881  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:09.410789   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:09.410640  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 235551us
I20260709 12:58:09.411707  1498 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:09.369222  3486 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:09.416680  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:09.417266  1675 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.380010  3508 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:09.421510  3284 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:09.423432  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.424057  1602 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:09.430439  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:09.429811  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:09.431332  2474 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.406939  3452 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.432283  1600 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:09.432785  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:09.434697  1681 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:09.438606  1607 raft_consensus.cc:2368] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3.
I20260709 12:58:09.438845  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 1637) took 1022 ms. Trace:
I20260709 12:58:09.441265  1649 leader_election.cc:400] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3.
I20260709 12:58:09.439265  1679 rpcz_store.cc:276] 0709 12:58:08.416904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.417039 (+   135us) service_pool.cc:224] Handling call
0709 12:58:09.434385 (+1017346us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54001b9c54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:09.438775 (+  4390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915313920}
I20260709 12:58:09.441428  1606 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:09.443707  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.443985  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.445075  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:09.445243  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:09.445624  1683 raft_consensus.cc:2376] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3. Re-sending same reply.
I20260709 12:58:09.446265  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.446465  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.446811  1678 raft_consensus.cc:2376] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3. Re-sending same reply.
I20260709 12:58:09.418507  3405 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:09.425143  3368 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:09.447566  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:09.449467  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:09.452468  2342 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:09.456545  2342 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.418411  3508 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:09.455683  1680 raft_consensus.cc:2376] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4. Re-sending same reply.
I20260709 12:58:09.454567  1604 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:09.385320  3402 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:58:09.456912  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.447831  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:09.453395  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:09.450145  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 182497us
I20260709 12:58:09.439507  3452 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.462857  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:09.465828  2461 raft_consensus.cc:2393] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:09.462517  1602 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:09.450992  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:09.467911  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:09.468776  1602 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.455399  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.431705  3387 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:58:09.459967  3508 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:09.475457  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.479483  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:09.479979  1604 raft_consensus.cc:2393] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:09.480085  1609 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.465770  1497 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:09.476742  1675 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:09.461544  3399 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.462822  3487 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:09.459707  3405 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:09.482545  3429 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:09.467887  3502 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:09.461647  3368 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:09.467432  2455 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.490761  1497 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:09.503726  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 55286.4us
I20260709 12:58:09.488741  3394 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.492019  3487 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.499928  1609 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:09.511853  3284 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:09.513883  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 223644us
I20260709 12:58:09.500675  3511 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.499256  3403 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:09.500411  3429 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.526729  1602 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:09.521982  2461 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:09.517361  1606 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:09.514911  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.510598  3487 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.552593  1572 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:09.514394  3502 raft_consensus.cc:697] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:09.573650  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 68545.2us
W20260709 12:58:09.571772  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 115282us
I20260709 12:58:09.580374  2342 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:09.498109  3414 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:09.585664  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.544095  3407 raft_consensus.cc:3055] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:09.586477  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:09.518126  3405 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:09.571089  3501 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:58:09.589875  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 99176.8us
I20260709 12:58:09.576130  3394 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:09.594846  1647 leader_election.cc:400] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3.
I20260709 12:58:09.570508  3509 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:58:09.615978  1647 leader_election.cc:403] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:58:09.617640  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 162317us
I20260709 12:58:09.606436  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:09.595850  3493 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.619881  3493 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.620401  3479 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.621969  3479 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.624209  3479 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:09.623925  3502 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.625279  3493 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.513747  2421 raft_consensus.cc:2955] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:09.627687  2474 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:09.621269  2342 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:09.591684  3368 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.629114  3492 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:09.629691  3492 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:09.630563  3492 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.632217  1500 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:09.618525  3518 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.309s	user 0.003s	sys 0.000s
W20260709 12:58:09.616466  3521 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.294s	user 0.003s	sys 0.000s
I20260709 12:58:09.634281  1534 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:09.586644  3371 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.596230  1608 raft_consensus.cc:2368] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:58:09.635025  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.636054  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:09.637189  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:09.646826  1529 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:09.642445  1606 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:58:09.643901  2474 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:09.646735  1531 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:58:09.637446  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:09.648161  1527 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.641585  1602 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:09.590245  3403 raft_consensus.cc:1064] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: attempting to promote NON_VOTER 1e45ac8b66854c2f905bf2c4114cb489 to VOTER
I20260709 12:58:09.615602  1607 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:09.653765  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:09.646260  1428 catalog_manager.cc:5697] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.588326  3407 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:09.669692  1428 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 4 to 5, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.604013  3347 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.645776  3370 raft_consensus.cc:2764] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:58:09.679502  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 88017.2us
I20260709 12:58:09.680265  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.650097  3371 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.678686  3284 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:09.598027  3387 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:58:09.710304  3284 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:09.676471  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:09.690079  3371 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:09.729607  2461 raft_consensus.cc:2955] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:09.731129  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 79088.2us
I20260709 12:58:09.732194  1649 leader_election.cc:400] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:58:09.687768  3536 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:09.732514  1649 leader_election.cc:403] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:58:09.734020  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.741180  1607 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
W20260709 12:58:09.742808  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 148088us
I20260709 12:58:09.745054  1647 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:09.717782  3511 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:09.688410  3347 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.753933  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:09.734758  3486 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3.
I20260709 12:58:09.714574  3535 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.767251  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:09.762123  1530 raft_consensus.cc:2393] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 2: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:09.751039  3536 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:09.772802  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 92588.1us
I20260709 12:58:09.766970  3511 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:09.770370  3346 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:09.778919  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.782553  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.734519  3407 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.785652  3402 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:09.786793  3402 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:09.788831  3536 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.786810  3407 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.681910  3470 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:09.793483  1497 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.796866  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:09.797744  2476 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.776583  3429 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:09.801103  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.774021  3414 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:09.778559  3532 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:09.833575  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 179887us
I20260709 12:58:09.793252  1526 raft_consensus.cc:2955] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:09.834966  3284 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:09.829775  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 83507.6us
I20260709 12:58:09.783332  3346 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.777383  3530 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:58:09.836910  3525 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:09.787698  3402 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.798846  3539 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:58:09.840170  3346 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.837311  3541 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.839854  3526 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.843194  3532 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:09.886525  3525 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:09.891599  1527 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:09.844866  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:09.891916  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.845433  3441 consensus_queue.cc:1059] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:58:09.877173  3526 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:58:09.910318  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 72922.9us
I20260709 12:58:09.911083  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:09.916162  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 79001.7us
I20260709 12:58:09.911149  3526 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:09.923254  1498 leader_election.cc:400] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:58:09.923614  1498 leader_election.cc:403] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:09.863508  3511 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:09.929174  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:09.929538  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.930025  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.930271  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:09.932906  1606 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:09.895479  3429 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:58:09.952111  1608 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
W20260709 12:58:09.948853  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 216953us
I20260709 12:58:09.956342  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.957988  1572 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.964771  1608 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.964813  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:09.967355  3547 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:09.967867  3547 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:09.968576  3549 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.925659  3541 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:09.970465  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:09.972750  2342 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:09.917232  3543 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.929175  3347 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:09.929080  3387 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:09.953938  3414 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:09.969848  3501 raft_consensus.cc:2764] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:58:09.974502  3509 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:10.012241  2476 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:09.998697  3550 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:58:10.014510  3544 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.989674  3387 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.016594  3544 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:09.951340  3532 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:09.995945  3498 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:09.991240  2455 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:10.019544  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:10.027685  3493 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.032335  3284 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:09.919232  3526 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.035034  3526 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.039482  3550 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:10.040083  3550 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:10.015565  3441 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:10.046030  1572 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:10.047705  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:10.078234  1572 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:10.079859  3501 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:10.080489  3501 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:10.081135  3501 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:10.002319  3543 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.083534  3371 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:10.084084  3503 consensus_meta.cc:287] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
I20260709 12:58:10.085060  3441 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.085687  3441 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.087184  2474 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:58:10.088279  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.091135  1608 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:10.021908  3498 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.098290  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:10.117483  3527 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:10.123720  3347 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:10.086376  3547 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.130026  3547 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:10.132319  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:10.097325  3394 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:10.133309  1608 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.121492  3498 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.141676  3548 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.155589  1527 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:10.125950  3371 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:10.161881  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.040987  3550 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.168566  1608 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:10.185010  1607 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:10.135310  3527 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:10.182139  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:10.159852  3526 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:10.182780  3398 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:58:10.195691  3487 consensus_meta.cc:287] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260709 12:58:10.226490  3284 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:10.232360  3284 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.235292  3284 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:10.221835  3493 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:10.235821  3535 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:58:10.261032  1429 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:10.276194  1429 catalog_manager.cc:5697] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:10.282831  3441 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:10.285594  3387 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:10.287009  3387 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.287448  3387 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.290068  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:10.290422  3543 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:10.290761  1601 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:10.292924  1498 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:10.295480  3441 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:10.295872  3441 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.296209  3441 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.291914  3543 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:10.298045  3543 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:10.300341  3543 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:10.306677  3387 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:10.322405  3441 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.278868  1429 catalog_manager.cc:5697] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.325716  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:10.326277  1609 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.335026  1609 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:10.218031  3526 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.336309  1498 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:10.346516  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:10.351166  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.350019  3527 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.181361  3548 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.252211  3487 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.360396  3441 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:10.360749  3487 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:10.337846  3452 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.860s	user 0.006s	sys 0.007s
I20260709 12:58:10.356313  3535 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:10.358531  3394 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:10.411466  3402 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.438565  3548 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:10.448645  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:10.454854  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:10.455575  1609 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.458002  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:10.471817  1603 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:10.476272  1498 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:10.267320  3498 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.479709  3347 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:10.370685  3550 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:10.488471  3549 consensus_meta.cc:287] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.519s	user 0.000s	sys 0.009s
I20260709 12:58:10.405936  3544 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:10.371291  3452 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.494889  3347 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:10.500298  3347 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:10.491878  3346 consensus_meta.cc:287] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.000s
I20260709 12:58:10.505957  1609 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:10.497187  3549 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:58:10.510322  3498 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:10.514245  3526 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:10.480473  3368 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:58:10.515239  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:10.526818  3508 consensus_meta.cc:287] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.038s	user 0.013s	sys 0.000s
I20260709 12:58:10.545595  3508 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.548445  3508 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:10.530704  3346 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.555547  2475 raft_consensus.cc:1240] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:10.527817  3452 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:10.409057  3394 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.571750  3394 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:10.577850  1530 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:10.598250  3346 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:10.564502  2342 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:10.602236  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.041s	sys 0.033s
W20260709 12:58:10.602859  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.042s	sys 0.033s
W20260709 12:58:10.603199  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 734569us
I20260709 12:58:10.603494  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:10.606609  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:10.607175  1600 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:10.610327  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 134175us
I20260709 12:58:10.611415  2475 raft_consensus.cc:2368] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
W20260709 12:58:10.613801  1526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.022s	sys 0.064s
W20260709 12:58:10.615517  1526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.022s	sys 0.064s
I20260709 12:58:10.614935  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:10.609869  3535 raft_consensus.cc:697] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:10.624261  1609 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:10.627604  1600 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:10.630611  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:10.639178  1605 raft_consensus.cc:2393] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:10.642992  1498 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:10.650441  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1599) took 1031 ms. Trace:
I20260709 12:58:10.625892  3429 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:10.632308  3498 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:10.632921  3405 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:10.633013  3441 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:10.655891  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:10.637090  3492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.004s	sys 0.028s
I20260709 12:58:10.645468  3525 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:10.667246  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 60764.4us
I20260709 12:58:10.663595  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:10.700863  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.701210  3544 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:10.726586  3555 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:58:10.710228  2435 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.032s	sys 0.138s
W20260709 12:58:10.728834  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.696978  3535 consensus_queue.cc:237] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:10.786219  1526 rpcz_store.cc:276] 0709 12:58:09.618856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.648223 (+ 29367us) service_pool.cc:224] Handling call
0709 12:58:09.792468 (+144245us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:09.792710 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:09.792951 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:09.960294 (+167343us) log.cc:844] Serialized 14 byte log entry
0709 12:58:10.650004 (+689710us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.650074 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:10.650141 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.650227 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.650371 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23042,"raft.queue_time_us":25236,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":2324224,"thread_start_us":654258,"threads_started":1}
I20260709 12:58:10.789116  3429 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:10.786731  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 143855us
I20260709 12:58:10.792309  3405 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.837671  3405 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:10.819291  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:10.822666  1605 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:10.830909  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:10.833922  3430 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.846534  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1697) took 1005 ms. Trace:
I20260709 12:58:10.867522  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:10.794242  3508 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:10.891170  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:10.806022  3492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.006s	sys 0.028s
W20260709 12:58:10.871445  2344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.560s (SENT) [suppressed 28 similar messages]
I20260709 12:58:10.867444  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:10.892177  1603 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.890874  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:10.889815  1602 rpcz_store.cc:276] 0709 12:58:09.841219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.841377 (+   158us) service_pool.cc:224] Handling call
0709 12:58:09.841768 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:09.847015 (+  5247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:09.847048 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:09.855192 (+  8144us) log.cc:844] Serialized 26 byte log entry
0709 12:58:10.154663 (+299471us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:10.154731 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.154833 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:10.846335 (+691502us) raft_consensus.cc:1685] finished
0709 12:58:10.846357 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.846479 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519,"raft.queue_time_us":5993,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5705,"thread_start_us":260393,"threads_started":1,"wal-append.queue_time_us":775961}
I20260709 12:58:10.866295  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:10.899657  1608 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
W20260709 12:58:10.829239  2435 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.033s	sys 0.139s
I20260709 12:58:10.804922  3498 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:10.914526  1681 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:10.899291  2342 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:10.895777  3508 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:10.920948  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:10.921317  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:10.921598  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.000s	sys 0.039s
I20260709 12:58:10.921640  1676 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:58:10.922109  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.000s	sys 0.039s
W20260709 12:58:10.924163  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 952685us
I20260709 12:58:10.931087  1602 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:58:10.931413  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.847304  3429 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:10.935576  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:10.892994  3394 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.828830  1525 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:10.945945  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:10.810159  3441 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.946854  1681 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.812521  3525 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.923616  3508 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:10.935806  3492 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:10.770578  3403 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:10.831755  3544 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:10.958626  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.012s	sys 0.022s
I20260709 12:58:10.958989  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:10.960563  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.012s	sys 0.023s
W20260709 12:58:10.936794  3541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.010s	sys 0.029s
I20260709 12:58:10.914292  3430 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:10.975481  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.947469  3394 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:10.976805  3541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.010s	sys 0.033s
I20260709 12:58:10.976498  3526 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:10.986507  1604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.012s	sys 0.006s
W20260709 12:58:11.021283  1604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.012s	sys 0.006s
I20260709 12:58:10.988927  1681 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:10.972398  3492 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:10.990906  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.017s	sys 0.004s
W20260709 12:58:11.022786  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.017s	sys 0.004s
W20260709 12:58:10.970649  3546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.043s	sys 0.051s
W20260709 12:58:11.006476  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.024s	sys 0.076s
I20260709 12:58:11.008216  3284 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.007515  1497 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:10.983048  3530 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:11.007071  3502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.011s	sys 0.033s
I20260709 12:58:10.989786  3553 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.984483  3541 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:10.989774  3548 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:11.057533  3553 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:10.986327  3470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.001s	sys 0.018s
W20260709 12:58:11.020294  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.004s	sys 0.017s
I20260709 12:58:11.027145  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:11.028750  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.025s	sys 0.076s
W20260709 12:58:11.067499  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.004s	sys 0.017s
I20260709 12:58:11.028026  3284 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.038972  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:11.040983  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:11.041884  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.006s	sys 0.015s
W20260709 12:58:11.074007  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.006s	sys 0.015s
W20260709 12:58:11.010099  3537 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.043s	sys 0.097s
W20260709 12:58:11.020394  3550 consensus_meta.cc:287] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.523s	user 0.003s	sys 0.008s
W20260709 12:58:11.041528  3502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.011s	sys 0.033s
W20260709 12:58:10.955826  3536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.014s	sys 0.028s
W20260709 12:58:11.039599  3546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.043s	sys 0.051s
I20260709 12:58:11.057018  1575 leader_election.cc:400] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
W20260709 12:58:11.034904  2421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.005s	sys 0.018s
I20260709 12:58:11.063652  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:11.064983  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:11.058106  3541 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.073457  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:11.037691  3405 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:11.074347  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:11.125876  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 51634us
W20260709 12:58:11.075515  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 48450us
I20260709 12:58:11.078011  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.128257  1680 raft_consensus.cc:2368] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3.
I20260709 12:58:11.078698  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:11.119992  2421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.005s	sys 0.018s
W20260709 12:58:11.076936  3537 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.044s	sys 0.098s
W20260709 12:58:11.086004  3536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.015s	sys 0.029s
I20260709 12:58:11.095618  3492 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.060268  3526 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:11.140750  3526 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:11.143337  3526 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:11.098874  3430 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:11.099359  3550 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:11.008533  3498 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.144694  3430 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:11.104892   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:11.057550  3548 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.055233  3402 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.043561  3530 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.084863  3551 consensus_queue.cc:1059] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:58:11.151962  3551 raft_consensus.cc:3055] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:11.152319  3551 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:11.153126  3551 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.153654  1682 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:11.154452  3551 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.154526  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:11.154982  3560 log.cc:927] Time spent T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:58:11.107569  3549 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:11.109054  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.156502  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.110594  3284 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:11.067107  3470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.001s	sys 0.018s
I20260709 12:58:11.066368  3547 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:11.124569  1679 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:58:11.127714  1676 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:11.133149  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:11.080515  1603 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:11.159458  1681 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.130599  1572 leader_election.cc:400] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3.
I20260709 12:58:11.160311  1572 leader_election.cc:403] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:11.160744  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:11.134429  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:11.144968  3550 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:11.106813  3556 log.cc:927] Time spent T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:58:11.147588  3402 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.128355  3441 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:11.086266  1575 leader_election.cc:403] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:11.183218  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.183323  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:11.184065  1676 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:11.184834  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.161825  1680 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.186559  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:11.187353  1603 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:11.129901  3539 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.185128  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.129801  3525 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:11.137442  3536 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:11.194010  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.193380  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.128909  3405 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.160805  3548 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:11.179191  3547 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:11.196870  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 457) took 1737 ms. Trace:
I20260709 12:58:11.203837  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:11.195498  3501 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:11.157758  3430 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.204532  2421 rpcz_store.cc:276] 0709 12:58:09.459105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.459730 (+   625us) service_pool.cc:224] Handling call
0709 12:58:09.497471 (+ 37741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:09.508428 (+ 10957us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:09.997443 (+489015us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.185602 (+1188159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:11.189594 (+  3992us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:11.192505 (+  2911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.193624 (+  1119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.195149 (+  1525us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1239,"raft.queue_time_us":20140,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5821,"thread_start_us":1120275,"threads_started":1}
I20260709 12:58:11.179447  3429 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.193661  3452 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:11.192525  3509 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:11.211475  2455 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:11.217765  1674 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:11.212689  3544 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:11.213208  3497 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:11.213961  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.191386  3530 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:11.215236  2461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.029s	sys 0.022s
I20260709 12:58:11.192408  3407 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 2. Current term is 3.
I20260709 12:58:11.219265  1676 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:11.226740  1681 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:11.236318  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:11.190070  3550 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.303467  3550 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:11.199429  3502 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:58:11.308300  3530 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:11.310978  3430 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:11.312492  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:11.314435  3402 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:11.298152  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 115278us
W20260709 12:58:11.322813  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.326120  3553 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:11.283732  3527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.007s	sys 0.022s
W20260709 12:58:11.327193  3527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.007s	sys 0.022s
I20260709 12:58:11.327677  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1735) took 1035 ms. Trace:
I20260709 12:58:11.298604  3497 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.328205  1604 rpcz_store.cc:276] 0709 12:58:10.292065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.292172 (+   107us) service_pool.cc:224] Handling call
0709 12:58:10.292535 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.292935 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.292966 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.293431 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.022089 (+728658us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:11.022151 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.022242 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.327431 (+305189us) raft_consensus.cc:1685] finished
0709 12:58:11.327454 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.327613 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9109,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":727995,"threads_started":1,"wal-append.queue_time_us":956879}
I20260709 12:58:11.330601  3497 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:11.258250  3509 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.334472  1680 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:11.336601  3509 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:11.212020  3511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.027s	sys 0.004s
I20260709 12:58:11.202852  3547 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:11.256409  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.015s	sys 0.018s
W20260709 12:58:11.366240  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.015s	sys 0.018s
W20260709 12:58:11.212540  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.013s	sys 0.035s
I20260709 12:58:11.203159  3394 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:11.193182  3539 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.368965  3539 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:11.275894  2461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.029s	sys 0.022s
W20260709 12:58:11.370807  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:11.369513  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.013s	sys 0.035s
W20260709 12:58:11.254936  3347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.008s	sys 0.037s
I20260709 12:58:11.249917  3501 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.374155  3501 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:11.374646  3347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.009s	sys 0.038s
W20260709 12:58:11.349771  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.005s
W20260709 12:58:11.381742  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.010s	sys 0.005s
I20260709 12:58:11.329334  3405 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:11.258033  3452 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:11.383780  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.004s	sys 0.013s
I20260709 12:58:11.483266  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 232) took 1357 ms. Trace:
I20260709 12:58:11.482509  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1612) took 1094 ms. Trace:
W20260709 12:58:11.485342  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.005s	sys 0.014s
I20260709 12:58:11.485145  1532 rpcz_store.cc:276] 0709 12:58:10.388221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.388404 (+   183us) service_pool.cc:224] Handling call
0709 12:58:10.395756 (+  7352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.396189 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.396218 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.396859 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.371987 (+975128us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:11.372044 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.372144 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.482260 (+110116us) raft_consensus.cc:1685] finished
0709 12:58:11.482281 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.482442 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1430,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":2362,"thread_start_us":974608,"threads_started":1,"wal-append.queue_time_us":1080789}
W20260709 12:58:11.486613  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 117275us
W20260709 12:58:11.366173  3511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.028s	sys 0.004s
W20260709 12:58:11.400405  2344 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.004s
I20260709 12:58:11.484391  1606 rpcz_store.cc:276] 0709 12:58:10.125926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.126507 (+   581us) service_pool.cc:224] Handling call
0709 12:58:10.127778 (+  1271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.186167 (+ 58389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.186207 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.189978 (+  3771us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.074445 (+884467us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:11.074499 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.085858 (+ 11359us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b540035f554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:11.085906 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.482936 (+397030us) raft_consensus.cc:1685] finished
0709 12:58:11.482962 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.483181 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":4733,"spinlock_wait_cycles":133295872,"thread_start_us":856526,"threads_started":1,"wal-append.queue_time_us":1168143}
I20260709 12:58:11.381551  3407 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:11.517490  2344 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.012s	sys 0.015s
W20260709 12:58:11.520725  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 649265us
I20260709 12:58:11.466522  3553 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:11.520975  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 500895us
W20260709 12:58:11.517761  1605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.030s	sys 0.041s
I20260709 12:58:11.528990  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:11.527343  1605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.030s	sys 0.041s
W20260709 12:58:11.383925  3535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.012s
I20260709 12:58:11.494784  3564 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:11.382624  3508 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:11.517318  3532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.010s	sys 0.017s
W20260709 12:58:11.538183  3535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.011s	sys 0.017s
W20260709 12:58:11.586524  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 458868us
I20260709 12:58:11.535012  3553 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.533686  3407 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:11.574712  1609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.005s	sys 0.017s
W20260709 12:58:11.587714  3532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.012s	sys 0.023s
I20260709 12:58:11.599527  1500 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:11.602358  1609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.017s
I20260709 12:58:11.586647  3539 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:11.627319  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.011s	sys 0.008s
W20260709 12:58:11.627069  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.023s
W20260709 12:58:11.591945  2435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.011s	sys 0.007s
I20260709 12:58:11.548499  3564 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.636085  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:11.636446  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:11.628818  2342 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:11.548734  3568 consensus_queue.cc:1059] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
W20260709 12:58:11.792157  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.013s	sys 0.034s
I20260709 12:58:11.792955  1531 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:11.823271  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:11.703431  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.009s	sys 0.007s
W20260709 12:58:11.825776  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.015s	sys 0.008s
I20260709 12:58:11.826702  1572 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:11.816689  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:11.663810  1678 raft_consensus.cc:2955] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:11.827750  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.015s	sys 0.011s
W20260709 12:58:11.904203  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 871736us
W20260709 12:58:11.845042  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.816687  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:11.905998  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 79297.7us
I20260709 12:58:11.906960  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:11.906206  1533 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:11.833768  1677 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:11.866039  3576 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:58:11.679440  3511 consensus_queue.cc:1059] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.232s
I20260709 12:58:11.912014  3405 raft_consensus.cc:3055] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:11.912503  3405 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:11.913331  3405 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.914485  3405 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:11.910426  3574 raft_consensus.cc:3055] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:11.917806  3574 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:11.864614  3572 log.cc:927] Time spent T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 12:58:11.918784  3574 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.920745  3574 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:11.815492  1527 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:11.739046  3394 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.922580  3394 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:11.871843  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:11.924608  1525 raft_consensus.cc:2410] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:11.924683  3394 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:11.846093  3430 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:11.925660  3430 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.926749  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:11.927896  3430 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:11.862581  3578 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
I20260709 12:58:11.663019  3535 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:11.929893  3535 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:11.626788  3502 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
W20260709 12:58:11.857868  3571 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:58:11.931452  3535 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:11.942453  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.966126  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 464) took 1494 ms. Trace:
I20260709 12:58:11.966585  2461 rpcz_store.cc:276] 0709 12:58:10.471848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.472024 (+   176us) service_pool.cc:224] Handling call
0709 12:58:10.472503 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.472759 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.472801 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.478014 (+  5213us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.369898 (+891884us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:11.369953 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.370047 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.965873 (+595826us) raft_consensus.cc:1685] finished
0709 12:58:11.965894 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.966061 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":891495,"threads_started":1,"wal-append.queue_time_us":1119149}
W20260709 12:58:11.641242  3403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.027s	sys 0.011s
W20260709 12:58:11.982779  3403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.035s	sys 0.030s
W20260709 12:58:11.795121  2435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.014s	sys 0.010s
I20260709 12:58:11.795636  3532 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.989787  3532 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:11.739254  3579 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:58:11.785627  3580 log.cc:927] Time spent T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:58:11.685675  3492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.016s	sys 0.031s
W20260709 12:58:12.001750  3492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.022s	sys 0.042s
I20260709 12:58:12.001896  3509 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:11.706467  3551 consensus_meta.cc:287] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.005s
I20260709 12:58:12.002566  3509 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:11.627406  3539 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.003930  3539 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:11.738300  2455 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:12.008374  3501 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:12.009084  3501 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:11.999451  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 94442.5us
W20260709 12:58:11.999490  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 370725us
I20260709 12:58:12.003026  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 383) took 1191 ms. Trace:
W20260709 12:58:12.000818  3584 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.134s	user 0.001s	sys 0.003s
I20260709 12:58:12.011150  1675 rpcz_store.cc:276] 0709 12:58:10.812013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.816395 (+  4382us) service_pool.cc:224] Handling call
0709 12:58:10.835203 (+ 18808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.835409 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.835436 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.835888 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.382588 (+546700us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:11.382629 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.382695 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:12.002766 (+620071us) raft_consensus.cc:1685] finished
0709 12:58:12.002785 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.002941 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":546293,"threads_started":1,"wal-append.queue_time_us":750342}
I20260709 12:58:12.012349  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:12.015225  1533 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
W20260709 12:58:11.866838  3582 log.cc:927] Time spent T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:58:12.016496  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 487520us
I20260709 12:58:11.796180  3537 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.030874  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:12.031600  1533 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:12.034706  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:11.902930  3429 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:11.903898  3527 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:12.058660  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.057204  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:12.059377  1526 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:12.064836  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1731) took 1839 ms. Trace:
I20260709 12:58:12.065251  1607 rpcz_store.cc:276] 0709 12:58:10.225114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.227758 (+  2644us) service_pool.cc:224] Handling call
0709 12:58:10.228160 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.228608 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.228647 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.236651 (+  8004us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.068595 (+831944us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:11.068661 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.069268 (+   607us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:12.064598 (+995330us) raft_consensus.cc:1685] finished
0709 12:58:12.064621 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.064762 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2860,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":18248,"thread_start_us":797383,"threads_started":1,"wal-append.queue_time_us":1007749}
I20260709 12:58:12.070839  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:12.071601  1534 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:12.079552  3564 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:12.080700  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1742) took 1241 ms. Trace:
I20260709 12:58:12.081110  1600 rpcz_store.cc:276] 0709 12:58:10.839814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.843051 (+  3237us) service_pool.cc:224] Handling call
0709 12:58:10.843429 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.843700 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.843736 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.844612 (+   876us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.486152 (+641540us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:11.486195 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.486283 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:12.080494 (+594211us) raft_consensus.cc:1685] finished
0709 12:58:12.080516 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.080643 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":640742,"threads_started":1,"wal-append.queue_time_us":756519}
I20260709 12:58:12.081938  3532 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:12.082734  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 72879.1us
I20260709 12:58:12.009510  3501 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.087911  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 245) took 1217 ms. Trace:
I20260709 12:58:12.061293  3574 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:58:12.088444  1605 rpcz_store.cc:276] 0709 12:58:10.870448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.925527 (+ 55079us) service_pool.cc:224] Handling call
0709 12:58:10.925872 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.926297 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.926336 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.937549 (+ 11213us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.530265 (+592716us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:11.530320 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.530416 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.903568 (+373152us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:12.087560 (+183992us) raft_consensus.cc:1685] finished
0709 12:58:12.087589 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.087852 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9193,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8512,"spinlock_wait_cycles":16494464,"thread_start_us":584679,"threads_started":1,"wal-append.queue_time_us":917757}
W20260709 12:58:12.088086  3581 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:58:12.105700  1526 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:12.081871  3509 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:12.112071  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 102759us
I20260709 12:58:12.091925  3394 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:12.119033  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:12.138609  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:12.119813  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:12.139433  1609 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:12.123652  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:12.119190  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:12.139371  1608 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:12.141117  1602 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:12.111331  3347 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:12.084017  3527 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:12.160712  3509 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.052857  3537 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.190070  3532 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.216945  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1615) took 1575 ms. Trace:
I20260709 12:58:12.161595  3407 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:12.215900  3532 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.211656  3553 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.274531  1603 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:58:12.275002  3592 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:58:12.293268  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1672) took 1223 ms. Trace:
W20260709 12:58:12.240126  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 156718us
I20260709 12:58:12.274781  3508 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:12.249792  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1675) took 1178 ms. Trace:
W20260709 12:58:12.290783  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 383861us
I20260709 12:58:12.297276  1683 rpcz_store.cc:276] 0709 12:58:11.070971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.096279 (+ 25308us) service_pool.cc:224] Handling call
0709 12:58:11.096712 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.097075 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.097128 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.097686 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.793014 (+695328us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:11.793059 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.793496 (+   437us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:12.249516 (+456020us) raft_consensus.cc:1685] finished
0709 12:58:12.249536 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.249714 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1324,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":694891,"threads_started":1,"wal-append.queue_time_us":1090155}
I20260709 12:58:12.268646  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:12.293649  1678 rpcz_store.cc:276] 0709 12:58:11.070049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.070900 (+   851us) service_pool.cc:224] Handling call
0709 12:58:11.071428 (+   528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.072033 (+   605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.072057 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.126318 (+ 54261us) log.cc:844] Serialized 564 byte log entry
0709 12:58:11.663662 (+537344us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:11.943684 (+280022us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.943978 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.944054 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:12.192855 (+248801us) raft_consensus.cc:1685] finished
0709 12:58:12.192889 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.293202 (+100313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"thread_start_us":474286,"threads_started":1,"wal-append.queue_time_us":1054166}
I20260709 12:58:12.304668  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:12.309958  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.312019  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:12.312804  1683 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:12.322894  3403 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.323127  3553 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.323529  3403 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.325719  3533 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.326263  3533 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.328135  3402 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.328051  3539 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:12.328706  3402 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:12.331599  3547 consensus_meta.cc:287] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.931s	user 0.007s	sys 0.004s
I20260709 12:58:12.332051  3547 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.334849  3508 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:12.335477  3508 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:12.296259  3551 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:58:12.336819  3551 consensus_queue.cc:1243] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:12.337344  3551 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:12.337699  3551 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:12.338424  3551 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.338892  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:12.339469  1676 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:12.323660  3553 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.301692  3532 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.291759  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 461) took 2401 ms. Trace:
I20260709 12:58:12.232832  3509 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:12.381098  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 263351us
I20260709 12:58:12.381500  3604 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.395717  3604 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.318589  3599 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:58:12.393462  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:12.391180  3609 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:12.405752  1674 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:12.405820  3609 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:12.397863  3502 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.406947  3537 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.407249  3502 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.413769  3347 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:12.419991  3347 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.421712  3394 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.422444  3394 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.439293  1528 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:12.387416  3501 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.385342  3508 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:12.521159  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.382395  2435 rpcz_store.cc:276] 0709 12:58:09.889942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.890142 (+   200us) service_pool.cc:224] Handling call
0709 12:58:09.919530 (+ 29388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:09.929096 (+  9566us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:10.913811 (+984715us) log.cc:844] Serialized 14 byte log entry
0709 12:58:12.291229 (+1377418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:12.291316 (+    87us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:12.291381 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:12.291484 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.291663 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24715,"prepare.queue_time_us":1036180,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":317709,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":54010,"thread_start_us":2271538,"threads_started":3,"wal-append.queue_time_us":1148203}
I20260709 12:58:12.505527  3532 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.593008  3544 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.623957  3544 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.615660  3532 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.585220  3574 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.648598  3574 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.585911  3407 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:12.217834  1530 rpcz_store.cc:276] 0709 12:58:10.641460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.645363 (+  3903us) service_pool.cc:224] Handling call
0709 12:58:11.038328 (+392965us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:11.061828 (+ 23500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.090838 (+ 29010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.105755 (+ 14917us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.106381 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.600863 (+494482us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:11.606375 (+  5512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.627265 (+ 20890us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:12.216586 (+589321us) raft_consensus.cc:1685] finished
0709 12:58:12.216611 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.216869 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4102528,"thread_start_us":478216,"threads_started":1,"wal-append.queue_time_us":1031588}
I20260709 12:58:12.771443  3609 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:12.776165  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 480913us
I20260709 12:58:12.777267  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:12.781387  3508 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.782299  3508 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.775686  3509 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:12.825981  3394 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.827389  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:12.828094  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 49555.6us
I20260709 12:58:12.829257  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:12.830550  1526 raft_consensus.cc:2410] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:58:12.833024  1528 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:58:12.834462  2343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.000s	sys 0.002s
I20260709 12:58:12.837805  1530 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.766630  3599 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:12.763360  3452 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:12.775658  3502 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.862545  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:12.893812  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:12.869868  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 102657us
I20260709 12:58:12.887864  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:12.888640  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:12.896986  1680 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:12.894215  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:12.889390  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:12.657217  3407 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:12.898233  1526 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:12.904881  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:12.904944  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 76032.5us
I20260709 12:58:12.907226  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:12.907929  1526 raft_consensus.cc:2410] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:58:12.911320  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:12.912207  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:12.903151  3599 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.913291  1525 raft_consensus.cc:2410] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:58:12.915352  3599 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.915815  3508 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.918872  3553 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.919420  3553 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.919852  3553 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.920477  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1711) took 1284 ms. Trace:
I20260709 12:58:12.926316  3533 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.889775  3609 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:12.891633  3509 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.863873  3619 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:12.900882  3501 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:12.931742  1529 rpcz_store.cc:276] 0709 12:58:11.636285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.636696 (+   411us) service_pool.cc:224] Handling call
0709 12:58:11.637022 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.998511 (+361489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.998540 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:12.013312 (+ 14772us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:12.013372 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:12.920259 (+906887us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400318dd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:12.920303 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.920420 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830782208}
I20260709 12:58:12.936488  3533 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.935822  3547 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.927373  3607 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:58:12.947619  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:12.937743  3509 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.954867  3553 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.957772  3509 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.959720  1530 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:12.962589  3407 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:12.965150  3508 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:12.965821  3508 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:12.967868  3508 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:12.969949  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:12.970818  3508 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:12.971293  3508 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:12.946902  3501 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.971860  3508 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.973768  3619 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:12.976053  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:12.952033  3533 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:12.977063  1604 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:12.978682  3533 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:12.982226  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 54872.9us
I20260709 12:58:12.939492  3609 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:12.973465  3501 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:12.992705  3574 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:13.003201  3626 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:58:13.007486  1500 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:13.014191  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:13.021399  3577 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.163s	user 0.009s	sys 0.005s
I20260709 12:58:13.025974  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.028481  3508 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.029273  3527 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:13.030623  3508 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.031288  3508 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:13.033357  3508 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:13.035382  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 556) took 1445 ms. Trace:
I20260709 12:58:13.035977  2421 rpcz_store.cc:276] 0709 12:58:11.590418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.599201 (+  8783us) service_pool.cc:224] Handling call
0709 12:58:13.034300 (+1435099us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:13.034530 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.034858 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:13.034906 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:13.034982 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:13.035038 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.035130 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.035309 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9236352}
W20260709 12:58:13.041404  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.042991  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1706) took 1411 ms. Trace:
I20260709 12:58:13.043601  1532 rpcz_store.cc:276] 0709 12:58:11.631877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.633153 (+  1276us) service_pool.cc:224] Handling call
0709 12:58:13.041965 (+1408812us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:13.042263 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.042514 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:13.042557 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:13.042625 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:13.042676 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.042759 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.042912 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8119040}
I20260709 12:58:13.045949  3612 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:13.046587  3612 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.048507  3609 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:13.048758  3631 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:13.021999  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.053977  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.055415  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.056414  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.057008  3607 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:13.057083  3604 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.057638  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.057910  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.063911  1604 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:13.070779  3539 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:13.071226  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.074345  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.075380  2461 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:13.077456  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.079728  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.080602  1525 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:13.080677  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.058506  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.059238  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.060926  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:13.082413  2475 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:13.082945  1572 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:13.083773  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.084340  3609 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:13.084760  3609 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.085117  3609 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:13.085970  2344 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:13.087785  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.089633  3527 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:13.090111  3619 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.090418  3527 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.090919  3527 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:13.092259  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.079810  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.094427  3612 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:13.096230  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.097158  2428 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:13.099324  2461 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:13.057700  3607 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.101382  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.098181  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.104570  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.104822  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.105444  1529 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:13.107127  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.089839  3452 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:13.110179  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.111222  1606 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:13.098203  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:13.117580  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 110170us
I20260709 12:58:13.120626  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.121450  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.104019  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:13.103104  3539 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:13.126978  3628 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.127624  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:13.108122  3604 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:13.109791  3533 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.113067  3452 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.118521  3619 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.116591  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.145535  1500 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:13.155126  3619 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.156275  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.157696  3633 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:13.146286  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.163028  3508 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:13.145253  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.121793  3553 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:13.148065  3607 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:13.119485  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.148463  3452 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.143573  3604 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.143599  3628 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.151994  3527 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:13.144572  3539 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.173816  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.174490  1534 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:13.157855  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.157739  3638 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.145942  3530 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:13.165132  3509 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.163985  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.195706  1500 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:13.164126  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.196691  3403 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.196849  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.197374  3633 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:13.197682  2421 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:13.166250  2428 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:13.134709  3599 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:13.166546  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:13.171448  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50907.2us
I20260709 12:58:13.178481  3527 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:13.182137  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41270 (request call id 226) took 3795 ms. Trace:
W20260709 12:58:13.188128  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 49374.1us
I20260709 12:58:13.184327  2344 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:13.197553  2423 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:13.196632  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.204375  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.205364  3403 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.205892  3609 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:13.206626  3603 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.012s	user 0.003s	sys 0.012s
I20260709 12:58:13.206964  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.208012  3403 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:13.208108  3609 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:13.208489  3403 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.208885  3403 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:13.209497  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1614) took 2073 ms. Trace:
I20260709 12:58:13.210207  3628 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.175118  3539 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.208825  1531 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:13.215868  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1715) took 1467 ms. Trace:
I20260709 12:58:13.209903  1677 rpcz_store.cc:276] 0709 12:58:11.135781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.215617 (+ 79836us) service_pool.cc:224] Handling call
0709 12:58:11.254640 (+ 39023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.259884 (+  5244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.259927 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.338196 (+ 78269us) log.cc:844] Serialized 564 byte log entry
0709 12:58:11.833597 (+495401us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:11.938273 (+104676us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.938661 (+   388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.938733 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:13.205909 (+1267176us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:13.209207 (+  3298us) raft_consensus.cc:1685] finished
0709 12:58:13.209306 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.209433 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":184,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"spinlock_wait_cycles":16848640,"thread_start_us":494723,"threads_started":1,"wal-append.queue_time_us":747206}
I20260709 12:58:13.216269  1531 rpcz_store.cc:276] 0709 12:58:11.748560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.794258 (+ 45698us) service_pool.cc:224] Handling call
0709 12:58:13.208457 (+1414199us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:13.208659 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.215612 (+  6953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.215809 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7512448}
I20260709 12:58:13.226533  3586 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:13.226958  3586 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.227286  3586 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:13.230492  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:13.233878  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.158252  3533 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:13.241073  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.250108  1531 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:13.175329  3553 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.245261  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:13.255676  1609 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:13.247045  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.247756  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:13.201339  3547 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:13.250972  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.244475  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.259496  1609 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:13.225276  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.198175  3633 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:58:13.258075  1531 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:13.265027  1600 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:13.268613  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.263278  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:13.253463  3371 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:13.220556  2455 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 1.
I20260709 12:58:13.270301  3371 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.267587  3368 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:13.274565  3368 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.201399  1428 rpcz_store.cc:276] 0709 12:58:09.381162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.381323 (+   161us) service_pool.cc:224] Handling call
0709 12:58:13.176036 (+3794713us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:09.909862 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:09.921194 (+ 11332us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:09.921241 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:58:09.921265 (+    24us) tablet.cc:662] Decoding operations
0709 12:58:09.984419 (+ 63154us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:09.986954 (+  2535us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:09.987009 (+    55us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:58:09.994483 (+  7474us) tablet.cc:701] Row locks acquired
0709 12:58:09.994511 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:58:09.994933 (+   422us) write_op.cc:270] Start()
0709 12:58:09.995504 (+   571us) write_op.cc:276] Timestamp: P: 1783601889994644 usec, L: 0
0709 12:58:09.995536 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:58:10.134744 (+139208us) log.cc:844] Serialized 915 byte log entry
0709 12:58:12.188444 (+2053700us) op_driver.cc:464] REPLICATION: finished
0709 12:58:12.827372 (+638928us) write_op.cc:301] APPLY: starting
0709 12:58:12.827448 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:12.827561 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:12.827667 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:12.886308 (+ 58641us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:12.886602 (+   294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:12.886681 (+    79us) write_op.cc:312] APPLY: finished
0709 12:58:12.894118 (+  7437us) log.cc:844] Serialized 29 byte log entry
0709 12:58:12.908794 (+ 14676us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:12.923086 (+ 14292us) write_op.cc:454] Released schema lock
0709 12:58:12.926902 (+  3816us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:12.942082 (+ 15180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:12.943511 (+  1429us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":638620,"apply.run_cpu_time_us":2777,"apply.run_wall_time_us":110500,"num_ops":2,"prepare.queue_time_us":177467,"prepare.run_cpu_time_us":101035,"prepare.run_wall_time_us":1207528,"raft.queue_time_us":1226385,"raft.run_cpu_time_us":92292,"raft.run_wall_time_us":680308,"replication_time_us":2192710,"thread_start_us":1689112,"threads_started":4,"wal-append.queue_time_us":1100190}]]}
I20260709 12:58:13.279595  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:13.282388  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.283509  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.284291  1531 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:13.287132  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.258025  3643 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:13.212906  3599 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.288311  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.289755  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.292430  1531 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:13.199863  3509 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.293612  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.296442  1534 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:13.277078  3452 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.297688  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.281105  3628 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:13.286360  3368 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:13.291675  3633 consensus_queue.cc:1243] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:13.291661  3574 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:13.308630  2476 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:13.290864  3643 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:13.277102  3586 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.309494  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.300613  1527 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:13.333760  3607 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:13.331547  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 131609us
I20260709 12:58:13.343997  1534 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:13.335767  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:13.345284  1527 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.348796  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.302335  3614 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:13.305094  3346 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.303485  3628 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.353497  3346 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.353997  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:58:13.354592  3509 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.354792  1601 raft_consensus.cc:606] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:13.355926  3621 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.587s	user 0.002s	sys 0.000s
I20260709 12:58:13.356030  3346 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:13.356645  3614 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.357937  3628 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.359206  3614 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:13.359369  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 315) took 3666 ms. Trace:
I20260709 12:58:13.360193  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.309119  3574 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.361232  1534 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:13.361501  3574 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:13.331974  3643 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.365814  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.370116  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:13.371014  2455 raft_consensus.cc:2368] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8.
I20260709 12:58:13.372200  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1721) took 1248 ms. Trace:
I20260709 12:58:13.372826  3527 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:13.346278  3607 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.375415  3607 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:13.381083  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.381989  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.382728  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.386484  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:13.387399  1607 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:13.372610  1605 rpcz_store.cc:276] 0709 12:58:12.123546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.161743 (+ 38197us) service_pool.cc:224] Handling call
0709 12:58:12.270945 (+109202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:12.496868 (+225923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:12.496912 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:12.511834 (+ 14922us) log.cc:844] Serialized 26 byte log entry
0709 12:58:12.769416 (+257582us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:12.769465 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.355354 (+585889us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:13.371849 (+ 16495us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400256cd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:13.371902 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:13.371962 (+    60us) raft_consensus.cc:1685] finished
0709 12:58:13.371981 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.372138 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":27210,"spinlock_wait_cycles":534120064,"thread_start_us":194350,"threads_started":1,"wal-append.queue_time_us":193546}
I20260709 12:58:13.389196  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.359814  1429 rpcz_store.cc:276] 0709 12:58:09.693183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.693620 (+   437us) service_pool.cc:224] Handling call
0709 12:58:13.359302 (+3665682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:11.096913 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:11.097454 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:11.097481 (+    27us) write_op.cc:435] Acquired schema lock
0709 12:58:11.097498 (+    17us) tablet.cc:662] Decoding operations
0709 12:58:11.098082 (+   584us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:11.098132 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:11.098158 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:11.098489 (+   331us) tablet.cc:701] Row locks acquired
0709 12:58:11.098508 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:58:11.098634 (+   126us) write_op.cc:270] Start()
0709 12:58:11.098734 (+   100us) write_op.cc:276] Timestamp: P: 1783601891098589 usec, L: 0
0709 12:58:11.098755 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:58:11.099360 (+   605us) log.cc:844] Serialized 1433 byte log entry
0709 12:58:12.394686 (+1295326us) op_driver.cc:464] REPLICATION: finished
0709 12:58:12.926254 (+531568us) write_op.cc:301] APPLY: starting
0709 12:58:12.926334 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:12.926467 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:12.926588 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:12.957208 (+ 30620us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:12.957418 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:12.957467 (+    49us) write_op.cc:312] APPLY: finished
0709 12:58:12.990606 (+ 33139us) log.cc:844] Serialized 35 byte log entry
0709 12:58:12.996729 (+  6123us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:12.999432 (+  2703us) write_op.cc:454] Released schema lock
0709 12:58:12.999501 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:13.012443 (+ 12942us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:13.015021 (+  2578us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":174727,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":515643,"apply.run_cpu_time_us":6673,"apply.run_wall_time_us":80416,"num_ops":3,"prepare.queue_time_us":769423,"prepare.run_cpu_time_us":2699,"prepare.run_wall_time_us":2699,"replication_time_us":1295704,"thread_start_us":479376,"threads_started":1}]]}
I20260709 12:58:13.391368  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.392149  1605 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:13.395963  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.396698  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.398725  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.399317  1534 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:13.399564  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.400086  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.402076  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.350769  3641 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:13.407212  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:13.408696  3646 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 12:58:13.408969  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.408702  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.410324  3647 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:58:13.373448  3527 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.515075  3452 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:13.565897  1600 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:13.529397  3614 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:13.570540  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.559376  1432 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 2 to 3, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.575071  1432 catalog_manager.cc:5697] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.538506  3553 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.586558  1432 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 3 to 4, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.560030  3567 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:13.474609  3641 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.608826  3567 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.617419  3567 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.618129  3567 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:13.618593  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:13.619025  3567 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:13.619606  1417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 228930us
I20260709 12:58:13.584714  3533 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:13.659040  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 261282us
W20260709 12:58:13.661616  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:13.599361  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 203393us
I20260709 12:58:13.668964  1607 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:13.671804  1498 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.675191  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.570091  3614 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.679720  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:13.671761  1527 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:13.685702  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.614289  3599 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.702477  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.697500  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.703424  1605 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:13.704437  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:13.704873  1606 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
W20260709 12:58:13.706591  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 419036us
I20260709 12:58:13.708988  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:13.711643  3544 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.712496  3544 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:13.717973  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:13.722368  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.725447  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:13.726569  1533 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:13.728401  1604 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:13.730132  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:13.738245  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.713394  3544 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:13.747547  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:13.748826  1528 raft_consensus.cc:2410] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:58:13.750424  3619 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:13.756559  1606 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:13.690841  3567 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.702481  3628 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:13.696453  3655 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:13.754290  3599 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:13.697353  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.768371  2344 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:13.759347  3586 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:13.774448  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.786373  2344 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:13.787508  2475 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:13.789692  3502 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:13.794535  2344 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:13.795708  1529 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.027s	sys 0.047s
W20260709 12:58:13.776521  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 430475us
W20260709 12:58:13.797217  1529 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.028s	sys 0.047s
I20260709 12:58:13.791390  3502 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.811822  2475 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:13.811923  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:13.813228  1500 leader_election.cc:400] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8.
I20260709 12:58:13.813584  1500 leader_election.cc:403] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:58:13.765695  3553 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.776136  3599 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.771353  3676 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:13.822857  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 125575us
I20260709 12:58:13.788295  3452 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:13.794364  3567 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:13.799013  3610 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:13.808282  3619 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:13.859469  3532 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.859730  3649 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:13.860021  3502 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.784240  3655 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.860540  3643 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.842823  2435 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:58:13.843799  3658 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:13.832033  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 101973us
I20260709 12:58:13.843937  3676 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:13.846350  3650 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:58:13.817508  3487 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:13.841049  3599 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:13.849063  3527 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:13.876621  3544 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:13.842666  3651 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:13.856040  3567 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.856642  3452 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:13.886439  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:14.038807  1602 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:14.039103  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:14.039752  1529 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.040777  3643 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:13.858882  3619 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:14.041488  3402 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:14.041860  3619 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.019012  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:14.018029  1528 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:14.050465  1527 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:13.886607  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:14.051909  1528 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:14.053546  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 214138us
I20260709 12:58:13.851912  3664 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:14.054049  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 167492us
I20260709 12:58:13.991148  2342 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:13.848752  3652 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:14.105849  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:14.108367  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:14.109462  1676 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:14.081176  1647 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:14.111248  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:14.112128  1676 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:13.866304  3610 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:14.120223  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:14.032269  3403 consensus_meta.cc:287] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.005s
I20260709 12:58:14.118832  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:13.922215  2451 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:14.119628  3574 consensus_meta.cc:287] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.758s	user 0.017s	sys 0.006s
I20260709 12:58:13.825832  3553 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:14.042861  3614 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:14.120738  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:14.137332  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:14.121055  1677 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:14.058262  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:14.123890  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:14.125433  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:14.128427  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:14.144397  1678 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.886471  3551 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:14.131431  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:14.130407  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:14.057246  1528 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.043488  3638 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.133263  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:14.151201  3574 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:13.956988  3676 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:14.190505  3614 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.201393  3574 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:14.190495  3628 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:14.202402  3638 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:13.914300  3633 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:14.043077  3394 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.056095  3658 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:14.145936  1529 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
W20260709 12:58:14.184124  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 193064us
W20260709 12:58:14.185070  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.185702  1678 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:13.884665  3666 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:14.087874  3402 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:14.187719  1675 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:13.994392  3641 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:14.078982  3567 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:14.189605  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 108536us
I20260709 12:58:14.087857  3664 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.223953  3664 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:14.114873  3532 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.125455  3652 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.187332  3527 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:14.234150  3487 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:58:14.221069  3610 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.240074  3527 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:14.195720  2344 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:14.241150  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 45526.5us
I20260709 12:58:13.941238  3663 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.197419  1528 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:14.175176  3403 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:14.206537  1674 raft_consensus.cc:2368] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6.
I20260709 12:58:14.133611  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:14.211104  1676 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:14.220809  3402 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.223220  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:14.115231  3649 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:58:14.088644  3651 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.220738  3666 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:14.355901  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.006s	sys 0.017s
I20260709 12:58:14.242683  2344 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:14.698639  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.017s	sys 0.027s
W20260709 12:58:14.698935  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 456302us
W20260709 12:58:14.619091  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.278821  1682 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
W20260709 12:58:14.699059  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 1.0347e+06us
W20260709 12:58:14.700870  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 477764us
W20260709 12:58:14.380978  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.012s	sys 0.013s
W20260709 12:58:14.701918  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.026s	sys 0.017s
W20260709 12:58:14.375406  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.011s	sys 0.014s
I20260709 12:58:14.213406  3658 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.702687  1498 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:14.470830  3668 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.721738  3620 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:14.685182  3669 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:14.702741  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.021s	sys 0.023s
I20260709 12:58:14.720259  1498 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:14.455121  2455 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.004s	sys 0.024s
W20260709 12:58:14.435127  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.722349  3620 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:14.231437  3676 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:14.422042  3501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.014s	sys 0.013s
W20260709 12:58:14.452035  1534 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.039s	sys 0.042s
W20260709 12:58:14.746265  1534 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.039s	sys 0.048s
I20260709 12:58:14.747416  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 352) took 1363 ms. Trace:
I20260709 12:58:14.747829  1534 rpcz_store.cc:276] 0709 12:58:13.383802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.406663 (+ 22861us) service_pool.cc:224] Handling call
0709 12:58:13.577338 (+170675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.577633 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:13.772035 (+194402us) log.cc:844] Serialized 14 byte log entry
0709 12:58:14.746893 (+974858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:14.746964 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:14.747017 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.747101 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.747344 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114435,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":30,"raft.queue_time_us":503322,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":1125718,"threads_started":2}
I20260709 12:58:14.749722  1676 pending_rounds.cc:85] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 1
I20260709 12:58:14.754251  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:14.218878  3394 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.770152  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:14.721956  3668 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.750105  1676 pending_rounds.cc:107] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:14.764864  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:14.777773  1676 raft_consensus.cc:2889] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:14.696156  3638 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:14.744572  2455 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.004s	sys 0.039s
W20260709 12:58:14.761473  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 631097us
I20260709 12:58:14.766561  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:14.770334  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:14.230799  3612 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.504s
I20260709 12:58:14.722872  3647 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.773164  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:14.655931  1484 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.004s	sys 0.021s
I20260709 12:58:14.778221  1529 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.773201  2421 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:58:14.423005  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:14.794533  1417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 371575us
W20260709 12:58:14.448652  3502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.021s	sys 0.024s
I20260709 12:58:14.474924  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:14.732947  3681 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:58:14.799490  3681 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:14.800956  3681 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.805773  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:14.817412  3681 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:14.819034  3681 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:14.819552  3681 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:14.820640  3681 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:14.823930  3681 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.827822  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:14.830227  3666 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:14.831056  3666 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:14.831694  3666 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:14.833796  3659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.009s	sys 0.006s
W20260709 12:58:14.834378  3659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.009s	sys 0.006s
I20260709 12:58:14.761855  3402 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:14.745759  3501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.018s	sys 0.026s
I20260709 12:58:14.549453  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:14.214967  3633 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:14.837890  1525 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:14.839298  3633 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:14.840772  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:14.786403  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:14.841398  1603 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:14.841924  1532 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
W20260709 12:58:14.778501  2461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 567) took 1659 ms (client timeout 1642 ms). Trace:
I20260709 12:58:14.843631  1498 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:14.782691  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:14.460386  3452 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:14.765070  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:14.849838  1605 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:14.847437  1608 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:14.848158  2461 rpcz_store.cc:269] 0709 12:58:13.099882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.100564 (+   682us) service_pool.cc:224] Handling call
0709 12:58:14.754044 (+1653480us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:14.758942 (+  4898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7097728}
I20260709 12:58:14.446600  3553 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:14.857587  3633 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:14.858047  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 72833us
I20260709 12:58:14.871068  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:14.471743  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 481) took 1075 ms. Trace:
I20260709 12:58:14.623538  3675 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:14.862277  1531 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:14.756590  3533 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:58:14.778990  3663 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:14.863348  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 80729.1us
I20260709 12:58:14.874082  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:14.349900  3670 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8.
W20260709 12:58:14.850729  3599 consensus_meta.cc:287] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.003s
I20260709 12:58:14.860536  3641 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:14.881047  1647 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:14.860733  3647 raft_consensus.cc:697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:14.771867  3669 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:14.851496  3508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.017s	sys 0.014s
I20260709 12:58:14.497042  3619 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.868471  3652 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:14.847035  3502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.023s	sys 0.029s
I20260709 12:58:14.870565  3633 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:14.913612  2474 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.026s	sys 0.030s
I20260709 12:58:15.297437  3651 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:14.912284  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:14.898712  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:15.225951  1601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.034s	sys 0.061s
W20260709 12:58:15.185708  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 450370us
I20260709 12:58:14.849807  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:15.177448  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.004s	sys 0.011s
W20260709 12:58:14.966215  3508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.017s	sys 0.014s
I20260709 12:58:14.875625  3527 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:14.905081  3532 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.881376  3553 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:14.959535  3551 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.904668  3599 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.358161  3666 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.358347  3599 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:15.189751  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.000s	sys 0.013s
I20260709 12:58:14.903012  3620 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:14.989069  3633 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:15.025362  3635 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.370328  3635 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.371429  3655 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.070600  3647 consensus_queue.cc:237] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.372807  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:14.875397  3649 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:14.867036  3658 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:14.957093  3656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.038s	sys 0.059s
W20260709 12:58:15.386140  3656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.615s	user 0.047s	sys 0.064s
I20260709 12:58:15.387279  1532 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:14.895490  3663 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:15.388654  3663 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:15.126230  3671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.025s	sys 0.077s
W20260709 12:58:15.392251  3671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.026s	sys 0.078s
I20260709 12:58:14.914325  3675 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:14.956885  3678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.003s	sys 0.015s
W20260709 12:58:15.394188  3678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.013s	sys 0.020s
I20260709 12:58:15.007431  3683 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:15.243110  1677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.000s	sys 0.007s
W20260709 12:58:15.250151  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.008s	sys 0.008s
I20260709 12:58:15.299749  3668 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.300034  3619 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:15.300137  3371 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:15.301833  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:15.305220  1528 consensus_meta.cc:287] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.012s
I20260709 12:58:15.314706  3394 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:15.400408  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.015s	sys 0.010s
I20260709 12:58:15.324990  3674 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:15.377140  3635 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:14.859074  1484 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.004s	sys 0.024s
I20260709 12:58:14.875715  2428 rpcz_store.cc:276] 0709 12:58:13.396587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.398275 (+  1688us) service_pool.cc:224] Handling call
0709 12:58:14.470747 (+1072472us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:14.470975 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:14.471252 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:14.471299 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:14.471361 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:14.471414 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.471500 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.471663 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20263296}
W20260709 12:58:15.331310  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 418944us
I20260709 12:58:15.332857  3673 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:15.338572  3679 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:15.339751  3533 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:15.341691  1601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.476s	user 0.038s	sys 0.073s
W20260709 12:58:15.342286  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 443500us
I20260709 12:58:15.345551  3651 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.346293  1530 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:58:15.346935  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.533s	user 0.013s	sys 0.026s
W20260709 12:58:15.360317  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.000s	sys 0.026s
W20260709 12:58:15.362891  1525 consensus_meta.cc:287] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.524s	user 0.017s	sys 0.013s
I20260709 12:58:15.363449  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:15.371958  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 412383us
I20260709 12:58:14.899614  3641 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:15.437351  3641 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.377939  3649 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:15.360000  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.003s	sys 0.012s
I20260709 12:58:15.316474  3403 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:15.325842  2474 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.027s	sys 0.039s
W20260709 12:58:15.404600  1677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.001s	sys 0.015s
W20260709 12:58:15.406420  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:15.411828  1527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.004s	sys 0.012s
I20260709 12:58:15.400377  3604 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.445403  3568 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:15.445883  3547 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:58:15.429164  3664 consensus_meta.cc:287] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.188s	user 0.021s	sys 0.000s
I20260709 12:58:15.425899  3673 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:15.426110  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 260) took 1742 ms. Trace:
I20260709 12:58:15.454201  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:15.414465  3675 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.434767  1525 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:15.438189  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 485) took 1385 ms. Trace:
I20260709 12:58:15.385106  3658 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.396029  3683 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.440575  3649 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:15.444518  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 359) took 1427 ms. Trace:
W20260709 12:58:15.446545  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.004s	sys 0.012s
I20260709 12:58:15.405305  3669 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.448676  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:15.423646  3533 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.452687  3674 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:15.456012  1527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.005s	sys 0.012s
I20260709 12:58:15.453928  1601 rpcz_store.cc:276] 0709 12:58:13.684031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.686491 (+  2460us) service_pool.cc:224] Handling call
0709 12:58:13.770840 (+ 84349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.799757 (+ 28917us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:13.864864 (+ 65107us) log.cc:844] Serialized 14 byte log entry
0709 12:58:15.425309 (+1560445us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:15.425415 (+   106us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:15.425527 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.425682 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:15.425929 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35734,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":6534,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":19947,"thread_start_us":1558488,"threads_started":1}
I20260709 12:58:15.459973  3651 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:15.460750  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 1.64746e+06us
I20260709 12:58:15.453058  3673 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.464825  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1635) took 1334 ms. Trace:
I20260709 12:58:15.465543  3604 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:15.465677  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.468237  3679 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.501892  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1625) took 1388 ms. Trace:
W20260709 12:58:15.502516  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 54084.7us
I20260709 12:58:15.502460  1676 rpcz_store.cc:276] 0709 12:58:14.113630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.117263 (+  3633us) service_pool.cc:224] Handling call
0709 12:58:14.117658 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:14.778295 (+660637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.501227 (+722932us) spinlock_profiling.cc:243] Waited 93 ms on lock 0x7b5400249fd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:15.501617 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213832576}
I20260709 12:58:15.503808  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:15.455422  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1633) took 1326 ms. Trace:
I20260709 12:58:15.506067  3695 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:15.506444  3604 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:15.507064  3695 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.508102  3604 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.489679  1528 rpcz_store.cc:276] 0709 12:58:14.017431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.017591 (+   160us) service_pool.cc:224] Handling call
0709 12:58:14.017902 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.443885 (+1425983us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:15.443952 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:15.444037 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:15.444091 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.444229 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:15.444423 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20041,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":262}
W20260709 12:58:15.496465  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 1729) took 2391 ms (client timeout 2905 ms). Trace:
I20260709 12:58:15.506268  3658 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:15.469522  3678 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.492115  3533 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:15.506059  1682 rpcz_store.cc:276] 0709 12:58:14.129142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.129288 (+   146us) service_pool.cc:224] Handling call
0709 12:58:15.454828 (+1325540us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b540015f754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:15.455094 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220436352}
I20260709 12:58:15.519228  1678 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:15.519407  3703 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.111s	user 0.001s	sys 0.001s
I20260709 12:58:15.524093  3666 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:15.525470  3688 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:15.526557  3617 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:15.527124  3688 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:15.527590  3688 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:15.511359  1525 rpcz_store.cc:269] 0709 12:58:13.100719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.102716 (+  1997us) service_pool.cc:224] Handling call
0709 12:58:14.509727 (+1407011us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:15.487504 (+977777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5148544}
I20260709 12:58:15.482187  2435 rpcz_store.cc:276] 0709 12:58:14.052703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.057085 (+  4382us) service_pool.cc:224] Handling call
0709 12:58:15.363087 (+1306002us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:15.438016 (+ 74929us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56739072}
I20260709 12:58:15.530563  3673 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:15.531175  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1761) took 2286 ms (client timeout 2053 ms). Trace:
I20260709 12:58:15.532025  3651 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:15.534394  1608 rpcz_store.cc:269] 0709 12:58:13.244753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.245662 (+   909us) service_pool.cc:224] Handling call
0709 12:58:14.474705 (+1229043us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b58000dfe98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:15.509248 (+1034543us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b54002be3d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:15.530980 (+ 21732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129481984}
I20260709 12:58:15.532409  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.536603  1682 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:15.481995  3664 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.547742  3568 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:15.548411  3568 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:15.496917  1677 rpcz_store.cc:276] 0709 12:58:14.129831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.138581 (+  8750us) service_pool.cc:224] Handling call
0709 12:58:14.138960 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:14.139444 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:14.139489 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:14.154130 (+ 14641us) log.cc:844] Serialized 26 byte log entry
0709 12:58:15.444479 (+1290349us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:15.444575 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.444980 (+   405us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:15.464419 (+ 19439us) raft_consensus.cc:1685] finished
0709 12:58:15.464436 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:15.464612 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23226,"raft.queue_time_us":96,"raft.run_cpu_time_us":12569,"raft.run_wall_time_us":42855,"thread_start_us":1199379,"threads_started":1,"wal-append.queue_time_us":1195789}
W20260709 12:58:15.550014  3567 consensus_meta.cc:287] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.296s	user 0.012s	sys 0.008s
I20260709 12:58:15.566413  1680 raft_consensus.cc:2368] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
W20260709 12:58:15.567176  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:15.570254  3567 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.574414  3641 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:15.549388  3674 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:15.577646  3681 consensus_meta.cc:287] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.625s	user 0.004s	sys 0.009s
I20260709 12:58:15.559955  3683 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.551537  3633 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.578979  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:15.581068  3633 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:15.573225  3567 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:15.584494  1533 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:15.537137  3678 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.609269  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.610270  3664 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:15.610527  1683 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
W20260709 12:58:15.611544  1529 consensus_meta.cc:287] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.764s	user 0.015s	sys 0.007s
I20260709 12:58:15.612026  1529 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
W20260709 12:58:15.614929  3697 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 12:58:15.582398  3655 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:15.621490  3690 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 12:58:15.624374  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1636) took 1494 ms. Trace:
I20260709 12:58:15.626318  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:15.628021  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 110337us
I20260709 12:58:15.613237  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:15.629328  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 487) took 1466 ms. Trace:
I20260709 12:58:15.633002  2474 rpcz_store.cc:276] 0709 12:58:14.135449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.135936 (+   487us) service_pool.cc:224] Handling call
0709 12:58:14.136282 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:14.136526 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:15.452829 (+1316303us) log.cc:844] Serialized 14 byte log entry
0709 12:58:15.553872 (+101043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:15.555998 (+  2126us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:15.560617 (+  4619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.591739 (+ 31122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:15.602205 (+ 10466us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1188270,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":134,"raft.queue_time_us":11625,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":3187,"thread_start_us":1339900,"threads_started":2,"wal-append.queue_time_us":149092}
I20260709 12:58:15.629477  1681 rpcz_store.cc:276] 0709 12:58:14.130099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.144828 (+ 14729us) service_pool.cc:224] Handling call
0709 12:58:14.145246 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:14.145532 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:14.145590 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:14.156729 (+ 11139us) log.cc:844] Serialized 26 byte log entry
0709 12:58:15.409412 (+1252683us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:15.418198 (+  8786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.429419 (+ 11221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:15.624103 (+194684us) raft_consensus.cc:1685] finished
0709 12:58:15.624123 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:15.624292 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1189903,"threads_started":1,"wal-append.queue_time_us":1388317}
W20260709 12:58:15.651958  3710 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:58:15.662457  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:15.678472  3649 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.674028  3633 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:15.675624  3656 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.676158  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:15.652216  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:15.676692  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:15.677660  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:15.678580  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:15.669697  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 45154.7us
W20260709 12:58:15.681574  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 128531us
I20260709 12:58:15.711684  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:15.644513  1601 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:15.679306  3666 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:15.725061  2475 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:15.651263  3688 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.724632  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.730283  1683 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:15.712245  3695 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:15.731256  3709 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:15.731982  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:15.732911  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:15.736550  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:15.744143  1678 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:15.740302  2474 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:15.717284  3647 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:15.743606  1525 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:15.754220  2423 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:15.755899  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:15.737797  3666 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.777058  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.777572  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:15.765825  3647 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.780277  1681 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:15.744374  3641 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:15.802445  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 49208.5us
I20260709 12:58:15.739670  3633 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.799952  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.750288  2451 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
W20260709 12:58:15.818678  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 173015us
I20260709 12:58:15.821385  1677 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:15.823302  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.823701  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:15.824980  1682 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:15.799712  3683 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:15.750011  3656 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.826769  3604 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:15.842113  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.845686  1677 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:15.822932  3695 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:15.848585  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 70729.1us
I20260709 12:58:15.849140  3698 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:15.821171  3609 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:15.853755  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:15.853945  1674 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:15.854840  3633 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:15.855508  1682 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:15.801842  3709 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.860677  3604 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.857440  3695 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:15.893972  3695 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:15.870899  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:15.870602  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:15.902367  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:15.903277  1603 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:15.847805  3683 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.864037  3649 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.870213  3666 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:15.910090  3620 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:58:15.870376  3502 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:15.858325  3668 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:15.896322  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.199s (SENT) [suppressed 38 similar messages]
I20260709 12:58:15.912642  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.874392  3604 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:15.856765  3533 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.926961  1674 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:15.927398  3617 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:15.864838  3609 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:15.931741  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 55466.6us
I20260709 12:58:15.934684  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:15.934808  2421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:15.935496  1607 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:15.935609  2421 raft_consensus.cc:606] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:15.936538  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:15.917732  3402 consensus_meta.cc:287] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.069s	user 0.012s	sys 0.010s
I20260709 12:58:15.937145  1602 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
W20260709 12:58:15.946590  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.893206  3698 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:15.943225  3663 consensus_meta.cc:287] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.553s	user 0.004s	sys 0.009s
I20260709 12:58:15.937865  3617 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:15.943864  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:15.938171  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:15.953823  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:15.947918  3647 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:15.937386  3568 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.948472  3402 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:15.976014  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.954121  3663 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.970214  3620 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:15.948686  3502 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:15.972558  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:15.949074  3668 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:16.014469  3609 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:16.010349  1682 raft_consensus.cc:2410] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:15.971544  3656 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:16.012934  3620 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.043901  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:16.059216  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.289917  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.046290  1679 raft_consensus.cc:2368] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5.
W20260709 12:58:16.250090  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1629) took 2129 ms (client timeout 1772 ms). Trace:
W20260709 12:58:16.284220  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.282548  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:16.313227  1680 rpcz_store.cc:269] 0709 12:58:14.123402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.123579 (+   177us) service_pool.cc:224] Handling call
0709 12:58:16.249801 (+2126222us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540015ed54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:16.250004 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3253598080}
W20260709 12:58:16.049381  3723 log.cc:927] Time spent T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
W20260709 12:58:16.347087  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 378638us
I20260709 12:58:16.354970  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:16.275705  3725 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.366s	user 0.002s	sys 0.000s
I20260709 12:58:16.311194  1681 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:16.320322  1603 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:16.303261  3698 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:16.279898  3724 log.cc:927] Time spent T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:58:16.269068  3533 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:16.265305  3712 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.687s	user 0.005s	sys 0.000s
I20260709 12:58:16.311120  3620 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.138993  3709 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:16.267396  3402 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:16.262920  3568 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:16.366263  1678 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:16.072769  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 479) took 2677 ms. Trace:
I20260709 12:58:16.369827  1498 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:16.371793  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.351365  3678 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:16.357489  3727 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.364630  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:16.380208  1675 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:16.382395  1498 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:16.259727  3617 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:16.383399  1498 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:16.375326  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:16.369338  3663 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:16.392717  3633 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:16.382360  3681 raft_consensus.cc:2764] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:16.373936  3668 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:16.378638  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:16.379683  3683 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:16.393088  3691 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.892s	user 0.006s	sys 0.000s
I20260709 12:58:16.384402  3647 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:16.396575  3666 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:16.397176  3633 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:16.385057  3727 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:16.421404  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.422127  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:16.422351  1678 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:16.409199  3668 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:16.406296  3647 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.417930  2451 raft_consensus.cc:2410] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:16.431259  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.432086  1681 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:16.427102  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:16.416656  3633 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:16.436815  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 79772.5us
I20260709 12:58:16.420353  3666 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:16.428803  3647 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:16.468927  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 85554.6us
I20260709 12:58:16.483409  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:16.476251  3617 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:16.491639  3695 consensus_meta.cc:287] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.597s	user 0.003s	sys 0.009s
I20260709 12:58:16.491943  3688 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.492182  3695 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:16.482007  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:16.494689  1525 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:16.498149  3679 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:16.511329  1526 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:16.511655  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:16.512744  1527 raft_consensus.cc:2393] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:16.511394  3695 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:16.514132  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:16.511771  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:16.514745  1609 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:16.515548  3679 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:16.516312  3679 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:16.523691  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:16.526666  1601 raft_consensus.cc:2393] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:16.527501  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:16.527938  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:16.379036  2455 rpcz_store.cc:276] 0709 12:58:13.395675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.398396 (+  2721us) service_pool.cc:224] Handling call
0709 12:58:13.539387 (+140991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.764429 (+225042us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:14.844960 (+1080531us) log.cc:844] Serialized 14 byte log entry
0709 12:58:15.420556 (+575596us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:15.439509 (+ 18953us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:15.482287 (+ 42778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.072247 (+589960us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54005235d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:16.072321 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.072559 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38781,"prepare.queue_time_us":1532625,"prepare.run_cpu_time_us":185,"prepare.run_wall_time_us":8547,"raft.queue_time_us":41697,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":26785,"spinlock_wait_cycles":493994880,"thread_start_us":1421199,"threads_started":2,"wal-append.queue_time_us":461739,"wal-append.run_cpu_time_us":2357,"wal-append.run_wall_time_us":1026481}
I20260709 12:58:16.528191  1601 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:16.529126  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:16.529654  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:16.530337  1602 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:16.531153  1601 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.535477  1682 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:16.536309  1525 pending_rounds.cc:85] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 5
I20260709 12:58:16.536634  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.536898  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:16.537627  1600 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:16.536661  1525 pending_rounds.cc:107] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:58:16.538147  1525 raft_consensus.cc:2889] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:16.524086  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:16.538692  1609 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:16.539423  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1634) took 2410 ms (client timeout 1591 ms). Trace:
W20260709 12:58:16.539877  1679 rpcz_store.cc:269] 0709 12:58:14.129443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.137027 (+  7584us) service_pool.cc:224] Handling call
0709 12:58:16.539160 (+2402133us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54001f7f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:16.539334 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4325869952}
I20260709 12:58:16.541057  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.537412  1682 raft_consensus.cc:2368] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5.
I20260709 12:58:16.541874  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:16.522110  3666 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:16.542704  1678 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:16.542861  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.544736  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.545919  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.546401  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.547119  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.547744  1677 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:16.550299  3727 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:16.550915  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.553042  3679 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:16.553943  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:16.554721  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:16.555325  1534 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.554754  1680 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:16.556067  1609 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:16.556998  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 360) took 4326 ms. Trace:
I20260709 12:58:16.558300  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.558954  1674 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:16.541741  2339 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:16.561048  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:16.561223  3612 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:16.561854  3730 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.568413  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.521793  1498 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:16.569432  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 47727.4us
I20260709 12:58:16.569833  1675 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:58:16.570936  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.571414  1498 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:16.587059  1498 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:16.588754  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:16.589759  1498 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:16.557381  1432 rpcz_store.cc:276] 0709 12:58:12.230550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.230756 (+   206us) service_pool.cc:224] Handling call
0709 12:58:12.409630 (+178874us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540012eb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1902090 00007f25d19a0f3a 00007f25d77571cc 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc 00007f25d5d15392 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:16.556805 (+4147175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:14.193553 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:14.194239 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:14.194287 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:58:14.194304 (+    17us) tablet.cc:662] Decoding operations
0709 12:58:14.198315 (+  4011us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:14.198375 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:14.198400 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:14.198732 (+   332us) tablet.cc:701] Row locks acquired
0709 12:58:14.198749 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:58:14.198903 (+   154us) write_op.cc:270] Start()
0709 12:58:14.199032 (+   129us) write_op.cc:276] Timestamp: P: 1783601894198851 usec, L: 0
0709 12:58:14.199063 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:58:14.344620 (+145557us) log.cc:844] Serialized 1312 byte log entry
0709 12:58:15.766207 (+1421587us) op_driver.cc:464] REPLICATION: finished
0709 12:58:15.855469 (+ 89262us) write_op.cc:301] APPLY: starting
0709 12:58:15.860516 (+  5047us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:15.864744 (+  4228us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:15.910554 (+ 45810us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:15.912827 (+  2273us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:15.913216 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:15.913275 (+    59us) write_op.cc:312] APPLY: finished
0709 12:58:15.918610 (+  5335us) log.cc:844] Serialized 35 byte log entry
0709 12:58:15.942725 (+ 24115us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:15.957240 (+ 14515us) write_op.cc:454] Released schema lock
0709 12:58:15.962089 (+  4849us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:16.025340 (+ 63251us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:16.025391 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":150316,"reported_tablets":8,"spinlock_wait_cycles":308482432,"child_traces":[["op",{"apply.queue_time_us":88891,"apply.run_cpu_time_us":4885,"apply.run_wall_time_us":159256,"num_ops":3,"prepare.queue_time_us":519423,"prepare.run_cpu_time_us":109716,"prepare.run_wall_time_us":1199616,"raft.queue_time_us":148655,"raft.run_cpu_time_us":4625,"raft.run_wall_time_us":56421,"replication_time_us":1566890,"thread_start_us":1278716,"threads_started":4,"wal-append.queue_time_us":1075633}]]}
I20260709 12:58:16.600906  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.608887  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.589054  3727 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:16.589190  3695 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:16.615078  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:58:16.615717  1608 raft_consensus.cc:606] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:16.616074  1608 raft_consensus.cc:614] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:16.596061  3732 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:16.604064  3547 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:16.621219  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:16.590235  3688 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:58:16.622334  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.623581  1678 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:16.613647  3727 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.611981  1427 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.632352  1681 raft_consensus.cc:2368] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
I20260709 12:58:16.614285  3695 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:16.637136  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 76150us
I20260709 12:58:16.641324  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.621433  3732 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.626814  3617 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:16.661062  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.661856  1683 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:16.672823  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:16.674826  1600 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:16.634006  3727 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.635398  3547 raft_consensus.cc:697] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:16.644701  3695 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.654254  3681 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.654083  3732 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.653644  3617 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:16.681792  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 63951.5us
I20260709 12:58:16.686357  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.691606   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:58:16.694950   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:16.712798  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.680898  3502 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:16.711716  1534 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:16.721801  1427 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.725733  3608 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:58:16.727231  3608 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:16.727594  3608 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:16.728644  3608 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:16.697414  3617 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.741654  3729 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:58:16.752467  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:16.763366  3620 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:16.767889  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.768715  1675 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:16.768883  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.769531  1680 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:16.769677  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.769940  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.770468  1681 raft_consensus.cc:2368] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
I20260709 12:58:16.770736  1676 raft_consensus.cc:2410] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:16.771402  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.771802  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:16.772137  1674 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:16.772586  1682 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:16.771416  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.774322  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.775574  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.776551  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.775660  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:16.778083  1676 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:16.724247  1427 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 5, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 5 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.783659  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:16.786135  1602 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:16.787401  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:16.788604  1600 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.793648  1604 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
W20260709 12:58:16.795334  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 228529us
W20260709 12:58:16.808495  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.808355  2344 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:16.812132  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:16.813282  1682 raft_consensus.cc:2368] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5.
I20260709 12:58:16.711133  3633 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:16.816453  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:16.817723  1533 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:16.701225  3681 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:16.822103  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:16.800997  3620 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:16.842167  1575 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:16.843035  3492 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:16.861356  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 59555.9us
I20260709 12:58:16.856771  3608 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:16.897338  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 55296us
I20260709 12:58:16.902169  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:16.938230  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:17.041651  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.069144  1600 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:17.108740  3683 raft_consensus.cc:2764] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:58:16.954909  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:17.114699  1533 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:17.127604  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:17.128454  1604 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
W20260709 12:58:17.010599  3742 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:58:16.896229  3533 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.896456  3492 raft_consensus.cc:697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:17.135593  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:16.958540  3730 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:17.133423  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:17.062217  3744 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:58:16.918408  3709 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:17.062354  3568 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.006919  3402 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.136967  1608 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:16.942655  3666 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.853737  3547 consensus_queue.cc:237] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:16.958837  3746 consensus_queue.cc:1059] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.235s
I20260709 12:58:16.867514  3647 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.144623  3709 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:17.164813  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 269727us
I20260709 12:58:17.139447  3533 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.159415  3681 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.177268  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:17.178422  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:17.166956  3709 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:17.181672  3681 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.182380  3681 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.184772  3681 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.185842  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:17.186908  1604 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:17.150997  3568 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.158133  3402 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:17.199649  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 44649.7us
W20260709 12:58:17.196152  1497 leader_election.cc:336] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.591s (SENT)
I20260709 12:58:17.178412  3730 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:17.169070  3666 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.206485  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:17.196799  3746 raft_consensus.cc:3055] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:17.209779  3734 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:17.214250  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.200788  3760 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.227509  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:17.228395  3732 consensus_meta.cc:287] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 12:58:17.228680  3402 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.230402  3666 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.235450  3612 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:17.220476  3492 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:17.236315  3749 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:58:17.259856  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:17.260658  1603 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:17.214263  3746 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:17.223860  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 149920us
I20260709 12:58:17.209291  3730 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:17.214171  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.259128  3612 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:17.269177  1608 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:17.273108  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:17.245071  3727 consensus_meta.cc:287] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.006s
W20260709 12:58:17.285873  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 65674.9us
I20260709 12:58:17.274355  3730 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:17.288475  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 119798us
I20260709 12:58:17.293920  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.295135  3756 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:17.301180  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 105056us
I20260709 12:58:17.254487  3402 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:17.306145  3695 consensus_meta.cc:287] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.004s
I20260709 12:58:17.306345  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.306627  3695 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.286682  3612 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.283538  3758 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:17.261793  3746 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.244580  3760 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.248106  3732 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:17.337378  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.340322  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:17.346837  3617 consensus_meta.cc:287] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
I20260709 12:58:17.351372  3709 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.640242  3617 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:17.582612  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.639544  1608 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:58:17.433063  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:17.643153  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:17.644073  1533 raft_consensus.cc:2410] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:58:17.350242  3533 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:17.301426  3756 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:17.346328  3765 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:58:17.678315  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.679908  1529 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:17.685453  1600 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:17.688655  1608 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:17.298385  3727 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.692309  1530 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:17.692503  3568 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:17.693066  3608 consensus_meta.cc:287] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.573s	user 0.006s	sys 0.006s
I20260709 12:58:17.707157  3727 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.686637  3533 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.707927  3533 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.710176  3533 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.653228  3656 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.710912  3656 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.713130  3656 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.671622  3679 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.713946  3679 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.716265  3679 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.707098  2455 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:17.719978  3502 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:17.351737  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.695637  3617 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.726228  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:17.726835  3732 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.499219  3633 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.728065  3756 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.728955  3760 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.309733  3761 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.373s
I20260709 12:58:17.337307  3766 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.731364  3730 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.732092  3766 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:17.733736  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 396650us
I20260709 12:58:17.734340  3766 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.345386  3767 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.734810  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:17.735230  3767 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.736044  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:17.656553  3734 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.336509  3402 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.350654  3647 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.636323  3612 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.652484  3709 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.662366  3746 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:17.737489  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:17.738605  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 92228.2us
I20260709 12:58:17.772426  3502 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:17.772735  1498 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:17.773829  3633 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:17.774251  3633 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:17.737920  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 73533.1us
I20260709 12:58:17.750602  3678 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:17.775657  3678 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.776023  3678 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.774824  3633 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:17.742815  3695 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.758005  3774 consensus_queue.cc:1059] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:58:17.778811  1575 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:17.779246  3774 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:17.779661  3774 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:17.779928  3402 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.779961  3502 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:17.780570  3502 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:17.740208  3769 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:17.781358  3502 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.744472  3764 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:17.756559  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:17.782612  1529 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:17.775940  1500 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:17.761332  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.774173  1498 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:17.777652  3734 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:17.756033  1497 leader_election.cc:336] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.599s (SENT)
I20260709 12:58:17.787165  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:17.785730  1498 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:17.770005  3730 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.793344  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.794883  2474 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:17.737386  3767 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.745643  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:17.800743  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:17.806370  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:17.789767  3695 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:17.810307   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:17.790370  3647 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:17.813598  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:17.816370  1608 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:17.794335  3727 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:17.817939  3727 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:17.819064  3727 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.814827  3695 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.821959  3695 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:17.826304  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:17.826992  1606 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:17.783394  3769 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.828720  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:17.817296  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:17.829303  1600 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:17.829813  1649 connection.cc:256] RPC call timeout handler was delayed by -1.1184143539999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2905s for a response
I20260709 12:58:17.827576  3709 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:17.833747  2342 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.023s	sys 0.031s
W20260709 12:58:17.834118  2342 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.023s	sys 0.031s
W20260709 12:58:17.834461  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 625104us
I20260709 12:58:17.837767  3617 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.838331  3617 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.839035  3769 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:17.780539  3774 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.840313  3774 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:17.840549  3617 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.841866  3767 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:17.827139  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:17.842654  3767 consensus_queue.cc:1243] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:58:17.827987  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.814793  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:17.875449  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 119437us
W20260709 12:58:17.908965  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 81885.9us
I20260709 12:58:17.913997  1608 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:17.916265  1600 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:17.910818  3769 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:17.919425  3769 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:17.920295  3769 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.810227  3666 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:17.911243  3709 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:17.910806  3771 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:58:17.921448  3769 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:17.923910  3502 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.924161  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:17.826987  3633 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.929033  3633 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:17.843314  3732 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:17.930009  3732 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:17.930768  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 87154.4us
I20260709 12:58:17.931034  3732 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:17.932397  3767 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:17.933837  3773 raft_consensus.cc:3055] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:17.934223  3773 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:17.935109  3773 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:17.935662  3612 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:17.935937  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.940398  2421 raft_consensus.cc:2410] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:17.940411  3773 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:17.945930  1575 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:17.947897  1575 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:17.949755  3709 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:17.950202  3709 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:17.950601  3709 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:17.953866  3764 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:17.954327  3764 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:17.954752  3764 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:17.949237  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:17.959971  2474 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:17.962723  1498 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:17.964416  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 292292us
I20260709 12:58:17.980058  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:17.991031  1679 raft_consensus.cc:2368] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5.
W20260709 12:58:17.966879  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:17.965775  1572 leader_election.cc:336] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.764s (SENT)
W20260709 12:58:17.977180  1497 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.615s (SENT)
I20260709 12:58:18.008692  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.011471  1609 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.009629  1681 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:18.001518  1572 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:18.017753  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.018018  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.019167  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:18.019094  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56459.6us
I20260709 12:58:18.020115  1498 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:18.022233  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.019909  1676 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:18.035857  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.036691  1681 raft_consensus.cc:2368] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
W20260709 12:58:18.037771  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.040351  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.041221  2474 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:18.061954  1609 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:18.063535  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 114369us
I20260709 12:58:18.064587  1575 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:18.069710  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 49681.1us
I20260709 12:58:18.070533  1498 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:18.074019  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:18.074823  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 112984us
I20260709 12:58:18.074221  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:18.075511  1497 leader_election.cc:336] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.664s (SENT)
I20260709 12:58:18.075904  1497 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:17.961140  3678 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.033864  3402 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:18.036738  3767 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:18.074960  1681 raft_consensus.cc:2376] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4. Re-sending same reply.
I20260709 12:58:18.088997  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.066197  3771 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:18.067216  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.084818  1676 pending_rounds.cc:85] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 5
I20260709 12:58:18.097929  1676 pending_rounds.cc:107] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:58:18.098163  1676 raft_consensus.cc:2889] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:18.074060  3547 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:18.096539  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.092025  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:18.099481  2474 raft_consensus.cc:2410] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:18.099398  3778 raft_consensus.cc:2764] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:18.100487  3778 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:18.100346  3547 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.101231  3778 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:18.078106  3633 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:18.092343  3767 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.102705  3547 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:18.103653  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:18.069598  3727 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:18.096535  3695 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:18.092077  3402 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:18.094565  3734 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.087978  3681 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.098713  1682 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:18.108880  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.113344  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.094051  3771 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:18.094650  3666 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:18.142730  1498 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:18.143213  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.171128  2474 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:18.146047  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 70559us
W20260709 12:58:18.130286  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 65799.3us
I20260709 12:58:18.149590  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:18.172623  2476 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:18.150350  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.168469  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.138553  3778 raft_consensus.cc:697] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:18.138540  3770 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:18.177412  1680 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:18.197012  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.179893  1681 raft_consensus.cc:2368] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6.
I20260709 12:58:18.149068  3647 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:18.189028  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.211526  1677 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 1.
I20260709 12:58:18.161808  3633 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:18.224176  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.171324  3771 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:18.232760  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 266995us
I20260709 12:58:18.233117  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.233952  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.234498  1680 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.234782  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.235416  1678 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:18.239049  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.240015  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.240625  1677 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.242127  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.242170  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:18.243023  2461 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:18.243147  2428 raft_consensus.cc:1240] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:18.243768  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.244572  2428 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:18.189958  3732 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:18.246140  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.259289  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.259758  2475 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:18.233260  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.196115  3666 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:18.228281  3770 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.262202  3502 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:18.275350  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.169413  3727 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.232798  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.244592  2455 raft_consensus.cc:2393] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:18.391207  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:18.410251  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 53068.4us
I20260709 12:58:18.406978  1682 raft_consensus.cc:2410] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:58:18.432909  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 260482us
I20260709 12:58:18.262391  3647 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:18.470397  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 237216us
I20260709 12:58:18.472357  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.476214  3761 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.476806  3761 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.478917  3761 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:18.479395  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 204537us
I20260709 12:58:18.481611  2476 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:18.482343  3774 consensus_meta.cc:287] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.011s
W20260709 12:58:18.486953  3769 consensus_meta.cc:287] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.563s	user 0.014s	sys 0.007s
I20260709 12:58:18.374498  3732 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:18.489991  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.422528  3734 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:18.497608  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.412084  3795 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:18.500022  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.500830  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.511648  1678 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:18.514820  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.523895  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.509678  1682 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:18.527629  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.528268  1683 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:18.495258  1674 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:18.529247  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:18.531785  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.536034  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.536849  1678 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:18.536705  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 346162us
I20260709 12:58:18.540925  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.541502  1608 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:18.544759  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.546074  1572 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.558445  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.559409  1678 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:18.560137  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.469875  3633 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:18.568114  1608 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:18.532081  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:18.574254  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.488125  3778 consensus_queue.cc:237] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:18.576494  1603 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:18.576723  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.579051  3760 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:18.558501  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.580292  1572 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:18.533293  3688 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:58:18.560487  3695 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:18.548491  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.613832  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.619269  1678 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:18.621860  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.574297  3795 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:18.581493  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.630366  1603 raft_consensus.cc:2410] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:58:18.583940  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.527519  3666 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:18.569015  3776 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:18.582005  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.624023  1680 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:18.647994  1608 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 3: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:18.648394  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.637897  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.649416  1680 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:18.650498  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.651832  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:18.628805  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 48574.1us
I20260709 12:58:18.653512  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.655185  1572 leader_election.cc:400] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
W20260709 12:58:18.655383  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.656059  1572 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.630488  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.581235  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:18.657388  1605 raft_consensus.cc:2410] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:18.657804  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.658195  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.658743  1605 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.658932  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:18.659504  1683 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:18.631193  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 123578us
I20260709 12:58:18.627537  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.661448  1497 leader_election.cc:400] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3.
I20260709 12:58:18.661988  1602 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:18.662287  1497 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:18.623898  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 55032.2us
I20260709 12:58:18.662773  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.580653  3402 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:18.663318  1602 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.663503  3402 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:18.608430  3683 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.666520  1680 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:18.638866  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.582772  2435 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.580000  3502 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.641059  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.643816  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.670128  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.667452  1607 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:18.621263  3767 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:18.689572  1572 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.642822  3727 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:18.731292  2461 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:18.583701  3760 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.729264  1678 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
W20260709 12:58:18.717407  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 79617.7us
W20260709 12:58:18.735296  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 73053.4us
I20260709 12:58:18.740289  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:18.742221  1675 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:18.743896  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:18.744490  1529 raft_consensus.cc:2376] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6. Re-sending same reply.
I20260709 12:58:18.716920  3774 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.695963  3782 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:18.726107  3773 consensus_meta.cc:287] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.785s	user 0.012s	sys 0.003s
I20260709 12:58:18.690080  3803 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:18.765813  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 76339.3us
I20260709 12:58:18.771906  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:18.741144  3764 consensus_meta.cc:287] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.786s	user 0.016s	sys 0.001s
I20260709 12:58:18.728852  3812 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.773705  1681 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:18.626894  3732 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:18.772821  1607 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:18.786156  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:18.740702  3647 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:18.607535  3806 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.170s
I20260709 12:58:18.779846  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:18.766603  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.752454  3776 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:18.794198  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 100034us
W20260709 12:58:18.787774  3796 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:58:18.764767  3782 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:18.797919  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:18.806497  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.775601  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:18.786156  1601 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:18.808470  1528 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:18.800374  3695 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:18.813675  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.808424  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:18.815307  3802 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:58:18.801116  3776 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:18.833922  1572 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:18.788144  3764 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:18.787160  3803 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.806500  3795 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:18.803515  3770 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:18.807494  3782 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.807397  3810 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 12:58:18.896469  1677 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.655s	user 0.015s	sys 0.006s
I20260709 12:58:18.818195  1525 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:18.845539  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:18.862004  3709 consensus_meta.cc:287] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.911s	user 0.012s	sys 0.000s
I20260709 12:58:18.898268  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:18.908635  1532 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.898777  3678 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:18.860850  3760 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:18.828676  3783 log.cc:927] Time spent T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
W20260709 12:58:18.871238  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 57661.5us
I20260709 12:58:18.871488  3812 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:18.845223  3793 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:18.835903  3799 log.cc:927] Time spent T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:58:18.854990  1575 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:18.849282  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 110989us
I20260709 12:58:18.844913  3683 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.897311  1677 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
W20260709 12:58:18.869354  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 535481us
I20260709 12:58:18.930768  1675 raft_consensus.cc:1240] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:18.845875  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:18.845163  1602 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
W20260709 12:58:18.908720  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.014s	sys 0.005s
W20260709 12:58:18.931447  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.015s	sys 0.005s
I20260709 12:58:18.900732  3803 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:18.908776  1607 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
W20260709 12:58:18.872675  3787 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.644s	user 0.000s	sys 0.003s
W20260709 12:58:18.865574  3771 consensus_meta.cc:287] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.603s	user 0.000s	sys 0.008s
I20260709 12:58:18.937602  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:18.911350  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 77570.2us
I20260709 12:58:18.938956  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.939793  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:18.840711  3547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.010s	sys 0.002s
I20260709 12:58:18.857846  3776 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.913224  3795 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.945111  1572 leader_election.cc:400] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5.
I20260709 12:58:18.945485  1572 leader_election.cc:403] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:18.845671  2451 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:18.914429  1609 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:18.915182  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 59674.8us
I20260709 12:58:18.946147  1602 raft_consensus.cc:2410] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:18.857659  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 581) took 1002 ms. Trace:
I20260709 12:58:18.851231  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.917712  3764 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:18.922482  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1741) took 1245 ms. Trace:
I20260709 12:58:18.929710  1605 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:18.956476  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:18.957176  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:18.933308  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 78374.4us
W20260709 12:58:18.950466  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.946417  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:18.958520  1575 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:18.911351  3709 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:18.957919  1605 raft_consensus.cc:2368] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3.
I20260709 12:58:18.961583  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.961874  2451 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:18.963133  2423 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:18.942749  3678 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.965664  1601 raft_consensus.cc:2376] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5. Re-sending same reply.
I20260709 12:58:18.966643  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.953927  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.967247  1601 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:18.969411  1607 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:18.956621  1534 rpcz_store.cc:276] 0709 12:58:17.677034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.677342 (+   308us) service_pool.cc:224] Handling call
0709 12:58:17.693165 (+ 15823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:17.703982 (+ 10817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.704025 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:17.705424 (+  1399us) log.cc:844] Serialized 564 byte log entry
0709 12:58:17.958212 (+252788us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:17.958250 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.958317 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:18.922291 (+963974us) raft_consensus.cc:1685] finished
0709 12:58:18.922310 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:18.922427 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":252343,"threads_started":1,"wal-append.queue_time_us":707687}
I20260709 12:58:18.920727  2435 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:18.976138  1609 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:18.977519  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.977731  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.978513  1605 raft_consensus.cc:2368] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:18.978938  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.979283  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.979621  1601 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:18.980058  1605 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:18.980217  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.980545  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.980830  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.950423  2421 rpcz_store.cc:276] 0709 12:58:17.855688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.988038 (+132350us) service_pool.cc:224] Handling call
0709 12:58:18.093616 (+105578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:18.171048 (+ 77432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:18.174324 (+  3276us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:18.538339 (+364015us) log.cc:844] Serialized 564 byte log entry
0709 12:58:18.771606 (+233267us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:18.775377 (+  3771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.787065 (+ 11688us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:18.857336 (+ 70271us) raft_consensus.cc:1685] finished
0709 12:58:18.857360 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:18.857582 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":156765,"threads_started":1,"wal-append.queue_time_us":289178}
I20260709 12:58:18.982549  2476 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:18.982812  3823 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:18.983176  3795 consensus_queue.cc:1059] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:18.983417  3823 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.984282  3795 raft_consensus.cc:3055] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:18.984427  1497 leader_election.cc:400] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6.
I20260709 12:58:18.984678  3795 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:18.985194  3727 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:18.985673  3727 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:18.986076  3727 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.989465  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:18.989737  3821 consensus_queue.cc:1059] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:18.990680  3821 raft_consensus.cc:3055] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:18.991024  3821 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:18.985313  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:18.991761  3821 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:18.992697  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:18.992967  3821 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:18.993691  3826 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5.
I20260709 12:58:18.993861  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.995025  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:18.995529  1607 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:18.997512  3709 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:18.998215  1600 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:18.998909  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 84281us
I20260709 12:58:18.999627  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:18.984826  1497 leader_election.cc:403] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:18.998286  3803 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:19.008569  1532 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:19.009613  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:19.011930  1600 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:19.001024  1498 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:19.006242  1647 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:18.958005  3793 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.019971  3826 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:19.024494  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.026285  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.026616  1607 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:18.973062  3683 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:18.973242  3806 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.026331  3826 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.042507  3826 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:19.026873  3812 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:19.046062  3812 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:19.047070  3812 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.031675  3820 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:19.049782  3820 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.050186  3820 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.950678  3807 consensus_queue.cc:1059] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:58:19.035364  3678 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:19.037796  3760 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.053794  3806 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.054533  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:19.056201  3806 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:19.056892  3612 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:19.037869  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 53562.3us
I20260709 12:58:19.058210  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.059340  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:19.059504  3681 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:19.059942  3681 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:19.060287  3681 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:19.060424  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.026439  3695 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6.
I20260709 12:58:18.943748  3771 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.025888  3803 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:19.039176  1605 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:19.039800  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.071791  1607 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:19.026232  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.013463  3795 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.040290  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.041441  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.041951  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.057451  3612 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:19.078495  3612 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.083084  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.084618  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.062161  1498 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:19.086110  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.055379  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:19.087369  3761 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:19.063410  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.037379  3774 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.008284  3823 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:19.073655  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 67466.8us
I20260709 12:58:19.095233  3761 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:19.095737  1606 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:19.096613  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.096756  3761 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.097385  1677 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:19.100798  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:19.073596  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 128569us
I20260709 12:58:19.074487  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:19.102392  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:19.103261  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.103422  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.104012  1605 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:19.108995  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 46899.7us
W20260709 12:58:19.111073  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.112838  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.071116  3683 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:19.113615  1675 raft_consensus.cc:2368] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
I20260709 12:58:19.113957  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:19.124229  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.115353  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.124688  1680 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:19.124944  1679 raft_consensus.cc:2368] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6.
I20260709 12:58:19.116786  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.125717  1534 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:19.119676  3771 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:19.120735  3780 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.886s	user 0.002s	sys 0.000s
I20260709 12:58:19.120784  3502 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.121848  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.122290  1601 raft_consensus.cc:2368] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9.
I20260709 12:58:19.133983  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.134794  1676 raft_consensus.cc:2368] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:58:19.122732  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.070063  3547 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.128863  1572 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:19.129212  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:19.192801  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.130491  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:19.131289  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 120113us
I20260709 12:58:19.130270  1607 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:19.194098  1529 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:19.121728  3666 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:19.141414  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.145363  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.037379  3727 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:19.195142  1532 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:19.196002  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 66868.5us
W20260709 12:58:19.199091  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 108694us
I20260709 12:58:19.106186  3806 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.199537  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.123878  3683 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:19.202121  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.204211  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:19.206784  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 78027.2us
I20260709 12:58:19.207173  1607 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:19.204509  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:19.207535  1572 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:19.209471  1534 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:19.212101  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:19.212914  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.213711  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.200904  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.220801  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.222432  2474 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:58:19.226485  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.216643  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.222829  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.202559  3795 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:19.195650  3666 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.239841  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.202679  3771 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:19.217542  1525 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:19.113193  3826 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:19.247910  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.142179  3502 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.251683  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.248631  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.253031  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.253203  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:19.221704  3819 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:19.221911  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.254644  1575 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:19.256852  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.223228  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.248314  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:19.245656  3832 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.214967  3829 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:19.259665  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.260583  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.286862  3829 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.288596  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.245800  3666 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.261745  3782 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:19.262846  3502 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:19.261785  3683 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.306393  3683 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:19.232858  3803 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:19.310757  3830 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:58:19.264225  3805 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.535s	user 0.000s	sys 0.002s
I20260709 12:58:19.311334  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.314886  3826 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:19.315560  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.224787  3681 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:19.268797  1427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40874 (request call id 351) took 8853 ms. Trace:
I20260709 12:58:19.271986  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.272346  3647 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.272464  3760 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:19.232393  3764 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.329742  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.278228  1607 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:19.250916  3771 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.285933  2451 raft_consensus.cc:2376] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4. Re-sending same reply.
I20260709 12:58:19.249727  3547 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:58:19.290242  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.298444  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.339092  1534 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:19.339960  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.340521  1534 raft_consensus.cc:2376] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6. Re-sending same reply.
I20260709 12:58:19.316777  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.264319  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.274123  3819 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.342093  1527 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:19.331473  1500 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.333395  1602 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:19.342012  3819 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:19.342463  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.343089  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.343597  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.343894  1527 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:19.344657  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.318562  1427 rpcz_store.cc:276] 0709 12:58:10.415459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.415664 (+   205us) service_pool.cc:224] Handling call
0709 12:58:11.100241 (+684577us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540012eb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1902090 00007f25d19a0f3a 00007f25d77571cc 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc 00007f25d5d15392 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:19.268710 (+8168469us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:17.171649 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:17.181081 (+  9432us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:17.181161 (+    80us) write_op.cc:435] Acquired schema lock
0709 12:58:17.181193 (+    32us) tablet.cc:662] Decoding operations
0709 12:58:17.182132 (+   939us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:17.182348 (+   216us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:17.182397 (+    49us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:17.182987 (+   590us) tablet.cc:701] Row locks acquired
0709 12:58:17.183052 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:58:17.183299 (+   247us) write_op.cc:270] Start()
0709 12:58:17.183499 (+   200us) write_op.cc:276] Timestamp: P: 1783601897183199 usec, L: 0
0709 12:58:17.183533 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:58:17.184450 (+   917us) log.cc:844] Serialized 1307 byte log entry
0709 12:58:18.102473 (+918023us) op_driver.cc:464] REPLICATION: finished
0709 12:58:18.579952 (+477479us) write_op.cc:301] APPLY: starting
0709 12:58:18.607758 (+ 27806us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:18.641756 (+ 33998us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:18.696156 (+ 54400us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:18.806692 (+110536us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:18.836940 (+ 30248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:18.868086 (+ 31146us) write_op.cc:312] APPLY: finished
0709 12:58:18.868342 (+   256us) log.cc:844] Serialized 35 byte log entry
0709 12:58:18.868519 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:18.868616 (+    97us) write_op.cc:454] Released schema lock
0709 12:58:18.868663 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:18.869059 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:18.869088 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52365,"reported_tablets":6,"spinlock_wait_cycles":1561688960,"child_traces":[["op",{"apply.queue_time_us":461736,"apply.run_cpu_time_us":3168,"apply.run_wall_time_us":293662,"num_ops":3,"prepare.queue_time_us":292750,"prepare.run_cpu_time_us":26943,"prepare.run_wall_time_us":66471,"raft.queue_time_us":362690,"raft.run_cpu_time_us":11549,"raft.run_wall_time_us":62319,"replication_time_us":918778,"thread_start_us":453530,"threads_started":4,"wal-append.queue_time_us":77184}]]}
I20260709 12:58:19.341396  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.352774  1534 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:19.344770  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.353812  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:19.354406  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 142332us
I20260709 12:58:19.354658  1534 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:19.357079  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.285218  3774 consensus_queue.cc:1059] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:58:19.356937  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.356003  1572 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:19.355692  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.357923  1604 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:19.360107  1677 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:19.363004  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.369387  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.332334  3771 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:19.370443  1497 connection.cc:256] RPC call timeout handler was delayed by -1.5046383710000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 12:58:19.371191  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.366110  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.372608  1572 leader_election.cc:400] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6.
I20260709 12:58:19.373109  1572 leader_election.cc:403] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:58:19.359004  3547 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.332276  3647 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.380880  1534 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:19.374894  1572 leader_election.cc:400] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
I20260709 12:58:19.381175  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.384356  1572 leader_election.cc:403] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:19.386235  3547 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:19.386860  3547 raft_consensus.cc:697] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:19.387899  3547 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.391160  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1639) took 1417 ms. Trace:
I20260709 12:58:19.391435  1678 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:19.391631  1674 rpcz_store.cc:276] 0709 12:58:17.973787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.987742 (+ 13955us) service_pool.cc:224] Handling call
0709 12:58:19.390977 (+1403235us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54001b8d54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:19.391100 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870518528}
I20260709 12:58:19.392263  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.377785  3795 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6.
I20260709 12:58:19.393103  1605 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:19.355613  1601 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:19.400332  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.374434  3837 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:19.398314  1527 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:19.402585  1572 leader_election.cc:400] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:58:19.398799  3681 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:19.402941  1572 leader_election.cc:403] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:58:19.403469  3832 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:58:19.398919  3782 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:19.404297  1572 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:19.405761  3782 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.405942  3837 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:19.406457  3837 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:19.406729  3782 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.407212  3782 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.408965  3782 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:19.408954  3776 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.412663  3776 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:19.413818  3795 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4.
I20260709 12:58:19.416599  1526 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:19.416415  3666 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.418756  3666 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:19.373428  1525 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:19.428442  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.430243  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.435417  1675 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:19.436075  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.436822  1678 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:19.373222  3774 consensus_queue.cc:1243] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:19.433169  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.443059  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.443768  1607 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:19.444608  1532 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:19.446297  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.447567  1647 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:19.400919  1601 raft_consensus.cc:2376] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5. Re-sending same reply.
I20260709 12:58:19.454293  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.434526  1534 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:19.437315  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.430940  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.456442  1680 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:19.439625  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.456483  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.440260  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:19.457443  1608 raft_consensus.cc:2410] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:19.457489  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.458159  1679 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:19.442246  1674 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:19.450518  1647 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:19.452191  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.460873  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.457517  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.461454  1608 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.459327  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:19.476207  1679 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:58:19.477826  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.478758  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:19.480265  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.481199  1607 raft_consensus.cc:2368] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:19.483445  1608 raft_consensus.cc:2410] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:19.451783  3816 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:19.485764  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 113804us
I20260709 12:58:19.488523  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.489319  1608 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:19.489883  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.486370  1681 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:19.459141  3767 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:19.489725  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4371393229999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 12:58:19.500113  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2410612439999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 12:58:19.500747  1497 connection.cc:256] RPC call timeout handler was delayed by -1.1368507410000461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26080000000000003s for a response
W20260709 12:58:19.501179  1497 connection.cc:256] RPC call timeout handler was delayed by -1.0621871850000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 12:58:19.502189  1497 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.506418  3681 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.510068  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:19.518085  3681 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.519701  3820 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.526880  3647 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:19.522718  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:19.528275  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.530019  1601 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:19.532338  3730 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:19.533097  3730 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:19.534011  3647 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.534358  3730 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.535805  1497 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.539029  3647 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:19.540108  3647 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.540737  3647 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:19.541952  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.543231  1601 raft_consensus.cc:2410] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:19.545327  1531 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:19.550079  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 85382.3us
I20260709 12:58:19.551272  2342 leader_election.cc:400] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3.
I20260709 12:58:19.551637  2342 leader_election.cc:403] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:19.552485  3756 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.565959  1675 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:19.460485  3760 consensus_queue.cc:1059] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:58:19.572891  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.544652  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.558068  3766 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:19.577477  1680 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:19.632356  3766 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.632963  3766 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.577489  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.634161  1607 raft_consensus.cc:2410] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:19.635083  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.636279  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.637236  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.590847  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.591413  3837 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:19.600706  3760 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:19.596166  1429 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:19.608214  3819 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.611557  1575 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:19.577044  3681 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:58:19.613513  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.613826  1534 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:19.573889  3734 consensus_queue.cc:1059] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:58:19.614369  3502 raft_consensus.cc:3055] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:19.614998  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.670156  1527 raft_consensus.cc:2368] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
W20260709 12:58:19.619633  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1813) took 1511 ms (client timeout 1865 ms). Trace:
I20260709 12:58:19.574322  3770 raft_consensus.cc:3055] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:19.621497  1498 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:19.622641  3820 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:19.628029  3756 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3.
I20260709 12:58:19.497040  3767 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.574658  3688 consensus_queue.cc:1059] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:58:19.580742  2342 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.639438  1607 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:19.652091  1606 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:19.658972  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1742) took 1040 ms. Trace:
I20260709 12:58:19.659179  3837 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:19.665593  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.662496  1429 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:19.664896  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.619163  3647 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:19.669937  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 214067us
W20260709 12:58:19.676237  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 54811.9us
I20260709 12:58:19.708194  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.708552  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.708925  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:19.709496  1527 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:19.705300  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 254874us
I20260709 12:58:19.710407  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:19.670636  1609 rpcz_store.cc:269] 0709 12:58:18.107967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.108581 (+   614us) service_pool.cc:224] Handling call
0709 12:58:19.619451 (+1510870us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54002a9ed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:19.619553 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728026368}
I20260709 12:58:19.703451  1604 rpcz_store.cc:276] 0709 12:58:18.618926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.273632 (+654706us) service_pool.cc:224] Handling call
0709 12:58:19.282060 (+  8428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.359787 (+ 77727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:19.658707 (+298920us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b54002558d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:19.658907 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165288832}
I20260709 12:58:19.705752  1429 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 2, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:19.711081  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 264666us
I20260709 12:58:19.652256  3793 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:19.713161  1498 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:19.665023  3709 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:19.711827  1429 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:19.717136  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 136517us
I20260709 12:58:19.716727  1498 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:19.720530  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:19.676100  3502 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:19.719874  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.676942  3770 raft_consensus.cc:740] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:19.704176  3767 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:19.704162  3666 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:19.720634  1429 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:19.669382  1601 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:19.723285  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:19.754396  1575 leader_election.cc:400] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:58:19.722620  1525 raft_consensus.cc:2368] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6.
I20260709 12:58:19.746378  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.752638  1534 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:19.722714  1606 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.766247  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1817) took 1222 ms. Trace:
I20260709 12:58:19.769716  1607 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:19.760957  1429 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:19.772264  1429 catalog_manager.cc:5697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 3, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:19.773859  1429 catalog_manager.cc:5697] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:58:19.766491  1604 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 3: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:19.775750  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.776259  1604 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.777020  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 1655) took 1040 ms. Trace:
I20260709 12:58:19.769488  1600 rpcz_store.cc:276] 0709 12:58:18.544283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.544475 (+   192us) service_pool.cc:224] Handling call
0709 12:58:19.766088 (+1221613us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54000848d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:19.766192 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041280896}
I20260709 12:58:19.778331  1528 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:19.778781  1600 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:19.779347  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1746) took 1150 ms. Trace:
I20260709 12:58:19.779613  1600 rpcz_store.cc:276] 0709 12:58:18.650056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.778342 (+1128286us) service_pool.cc:224] Handling call
0709 12:58:19.778614 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.779152 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:19.779299 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:19.780761  1600 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:19.722718  3746 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:19.755878  3688 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:19.781553  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1753) took 1129 ms. Trace:
W20260709 12:58:19.777918  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 69080.3us
I20260709 12:58:19.811349  1600 rpcz_store.cc:276] 0709 12:58:18.652492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.780333 (+1127841us) service_pool.cc:224] Handling call
0709 12:58:19.780589 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.781341 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:19.781505 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:19.812565  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:19.775068  1429 catalog_manager.cc:5697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 3, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:19.791277  1606 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:19.813783  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:19.780686  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 62081.1us
I20260709 12:58:19.777431  1533 rpcz_store.cc:276] 0709 12:58:18.736638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.736869 (+   231us) service_pool.cc:224] Handling call
0709 12:58:18.985179 (+248310us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:19.776811 (+791632us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b54000c76d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:19.776966 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832533760}
I20260709 12:58:19.783308  1602 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:19.815635  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1756) took 1162 ms. Trace:
I20260709 12:58:19.815765  2342 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.817276  1600 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:19.818152  1606 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:58:19.815974  1602 rpcz_store.cc:276] 0709 12:58:18.653386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.782816 (+1129430us) service_pool.cc:224] Handling call
0709 12:58:19.783096 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.815419 (+ 32323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:19.815588 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:19.828404  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.755173  3820 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:19.829314  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 118973us
I20260709 12:58:19.839591  1604 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:19.830633  1429 catalog_manager.cc:5697] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:58:19.758699  3756 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:58:19.789342  3666 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:19.811098  3688 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.848206  1647 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:19.768455  3847 raft_consensus.cc:3055] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:19.746966  3502 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.811838  3709 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:19.720476  3793 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.841717  1429 catalog_manager.cc:5697] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:19.759496  3771 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.868734  1606 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:19.871551  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.872327  3850 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:19.843894  3770 consensus_queue.cc:260] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:19.839807  3820 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.866830  3847 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:19.874310  3837 consensus_queue.cc:1059] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:19.866969  3845 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:19.875670  1647 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:19.867040  3688 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:19.918637  1606 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:58:19.922417  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.910490  1601 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:19.927839  3845 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.928120  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:19.928727  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:19.931500  1603 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:19.910993  3810 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:19.908142  3850 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:19.911458  3820 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:19.949767  3845 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:19.954273  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:19.942529  1575 leader_election.cc:400] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6.
W20260709 12:58:19.990559  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 48255.2us
I20260709 12:58:19.990983  2474 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:19.928509  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.930647  1529 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:19.957700  1532 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:58:19.977316  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:19.979967  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 162914us
I20260709 12:58:19.993505  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.994189  2342 leader_election.cc:400] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9.
I20260709 12:58:19.895365  3709 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:19.996846  1603 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:58:19.929741  3846 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:58:19.947916  3819 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:19.984851  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:19.944228  3647 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:19.928601  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:19.944823  3843 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:19.935372  3547 raft_consensus.cc:3055] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:20.018169  1606 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:19.929050  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:19.922752  3849 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:19.938587  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 305) took 1278 ms. Trace:
I20260709 12:58:19.933254  3727 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:20.029726  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:20.062973  1609 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:20.031909  3709 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:20.032835  2342 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.034960  1603 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:19.986728  3850 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:20.044545  2476 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:19.942729  3678 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:58:20.047644  1498 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:20.074669  1603 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:20.076969  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:19.984263  3666 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.069545  3816 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.934211  3847 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:20.125805  3847 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:20.130520  3793 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:20.133355  3756 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.133975  3756 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.136277  3756 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:20.069108  2451 raft_consensus.cc:2376] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5. Re-sending same reply.
I20260709 12:58:20.145798  3819 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:20.147986  3771 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:20.150136  3846 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:58:20.152182  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:20.155323  1526 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:20.160239  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:20.066112  1601 rpcz_store.cc:276] 0709 12:58:18.659869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.815000 (+1155131us) service_pool.cc:224] Handling call
0709 12:58:19.851251 (+ 36251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.938227 (+ 86976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:19.938497 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:20.085387  1609 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:20.040786  3843 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:20.175331  3843 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:20.046617  3547 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:20.090185  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 57442us
I20260709 12:58:20.094138  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:20.077337  1603 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:20.202337  1609 raft_consensus.cc:1240] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:20.082803  1498 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:20.124328  3816 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.162192  3709 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:20.163367  3766 consensus_meta.cc:287] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.002s
I20260709 12:58:20.074119  3779 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:58:20.084566  1531 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:20.179003  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 366531us
I20260709 12:58:20.095746  3647 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:58:20.207056  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 124361us
I20260709 12:58:20.206238  1606 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:20.211407  1530 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:20.214533  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:20.217949  1498 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:20.220104  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.222226  3852 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:20.223696  3849 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:20.223485  3547 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:20.224118  3849 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:20.211936  3766 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.224846  3547 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.217736  2421 raft_consensus.cc:1240] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:20.225514  3849 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.226588  3766 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:20.227351  2461 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:20.211681  3771 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:20.225706  3760 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.216348  3709 raft_consensus.cc:697] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:20.229854  3806 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:58:20.231783  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 356162us
I20260709 12:58:20.234856  1647 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:20.245198  1527 consensus_meta.cc:287] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
W20260709 12:58:20.247767  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.250536  1527 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:20.251948  2461 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:20.267560  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.286721  1647 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:20.288689  3766 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:20.290202  3681 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:20.290984  3633 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:20.298703  3767 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 12:58:20.299237  3767 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.300001  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1744) took 1672 ms. Trace:
I20260709 12:58:20.300451  1608 rpcz_store.cc:276] 0709 12:58:18.628007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.756013 (+1128006us) service_pool.cc:224] Handling call
0709 12:58:19.756688 (+   675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:19.757116 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:19.757153 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:19.764879 (+  7726us) log.cc:844] Serialized 564 byte log entry
0709 12:58:20.073143 (+308264us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:20.073198 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.073268 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:20.299717 (+226449us) raft_consensus.cc:1685] finished
0709 12:58:20.299738 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.299929 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":244404,"threads_started":1,"wal-append.queue_time_us":456790}
W20260709 12:58:20.305994  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.306403  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:20.306995  1608 raft_consensus.cc:2376] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6. Re-sending same reply.
I20260709 12:58:20.307456  1606 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:58:20.307644  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:20.310997  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.312528  1498 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:20.250114  3811 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:20.230325  3709 consensus_queue.cc:237] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.249316  3647 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:20.318902  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:20.270288  3760 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.266302  3771 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:20.321321  1532 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:20.334786  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.243176  3688 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.323050  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:20.330322  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.270946  3849 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:20.339306  3806 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:20.336342  3633 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:20.342626  3633 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:20.343801  3633 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:20.314069  3612 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:20.345954  3771 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.346024  3612 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.272333  3779 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:58:20.272488  3758 consensus_queue.cc:1059] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:58:20.349752  3834 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:20.350258  3758 raft_consensus.cc:3055] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:20.275202  3734 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
W20260709 12:58:20.355522  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.322171  3840 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.335543  3766 raft_consensus.cc:2764] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:20.315248  3727 consensus_queue.cc:1059] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:58:20.372334  1534 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:20.374261  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:20.238575  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:20.335232  3811 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:20.354334  3758 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:20.367394  1527 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:58:20.310899  3809 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:58:20.375423  1528 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:20.356812  1647 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:20.383782  3746 consensus_meta.cc:287] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.545s	user 0.000s	sys 0.009s
I20260709 12:58:20.399338  1647 leader_election.cc:400] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:20.399847  1647 leader_election.cc:403] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:58:20.388662  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 150212us
I20260709 12:58:20.370561  3860 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.374756  3612 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:20.398694  3647 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:20.410271  3756 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:20.398496  3746 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.430158   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:20.393396  3861 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.371044  3803 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:58:20.401708  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:20.438373  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.440021  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:20.369688  3840 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.442792  3840 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:20.415932  1647 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:20.400302  3760 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:20.411252  3811 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.400154  3767 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:20.446157  1647 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:20.447944  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.450671  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 307) took 1107 ms. Trace:
I20260709 12:58:20.451071  1605 rpcz_store.cc:276] 0709 12:58:19.343717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.937011 (+593294us) service_pool.cc:224] Handling call
0709 12:58:19.937405 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.937722 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:20.206887 (+269165us) log.cc:844] Serialized 14 byte log entry
0709 12:58:20.450350 (+243463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:20.450401 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:20.450442 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.450504 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.450616 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":434735,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":81,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":511880,"threads_started":2}
I20260709 12:58:20.453329  1605 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:20.445348  3812 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:20.476962  1647 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:20.482702  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 405852us
I20260709 12:58:20.428220  3860 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:20.483167  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 308) took 1139 ms. Trace:
I20260709 12:58:20.471971  3766 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.485323  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:20.484592  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1826) took 1471 ms. Trace:
I20260709 12:58:20.487178  1602 rpcz_store.cc:276] 0709 12:58:19.343989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.944049 (+600060us) service_pool.cc:224] Handling call
0709 12:58:19.944435 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.944707 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:20.359646 (+414939us) log.cc:844] Serialized 14 byte log entry
0709 12:58:20.482784 (+123138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:20.482840 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:20.482895 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.482962 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.483095 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5874,"prepare.queue_time_us":460403,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":13499,"raft.queue_time_us":96,"thread_start_us":537196,"threads_started":2}
I20260709 12:58:20.475286  3851 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:20.495488  1600 rpcz_store.cc:276] 0709 12:58:19.013261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.838577 (+825316us) service_pool.cc:224] Handling call
0709 12:58:19.838836 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.839048 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:20.359467 (+520419us) log.cc:844] Serialized 14 byte log entry
0709 12:58:20.484190 (+124723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:20.484243 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:20.484288 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.484367 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.484522 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":494841,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1786,"raft.queue_time_us":2590,"thread_start_us":618862,"threads_started":2}
I20260709 12:58:20.476167  3861 raft_consensus.cc:2764] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:58:20.498783  1647 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.477592  3803 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:20.511884  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:20.506496  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 110877us
I20260709 12:58:20.482267  3845 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:20.483377  3767 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:20.513388  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 65524.9us
I20260709 12:58:20.414521  3730 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
W20260709 12:58:20.529546  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.538395  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:20.544348  1531 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:20.514431  3688 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:20.523177  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:20.509817  3860 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.506819  3812 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.549046  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:20.546595  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.550717  1602 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:20.523953  3803 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.564591  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:20.574409  1605 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
W20260709 12:58:20.556735  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.573164  1602 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:20.521250  3760 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:20.538841  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:20.509264  3853 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:58:20.535835  3767 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:20.591332  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:20.536355  3776 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:58:20.486563  3758 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:20.603078  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:20.610580  1525 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:20.590021  3861 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:20.552053  3845 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:20.521085  3678 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:58:20.629418  3811 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:20.605427  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:20.629914  3758 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:20.524689  3766 consensus_queue.cc:1059] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 12:58:20.622903  3820 consensus_meta.cc:287] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 12:58:20.626994  1601 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:20.616973  2461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:20.567564  3871 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:20.575277  3881 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:20.634841  2461 raft_consensus.cc:606] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:20.620296  3767 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.632738  3847 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:58:20.552757  3843 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.652179  3770 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.574949  3851 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:58:20.640139  3881 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:20.665069  3881 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:20.679768  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.681030  3760 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:20.709894  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 104583us
I20260709 12:58:20.710940  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:20.642696  3820 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.728284  2342 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:20.708545  3850 consensus_meta.cc:287] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.610s	user 0.003s	sys 0.008s
I20260709 12:58:20.645386  3811 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.732350  3887 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:20.730787  3761 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:58:20.708657  3776 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:20.709250  3861 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:20.758747  3861 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:20.754511  1533 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:20.737521  3893 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.763577  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:20.764557  1606 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:20.764889  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:20.765471  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:20.764976  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 161104us
I20260709 12:58:20.767355  2342 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.767545  1529 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:20.770898  3853 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:20.771170  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:20.772185  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1828) took 1748 ms. Trace:
I20260709 12:58:20.773604  1604 rpcz_store.cc:276] 0709 12:58:19.023798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.841708 (+817910us) service_pool.cc:224] Handling call
0709 12:58:19.864041 (+ 22333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:20.035239 (+171198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:20.035273 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:20.046970 (+ 11697us) log.cc:844] Serialized 26 byte log entry
0709 12:58:20.416791 (+369821us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:20.416846 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.761913 (+345067us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540035f054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:20.761960 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:20.762007 (+    47us) raft_consensus.cc:1685] finished
0709 12:58:20.762021 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.772111 (+ 10090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392782080,"thread_start_us":314878,"threads_started":1,"wal-append.queue_time_us":496605}
I20260709 12:58:20.776172  1600 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:20.776860  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:20.772516  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.738054  3612 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:20.777266  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:20.780833  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:20.722350  3860 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 12:58:20.785152  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.790894  1675 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:20.780014  3612 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:20.757938  3809 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:58:20.796919  1675 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:20.779250  3851 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:20.740937  3850 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:20.793838  3612 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:20.778920  3727 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:58:20.810575  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:20.811854  1675 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:20.824949  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 238319us
I20260709 12:58:20.795428  3871 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:20.831948  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 49876.1us
I20260709 12:58:20.834014  1680 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:20.797413  3803 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:20.843379  1675 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:20.844625  1604 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:20.847090  1606 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:20.774039  3893 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:20.854707  1675 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:20.830624  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:20.857728  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:20.863984  1675 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:20.805956  3816 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:20.872088  1682 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:20.808492  3851 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:20.878338  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:20.881824  1497 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.520s (SENT)
I20260709 12:58:20.882524  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:20.858939  3843 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:20.846001  3776 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:58:20.856858  3890 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:20.907717  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:20.972028  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 90246.7us
I20260709 12:58:20.921624  3820 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:20.973887  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:20.955983  3681 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.978039  1681 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:20.924909  3811 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:20.982551  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:20.991644  3898 log.cc:927] Time spent T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:58:20.997814  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1776) took 1424 ms. Trace:
I20260709 12:58:20.998759  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:20.998226  1530 rpcz_store.cc:276] 0709 12:58:19.574084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.574661 (+   577us) service_pool.cc:224] Handling call
0709 12:58:19.602726 (+ 28065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.231666 (+628940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.997551 (+765885us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54003af054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:20.997753 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396438784}
I20260709 12:58:20.911019  3890 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:20.921526  3900 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:58:21.020855  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:21.020133  3760 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:20.962843  3871 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:20.994165  3894 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.023978  3850 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:21.045187  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 187529us
W20260709 12:58:21.050717  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.051100  1649 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:21.051307  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.502s (SENT) [suppressed 61 similar messages]
I20260709 12:58:21.051800  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:21.063679  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:21.071077  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:21.082580  3850 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:21.092839  3837 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:21.093547  3837 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:21.094715  3837 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.096223  3837 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.088896  3850 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.054445  3894 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.116099  1601 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:21.117775  3894 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:21.118341  3911 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.118445  1601 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:21.122705  3882 raft_consensus.cc:3055] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:21.123135  3882 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:21.124022  3882 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.125270  3882 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.125765  3909 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.126139  3892 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.121265  3766 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:21.097658  3851 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:21.140558  3909 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.141315  3766 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:21.132222  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 80926.1us
I20260709 12:58:21.133873  3893 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:21.138270  3845 raft_consensus.cc:3055] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:21.140698  3903 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:58:21.115188  3850 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:21.143993  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:21.130421  3901 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:58:21.142608  3766 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.192158  1528 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:21.149616  3612 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.150396  3914 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.145004  3845 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:21.194113  3905 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.166s	user 0.003s	sys 0.000s
I20260709 12:58:21.194167  3766 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:21.192754  3881 consensus_meta.cc:287] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.005s
I20260709 12:58:21.205308  1530 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:21.190012  3793 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:21.217801  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 154259us
I20260709 12:58:21.129426  3767 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:21.202181  3709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.010s	sys 0.017s
W20260709 12:58:21.246820  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 257658us
W20260709 12:58:21.246874  3709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.010s	sys 0.018s
I20260709 12:58:21.258826  1683 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:21.144826  3892 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.255941  3890 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:21.219193  3881 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.273809  3909 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:21.244187  3793 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.247416  3914 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.291090  3881 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:21.294994  3776 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.295678  3776 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.362206  3617 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:58:21.372885  3914 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:21.373492  3617 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:21.373952  3617 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:21.374876  3793 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:21.375195  3617 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.270555  3845 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.272032  3911 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:21.372094  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 59044.7us
I20260709 12:58:21.377009  3776 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:21.430879  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:21.431317  3816 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:21.432552  3856 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:21.443805  3853 raft_consensus.cc:993] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:58:21.460237  3856 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:21.460711  3746 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:21.462105  3923 raft_consensus.cc:1081] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
W20260709 12:58:21.422322  3916 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:58:21.461694  3856 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.467159  2339 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:21.465161  3840 consensus_queue.cc:1059] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:58:21.522912  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 55851.7us
I20260709 12:58:21.561977  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:21.513891  3915 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:21.575217  3914 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:21.586385  3793 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:21.585912  2435 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:21.586200  2428 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:58:21.598167  3914 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.475721  3816 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:58:21.756280  2461 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:21.756742  2461 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:21.757956  2461 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.791265  2461 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:21.755299  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 467819us
W20260709 12:58:21.795691  1497 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.014s	sys 0.016s
W20260709 12:58:21.796541  1497 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.014s	sys 0.016s
W20260709 12:58:21.816695  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.565667  3746 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:21.817857  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:21.818069  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.587217  3892 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:21.819818  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:21.704015  1679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:45362
I20260709 12:58:21.797897  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:21.830125  1679 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:21.823704  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:21.796890  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 569726us
W20260709 12:58:21.825469  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:21.819031  3837 consensus_meta.cc:287] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.722s	user 0.015s	sys 0.000s
I20260709 12:58:21.830763  1679 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:21.831338  2461 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:58:21.753244  3617 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.791159  3776 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.831059  2475 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:21.831578  1497 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.576s (SENT)
W20260709 12:58:21.831516  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.832837  2461 pending_rounds.cc:85] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 6
I20260709 12:58:21.598290  3793 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.824644  3709 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:21.641700  3915 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:21.836692  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:21.838776  1497 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.605s (SENT)
I20260709 12:58:21.837754  2461 pending_rounds.cc:107] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:58:21.804167  3845 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.835002  2476 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:21.845593  2461 raft_consensus.cc:2889] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:21.846067  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:21.846349  1497 leader_election.cc:336] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.997s (SENT)
I20260709 12:58:21.850732  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:21.836215  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:21.854756  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:21.837692  3924 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.841301  3837 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:21.838624  3892 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.841473  3767 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:21.844805  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:21.843781  3766 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:21.849237  3612 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:21.841794  3776 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.864856  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:21.844641  3709 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:21.884819  3882 consensus_meta.cc:287] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.753s	user 0.005s	sys 0.003s
I20260709 12:58:21.862075  3837 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.864792  3920 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:21.895828  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 421) took 2182 ms. Trace:
I20260709 12:58:21.896281  1533 rpcz_store.cc:276] 0709 12:58:19.713192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.816542 (+103350us) service_pool.cc:224] Handling call
0709 12:58:19.843036 (+ 26494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.761797 (+918761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.895567 (+1133770us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b5400211bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:21.895763 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2095593344}
I20260709 12:58:21.862212  3892 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.904418  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:21.861217  3924 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:21.900346  3850 consensus_meta.cc:287] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.000s
I20260709 12:58:21.910247  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:21.917201  1532 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:21.911154  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:21.912501  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:21.872192  3766 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.909989  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:21.915113  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:21.919718  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:21.920848  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:21.894502  3882 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:21.926412  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:21.902186  3843 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.923193  3930 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.923727  3837 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:21.934831  1649 leader_election.cc:336] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Timed out: RequestConsensusVote RPC to 127.0.107.196:46719 timed out after 1.595s (SENT)
I20260709 12:58:21.936113  3914 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:21.936671  3914 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:21.937135  3914 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.938442  1676 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:21.939268  3914 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:21.939543  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:21.942090  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:21.944253  1649 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:21.946832  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:21.951797  1676 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:21.952253  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:21.927649  3920 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:21.927405  3612 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.930225  1530 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:21.929090  3770 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:21.971345  2455 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:21.972757  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:21.973131  3880 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:21.973950  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 465) took 1185 ms. Trace:
W20260709 12:58:21.974639  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.974946  3924 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:21.975735  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.975551  3924 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:21.976109  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.975991  3834 raft_consensus.cc:3055] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:21.976679  3834 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:21.976922  3924 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:21.976779  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.977596  3834 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.978719  3834 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:21.978922  3892 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:21.900477  3915 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.980729  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:21.981382  1675 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:21.981439  3915 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:21.983181  3861 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.984192  3861 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:21.953290  3914 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:21.986095  3914 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:21.986977  3914 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:21.988343  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 474) took 1186 ms. Trace:
I20260709 12:58:21.988692  1680 rpcz_store.cc:276] 0709 12:58:20.802072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.802296 (+   224us) service_pool.cc:224] Handling call
0709 12:58:20.802580 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.834433 (+ 31853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.988102 (+1153669us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54001121d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:21.988284 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71883648}
I20260709 12:58:21.989706  3612 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:21.974331  1683 rpcz_store.cc:276] 0709 12:58:20.788374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.788495 (+   121us) service_pool.cc:224] Handling call
0709 12:58:20.788773 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.260347 (+471574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.973746 (+713399us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400066b54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:21.973897 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080416640}
I20260709 12:58:22.005105  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:21.940097  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:21.940817  3837 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:21.951032  3767 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:21.992444  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:21.926672  3850 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.010349  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:21.964923  3911 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:21.930847  3882 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:22.017326  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 50102.6us
W20260709 12:58:22.018687  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 66485.3us
I20260709 12:58:22.015386  1680 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:22.020144  1683 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:22.017869  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.022859  1676 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.026471  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:22.016202  3889 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:58:22.015586  3770 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.940277  3843 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: true } }
I20260709 12:58:21.977430  3924 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.028548  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.038618  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.038093  1572 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.046283  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:21.950495  3930 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.022217  3793 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.036398  1679 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.059635  1679 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.042615  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:22.053390  1497 leader_election.cc:336] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.121s (SENT)
I20260709 12:58:22.016270  3837 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.061862  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:22.062852  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.054283  2421 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:22.065315  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:22.067003  3843 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:22.056713  2451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:22.069703  2451 raft_consensus.cc:606] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:22.073726  3776 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.074945  1680 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:22.075183  3612 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:22.075992  3709 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.078863  3924 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.080245  3850 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:22.075867  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.081517  1680 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:22.042834  3770 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.082398  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.082926  1680 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.083441  3770 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.085357  3882 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.042342  3911 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:58:22.061347  3931 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:22.089105  1680 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:22.090579  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 48080.6us
I20260709 12:58:22.091595  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.054713  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.054862  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:22.009043  3920 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:58:22.093853  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.095206  3930 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.096309  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:22.096896  1526 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.100265  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1859) took 1254 ms. Trace:
I20260709 12:58:22.102324  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:22.102963  3837 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.103242  1525 raft_consensus.cc:2410] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:58:22.056023  3892 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:22.103832  3892 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.104147  3923 raft_consensus.cc:3055] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:22.104242  3892 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.104614  3923 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:22.105890  1526 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:22.106217  3933 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:22.107460  2474 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:22.107842  2474 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:22.108520  2474 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.110395  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 326) took 1393 ms. Trace:
I20260709 12:58:22.110798  1609 rpcz_store.cc:276] 0709 12:58:20.717284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.717448 (+   164us) service_pool.cc:224] Handling call
0709 12:58:20.717937 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:20.797786 (+ 79849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:20.797835 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:20.803648 (+  5813us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.060733 (+257085us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:21.060777 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.110019 (+1049242us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b54002be3d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:22.110063 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.110108 (+    45us) raft_consensus.cc:1685] finished
0709 12:58:22.110120 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.110337 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2899,"raft.queue_time_us":3082,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":4397,"spinlock_wait_cycles":165251328,"thread_start_us":215695,"threads_started":1,"wal-append.queue_time_us":260597}
W20260709 12:58:22.112828  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.103272  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.101275  1676 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:22.043757  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:22.109417  2474 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.117513  1680 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:22.119007  1683 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:22.121134  1682 raft_consensus.cc:2410] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:22.100696  1604 rpcz_store.cc:276] 0709 12:58:20.845655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.848044 (+  2389us) service_pool.cc:224] Handling call
0709 12:58:20.852032 (+  3988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:20.854270 (+  2238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:20.854316 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:20.854916 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:58:20.856361 (+  1445us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:20.856399 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.856459 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.099321 (+1242862us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b240041dfc8. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7319c4 00007f25ce72facb 00007f25ce8eadc9 00007f25ce8eaa55 00007f25ce8e9fb0 00007f25d1560488 00007f25d1560be8 00007f25d1538398 00007f25d153376a 00007f25d1532bb6
0709 12:58:22.099965 (+   644us) raft_consensus.cc:1685] finished
0709 12:58:22.099987 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.100202 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":15298,"spinlock_wait_cycles":8445312,"thread_start_us":946,"threads_started":1,"wal-append.queue_time_us":124050}
I20260709 12:58:22.123361  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.124881  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:22.125927  1526 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.124966  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.125751  3929 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.130789  3929 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.133081  3929 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.134238  2461 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:22.134147  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.135442  1679 raft_consensus.cc:2393] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:22.137362  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.137439  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.138466  1679 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:22.137420  3928 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:58:22.137831  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.107484  3933 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.142625  1680 raft_consensus.cc:2376] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4. Re-sending same reply.
I20260709 12:58:22.143647  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.144312  1682 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:22.144325  2474 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:22.145696  3502 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.134917  3882 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.152864  3882 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.155041  3882 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.149655  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:22.157282  1572 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:22.157018  1526 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:22.140141  3930 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.160667  3930 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.124145  3923 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.158847  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:22.159301  3861 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:22.159608  3936 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.158936  1572 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:22.143344  3924 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.168274  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:22.150925  3871 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:22.169601  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.205758  1676 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:22.207024  2435 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:22.207165  3924 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.208052  3914 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:22.208483  3914 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.208866  3914 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.140869  3892 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.150141  3933 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.210813  3930 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.211776  3933 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.165526  3923 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.212749  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.213415  1676 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:22.209549  3924 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:22.215157  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 46984.1us
I20260709 12:58:22.215901  1575 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.216753  1575 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:22.217430  3930 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:22.169091  3709 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:22.217833  3929 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:22.218654  3929 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.219200  3929 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.221760  3892 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.222432  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.223112  1674 raft_consensus.cc:2376] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3. Re-sending same reply.
I20260709 12:58:22.224068  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.204344  3861 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:22.224033  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.224068  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.204125  3936 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.224514  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.232267  1676 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:22.232748  3855 log.cc:927] Time spent T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.992s	user 0.000s	sys 0.015s
I20260709 12:58:22.233875  1607 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:22.234427  3887 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.234897  3887 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.224946  2475 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:22.225270  2474 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:22.225453  3861 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.226161  1674 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:22.242650  3547 raft_consensus.cc:3055] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:22.242738  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.243187  3547 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:22.243651  1674 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:22.244062  3547 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.244587  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.245986  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:22.226799  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.204176  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 45327.2us
I20260709 12:58:22.231408  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60652 (request call id 87) took 2070 ms. Trace:
I20260709 12:58:22.236618  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.249498  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.250663  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.218657  3709 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:22.245211  1674 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:22.254112  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 477) took 1420 ms. Trace:
I20260709 12:58:22.254565  1676 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:22.254491  1677 rpcz_store.cc:276] 0709 12:58:20.833442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.833673 (+   231us) service_pool.cc:224] Handling call
0709 12:58:20.856758 (+ 23085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.900153 (+ 43395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:20.900188 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:20.900231 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:20.900260 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.253735 (+1353475us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b54003557d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:22.253779 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.254061 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99322240}
I20260709 12:58:22.255342  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.255939  1676 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:22.257681  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.258482  1676 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.259737  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.265348  1677 raft_consensus.cc:2393] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:22.261456  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.248373  1603 rpcz_store.cc:276] 0709 12:58:20.160696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.202724 (+ 42028us) service_pool.cc:224] Handling call
0709 12:58:22.230092 (+2027368us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5400035fa0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1915520 00007f25d199eb42 00007f25d199d800 00007f25d19969fa 00007f25d695e4c9 00007f25cfedac54 00007f25cfedabe2 00007f25cfedab11 00007f25cfedaa8c 00007f25cfed9d42
0709 12:58:22.231142 (+  1050us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001559d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199e735 00007f25d19969fa 00007f25d695e4c9 00007f25cfedac54 00007f25cfedabe2 00007f25cfedab11 00007f25cfedaa8c 00007f25cfed9d42 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:22.231319 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465846400}
I20260709 12:58:22.261281  3849 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:22.268695  1676 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:22.279448  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.286070  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.287017  1677 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:22.287149  1497 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.285961  1678 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.167374  3882 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:22.268399  1572 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:22.236650  3927 log.cc:927] Time spent T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:58:22.291858  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:22.296191  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.292549  1677 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:22.293527  1676 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:22.299316  1676 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:22.228727  3936 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.224825  3871 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.245503  3547 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.259800  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.295121  3860 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.295356  3924 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:22.307135  3879 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:58:22.313592  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 45263.4us
I20260709 12:58:22.314365  1678 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:22.314486  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.316265  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 439) took 1953 ms. Trace:
I20260709 12:58:22.285182  3849 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:22.293846  3806 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:22.289665  3709 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.290019  3845 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.321686  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.321902  2461 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:22.321839  1527 rpcz_store.cc:276] 0709 12:58:20.362957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.363071 (+   114us) service_pool.cc:224] Handling call
0709 12:58:20.363356 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:20.392867 (+ 29511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.315987 (+1923120us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5400198f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:22.316202 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8513792}
I20260709 12:58:22.321245  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.314047  3837 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.351454  1676 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:22.330559  1678 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:22.315307  3871 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.344218  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.347688  1679 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:22.356415  2461 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:22.319626  3793 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:22.317231  3911 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.362000  1679 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:22.319149  3930 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.326802  3776 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:22.354803  3840 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.321017  1674 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:22.362727  3793 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.343797  3502 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:22.349663  3892 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:22.405076  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 83916.4us
W20260709 12:58:22.405995  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.307729  3803 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:58:22.358469  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.354463  3806 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:22.326812  3933 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:22.324936  3882 raft_consensus.cc:697] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:22.406461  1676 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:22.323982  3924 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.321907  3860 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.429093  3860 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.350188  3845 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.353798  3709 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.431228  3845 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.431321  3709 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:22.419597  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.407068  3776 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.432709  3776 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:22.411844  3892 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.434540  3892 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.411696  3793 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:22.421259  1604 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:22.423540  3806 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.363564  3837 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.409847  3502 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.424996  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:22.418144  3933 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.426681  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:22.344460  3849 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:22.441612  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.412882  3840 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.460640  3840 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:22.415086  3810 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:22.440073  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 81720.7us
I20260709 12:58:22.399474  3911 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.461405  3810 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.462857  3911 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.451361  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:22.443529  1500 connection.cc:256] RPC call timeout handler was delayed by -1.0187895990000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 12:58:22.468276  1500 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:22.453444  3882 consensus_queue.cc:237] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.453778  3929 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.446139  3678 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:22.446161  3502 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.482215  3678 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.482669  3678 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.483587  3929 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.469710  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:22.408466  3930 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.452478  3933 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:22.486897  2461 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:22.487005  1606 raft_consensus.cc:2410] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:58:22.489128  1572 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.490978  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:22.492492  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:22.495433  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.486339  3930 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.485747  3871 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.462715  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:22.515962  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:22.448467  3915 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:58:22.490001  3770 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:22.449645  3914 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.496632  3936 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:22.473228  3937 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.500090  3947 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:22.516126  3849 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.531965  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 437) took 2166 ms. Trace:
I20260709 12:58:22.581908  1534 rpcz_store.cc:276] 0709 12:58:20.361658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.361789 (+   131us) service_pool.cc:224] Handling call
0709 12:58:20.362110 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.375753 (+ 13643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.527753 (+2152000us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b540004cc54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:22.527925 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19371904}
I20260709 12:58:22.533205  3770 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.490641  3935 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:58:22.536281  1674 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:22.538805  3837 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.542197  3633 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.545192  3892 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:22.545961  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.547384  3875 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 1.882s	user 0.007s	sys 0.011s
I20260709 12:58:22.551556  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 303) took 3892 ms. Trace:
I20260709 12:58:22.551466  3914 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.552640  3709 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.645843  1601 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:22.645994  3709 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.647147  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:22.648962  3709 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.649084  3935 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.514434  3893 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:22.649704  3893 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.650084  3893 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.624293  1607 rpcz_store.cc:276] 0709 12:58:18.659215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.790476 (+1131261us) service_pool.cc:224] Handling call
0709 12:58:19.790831 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.234235 (+2443404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.551310 (+317075us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54002689d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:22.551472 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5617616768}
I20260709 12:58:22.553493  3810 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:22.491000  3803 consensus_queue.cc:1059] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:58:22.555100  3924 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.557123  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:22.557554  3871 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.561898  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1851) took 1799 ms. Trace:
I20260709 12:58:22.500090  3547 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:58:22.528600  3929 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.549126  3776 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.580277  3947 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.579290  3936 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.580526  3888 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.628780  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:22.629702  3837 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:22.630383  3845 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.584084  3937 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.623839  3633 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.642524  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.660363  3915 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:58:22.663607  1602 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:22.663640  1605 rpcz_store.cc:276] 0709 12:58:20.762553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.762689 (+   136us) service_pool.cc:224] Handling call
0709 12:58:20.763136 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:20.892310 (+129174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:20.892344 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:20.892913 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.009988 (+117075us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:21.010045 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.561229 (+1551184us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540033fed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:22.561325 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.561397 (+    72us) raft_consensus.cc:1685] finished
0709 12:58:22.561420 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.561810 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":357,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":12740,"spinlock_wait_cycles":264204032,"thread_start_us":86386,"threads_started":1,"wal-append.queue_time_us":179495}
I20260709 12:58:22.674623  1604 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:22.674307  3929 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.678570  3678 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.607754  3770 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.659725  3935 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.664930  3793 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:22.683764  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.726589  3936 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.687732  3892 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.687870  3879 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.762017  3847 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:22.667603  3920 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:22.695039  1680 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:22.696375  3803 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.699033  3887 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.699568  1678 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:58:22.701910  3727 raft_consensus.cc:3055] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:58:22.747377  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 118685us
I20260709 12:58:22.810894  1678 pending_rounds.cc:85] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 2
I20260709 12:58:22.811280  1678 pending_rounds.cc:107] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:58:22.760635  1607 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:22.811563  1678 raft_consensus.cc:2889] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:22.693244  3502 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.724606  3779 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:22.770440  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:22.662978  3933 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.773810  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.780764  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.781919  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.783032  2451 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:22.820561  3502 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.821053  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.821275  1600 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 4. Ops: []
I20260709 12:58:22.821866  2451 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:22.815443  3779 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:22.822983  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:22.823227  3779 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.783650  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.783871  3793 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.784308  1674 raft_consensus.cc:2393] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:22.824723  3779 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:22.784355  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:22.825609  2461 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:22.825450  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.785163  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:22.828164  2474 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:22.787041  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:22.829859  1603 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.724859  3947 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:22.692677  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.767773  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:22.759655  3888 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.815750  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:22.833469  1605 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:22.835538  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:22.790261  3852 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.836418  3852 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.762426  3845 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.819871  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:22.830318  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.838599  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:22.762562  3837 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.814069  3727 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:22.834543  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:22.843834  3850 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:22.864389  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:22.843658  2455 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:22.814604  3803 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.809510  3920 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.866202  1604 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:22.843963  3861 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:22.880537  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 188841us
W20260709 12:58:22.890504  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.891279  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.897445  1603 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:22.910056  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:22.913587  1603 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:22.919672  1603 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:22.922530  2461 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:58:22.925839  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 87336.2us
I20260709 12:58:22.926322  1604 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:22.929622  1572 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.865813  3911 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:22.927304  1605 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:22.867424  3850 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:22.934913  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 140422us
I20260709 12:58:22.936607  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:22.806615  3879 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.941066  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:22.944269  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.945039  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.945621  1678 raft_consensus.cc:2376] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4. Re-sending same reply.
I20260709 12:58:22.947958  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.907841  3929 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.956316  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.957098  1678 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
W20260709 12:58:22.952319  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 86604.1us
I20260709 12:58:22.955581  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.951337  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:22.958853  1678 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:22.959980  1681 raft_consensus.cc:2376] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4. Re-sending same reply.
I20260709 12:58:22.955899  3793 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:22.961550  3793 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:22.964335  1608 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:22.930905  3952 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:22.942401  3877 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 2.335s	user 0.011s	sys 0.007s
I20260709 12:58:22.943879  3850 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:22.962457  3793 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:22.969269  1608 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:22.968876  3776 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.968858  3882 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:22.978001  3633 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.978478  3961 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:22.986416  3837 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.986225  3961 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.950881  3955 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:22.969339  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.968142  1681 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:22.987286  3955 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.993029  3502 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:22.993425  3920 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:22.993817  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:22.994086  3920 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:22.971987  3806 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:22.978777  3952 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:22.999071  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.999861  1681 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:23.000916  3678 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:23.001883  3806 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.003966  3806 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.963824  3911 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:22.994552  2421 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.008318  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1689) took 1076 ms. Trace:
I20260709 12:58:23.010186  1608 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:23.010928  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.012426  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.013151  1681 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:23.019212  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.964416  3957 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.019891  1675 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:23.008801  1677 rpcz_store.cc:276] 0709 12:58:21.931522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.297472 (+365950us) service_pool.cc:224] Handling call
0709 12:58:22.297822 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:22.298171 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.298199 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:22.318336 (+ 20137us) log.cc:844] Serialized 26 byte log entry
0709 12:58:22.584974 (+266638us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:22.866421 (+281447us) log.cc:844] Serialized 14 byte log entry
0709 12:58:23.007921 (+141500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:23.008096 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:23.008138 (+    42us) raft_consensus.cc:1685] finished
0709 12:58:23.008150 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:23.008265 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31955,"prepare.queue_time_us":385434,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":69577,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":12751,"thread_start_us":584073,"threads_started":3,"wal-append.queue_time_us":379552}
W20260709 12:58:22.983197  3951 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:58:23.024840  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 83861.9us
I20260709 12:58:23.001298  3952 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.014230  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:22.972460  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:22.964017  3871 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:58:23.028801  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:23.030848  1680 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:22.982676  3852 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:22.982672  3845 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.035305  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:23.025888  1647 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.026227  1681 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.026335  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.037285  1675 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:22.984764  3879 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:23.040052  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.040647  1675 raft_consensus.cc:2393] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:23.034287  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.041402  1680 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.034643  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.019663  3861 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:22.935364  3727 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:23.043754  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 70670.1us
I20260709 12:58:23.037774  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:23.038753  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 86234.3us
I20260709 12:58:23.043252  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.045882  1647 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.048926  3766 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:23.053869  3961 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:23.057654  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.057636  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.058504  1675 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:23.022729  3937 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.060110  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 316) took 7294 ms. Trace:
I20260709 12:58:23.060663  1681 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:23.066138  1680 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:58:23.068064  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.029170  3911 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:23.066548  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:23.070822  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:23.038441  3845 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:23.072286   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:23.075191  3502 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.078559   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:23.063730  1429 rpcz_store.cc:276] 0709 12:58:15.766134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.766513 (+   379us) service_pool.cc:224] Handling call
0709 12:58:16.255640 (+489127us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b540012eb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1902090 00007f25d19a0f3a 00007f25d77571cc 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc 00007f25d5d15392 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:23.060021 (+6804381us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:20.517680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:20.518397 (+   717us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:20.518435 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:58:20.518460 (+    25us) tablet.cc:662] Decoding operations
0709 12:58:20.519714 (+  1254us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:20.519781 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:20.519818 (+    37us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:58:20.614179 (+ 94361us) tablet.cc:701] Row locks acquired
0709 12:58:20.614223 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:58:20.614455 (+   232us) write_op.cc:270] Start()
0709 12:58:20.614601 (+   146us) write_op.cc:276] Timestamp: P: 1783601900614386 usec, L: 0
0709 12:58:20.614630 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:58:20.615589 (+   959us) log.cc:844] Serialized 4440 byte log entry
0709 12:58:20.994178 (+378589us) op_driver.cc:464] REPLICATION: finished
0709 12:58:21.842832 (+848654us) write_op.cc:301] APPLY: starting
0709 12:58:21.842938 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:21.869921 (+ 26983us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:21.875095 (+  5174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:21.934071 (+ 58976us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:21.934345 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:58:21.934395 (+    50us) write_op.cc:312] APPLY: finished
0709 12:58:21.934700 (+   305us) log.cc:844] Serialized 83 byte log entry
0709 12:58:21.934872 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:21.935004 (+   132us) write_op.cc:454] Released schema lock
0709 12:58:21.935057 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:21.935459 (+   402us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:21.935491 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":95110,"reported_tablets":19,"spinlock_wait_cycles":56325888,"child_traces":[["op",{"apply.queue_time_us":841847,"apply.run_cpu_time_us":4271,"apply.run_wall_time_us":92619,"num_ops":11,"prepare.queue_time_us":475002,"prepare.run_cpu_time_us":39925,"prepare.run_wall_time_us":228987,"raft.queue_time_us":222259,"raft.run_cpu_time_us":31610,"raft.run_wall_time_us":223833,"replication_time_us":379349,"thread_start_us":851563,"threads_started":4,"wal-append.queue_time_us":153708,"wal-append.run_cpu_time_us":40682,"wal-append.run_wall_time_us":2284305}]]}
I20260709 12:58:23.044760  3933 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.081122  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:23.056406  3947 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.077349  2344 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.087028  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.062527  3860 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:23.092765  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:23.027359  3957 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.094069  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.074874  3930 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:23.098526  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.098831  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.099366  1527 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:23.100525  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:23.117940  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 72101.7us
I20260709 12:58:23.118425  1527 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:23.085930  3837 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.118757  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:23.089912  3819 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:23.079320  3879 consensus_queue.cc:1059] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:58:23.087509  3888 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:23.096911  3776 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:23.089798  3952 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:58:23.134408  1601 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:23.124244  3766 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:23.112390  3930 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:23.134557  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.134455  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.146849  1676 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:23.132867  3937 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:23.150368  3937 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.158422  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.159183  1676 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.098244  3920 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:58:23.121366  3803 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:23.133112  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.142716  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.132913  1575 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:23.095088  3968 consensus_queue.cc:1059] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:58:23.135284  3860 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:23.148216  3930 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.115952  1534 raft_consensus.cc:2955] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:23.094871  3612 consensus_queue.cc:1059] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:58:23.135344  1675 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:23.141172  3776 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.140260  3845 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:23.182027  3973 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:23.182585  3973 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:23.183079  3860 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:23.120888  3893 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:23.132278  3849 consensus_meta.cc:287] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.002s
I20260709 12:58:23.190701  3893 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:23.177871  3914 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.142455  3966 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:58:23.186604  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.135144  3911 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:23.156323  3958 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:58:23.156873  3947 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:23.162760  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.127547  3837 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.175181  1676 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:23.175325  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:23.176945  1680 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:23.146943  3952 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:23.144788  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.177587  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.207069  1526 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:23.145080  2451 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:23.182191  3845 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:23.137878  3924 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:23.184355  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.184480  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.183385  3973 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.187449  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:23.183979  3860 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.190083  1603 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:23.190192  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.182204  3776 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.153842  2421 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:23.198632  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.008s	sys 0.054s
W20260709 12:58:23.234645  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.008s	sys 0.055s
W20260709 12:58:23.235005  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 761011us
I20260709 12:58:23.225471  1533 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:23.226226  1528 raft_consensus.cc:2393] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:23.198469  1432 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 3 to 5, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.235909  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.234153  3957 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:23.244140  3973 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.246716  3937 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:23.199839  3847 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:58:23.252696  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.250326  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:23.253449  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 78206.9us
I20260709 12:58:23.245427  3837 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.257282  1675 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:23.258643  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.258160  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:23.261656  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.262699  1575 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:23.212564  3952 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:23.224673  3933 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.268672  1675 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:23.235265  3924 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.273252  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.255736  3969 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.255756  3968 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:23.278131  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:23.275087  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:23.283758  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:23.264256  3709 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:23.275331  3837 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:23.272475  3924 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:23.290546  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:23.288705  3709 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:23.300540  3837 raft_consensus.cc:697] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:23.300868  3709 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:23.300973  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:23.301548  3837 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.305545  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:23.307479  1533 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:23.301962  2423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 537) took 1620 ms. Trace:
W20260709 12:58:23.310938  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 1756) took 1381 ms (client timeout 1825 ms). Trace:
W20260709 12:58:23.311494  1683 rpcz_store.cc:269] 0709 12:58:21.929443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.038330 (+108887us) service_pool.cc:224] Handling call
0709 12:58:23.310720 (+1272390us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b54001f6b54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:23.310866 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145060608}
I20260709 12:58:23.287007  3617 raft_consensus.cc:3055] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:23.308827  2423 rpcz_store.cc:276] 0709 12:58:21.681982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.691214 (+  9232us) service_pool.cc:224] Handling call
0709 12:58:23.300796 (+1609582us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:23.301889 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5383424}
I20260709 12:58:23.288203  3947 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:23.297863  3888 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:23.337441  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.338881  1534 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:23.342177  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:23.322458  3617 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:23.285912  3969 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.346089  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.299275  3952 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.313839  3845 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.348526  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:23.462240  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:23.472312  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:23.496273  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 598) took 1697 ms. Trace:
I20260709 12:58:23.498381  2476 rpcz_store.cc:276] 0709 12:58:21.798458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.799143 (+   685us) service_pool.cc:224] Handling call
0709 12:58:21.799526 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.834916 (+ 35390us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:21.880505 (+ 45589us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.020611 (+140106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.020680 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:22.020740 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:23.495951 (+1475211us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b540051b154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:23.496022 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:23.496196 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2191,"raft.queue_time_us":2309,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8036,"spinlock_wait_cycles":82444416,"thread_start_us":137518,"threads_started":1,"wal-append.queue_time_us":260153,"wal-append.run_cpu_time_us":4413,"wal-append.run_wall_time_us":1175631}
I20260709 12:58:23.501019  1534 raft_consensus.cc:2410] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:58:23.400662  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.339944  3856 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:23.504092  1527 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:23.403627  2461 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:23.504642  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.506167  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.390933  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.509497  1528 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:23.331506  3982 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:23.507115  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.512043  1531 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:23.513015  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.513731  1532 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:23.514031  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.515013  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.515621  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.516100  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.508536  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:23.401067  3936 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.599s	user 0.005s	sys 0.003s
I20260709 12:58:23.464994  3502 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:23.525185  3982 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.531893  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.517643  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.564415  1531 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:23.398706  3776 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.519531  1527 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:23.366135  3850 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.559706  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.565918  1531 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:23.364920  3966 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:23.397990  3617 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.534898  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:23.401219  3930 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.495203  3709 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.583205  1605 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:23.530876  3766 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 12:58:23.588383  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 59457us
I20260709 12:58:23.538847  3937 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:58:23.604127  1497 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:23.467782  3920 raft_consensus.cc:3055] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:23.563661  3947 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:23.600693  3966 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.555428  3935 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:23.627604  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.598888  3803 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:23.563817  3888 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:23.546042  3957 consensus_queue.cc:1059] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:58:23.540006  3936 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.606000  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.635141  1683 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:23.628813  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:23.635900  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.602993  3990 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:23.608276  3920 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:23.520782  3856 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.632573  3989 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:23.660984  1609 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:23.670523  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 109796us
I20260709 12:58:23.663715  3957 raft_consensus.cc:3055] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:23.681458  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:23.693296  1575 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:23.659269  3776 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.693468  1530 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:23.651517  3990 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.689643  3936 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:23.717758  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 113697us
I20260709 12:58:23.722549  1497 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.723834  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:23.723935  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.691119  3882 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:23.693634  3957 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:23.729296  1497 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:23.710949  3935 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:23.714576  3776 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:23.739265  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.714097  3947 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.737679  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:23.709970  3995 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:23.673200  3989 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.715044  3803 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:23.732879  3882 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:23.768182  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.776935  1676 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:23.778234  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.775961  3982 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.690901  3920 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.732489  3973 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:23.769722  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.770061  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.787349  1681 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:23.735574  3887 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.773919  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:23.757025  1675 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:23.779911  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:23.791656  3766 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:23.792361  3766 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:23.792946  3766 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.793529  3989 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.793710  4004 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.794960  3990 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.795643  3850 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.746302  3776 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:23.800923  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.790597  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:23.796993  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.802580  1680 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
W20260709 12:58:23.779834  3987 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.184s	user 0.001s	sys 0.001s
I20260709 12:58:23.798723  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:23.769176  3999 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:23.806099  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.807229  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:23.808321  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:23.803632  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 184907us
W20260709 12:58:23.798424  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 78584.2us
I20260709 12:58:23.808250  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:23.745201  3970 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:23.776831  3997 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.716662  3888 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:23.813177  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 57275.8us
I20260709 12:58:23.797492  3709 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.803220  3776 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.802232  3989 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:23.804667  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.810328  3990 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:23.796607  3957 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.838893  3957 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.811338  3850 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:23.813464  3995 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:58:23.842195  3998 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:58:23.820996  3966 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.812841  4005 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:58:23.827469  3930 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.813139  3991 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:58:23.827811  3709 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:23.847882  3709 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.848251  3709 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:23.832562  3914 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.004s
I20260709 12:58:23.849862  3937 raft_consensus.cc:3055] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:23.838454  3931 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:23.850448  3937 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:23.851655  3937 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.830778  3856 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:23.814441  3982 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:23.842896  3933 consensus_meta.cc:287] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 12:58:23.810004  3970 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:23.856788  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.857170  1683 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:23.862931  1678 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:23.820418  3973 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:23.868371  3973 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.853547  3972 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.828069  3999 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:23.869536  3972 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.874245  4005 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.877688  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.874845  4005 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:23.879525  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 71393.9us
I20260709 12:58:23.882308  4005 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:23.825384  4000 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:23.881043  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:23.850314  3914 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:23.853646  3990 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.874436  3999 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.889755  1575 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:23.892529  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:23.878978  3972 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:23.857306  3931 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.895807  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:23.871023  3970 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.870520  3933 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:23.902179  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:23.901895  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 87258.7us
I20260709 12:58:23.874915  3997 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:23.906203  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.906913  1680 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:23.897516  3991 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:23.897315  3989 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:23.910465  2344 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.894124  3803 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.916249  2344 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:23.883749  4000 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.918900  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.923379  1680 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:23.912552  3991 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.898741  3990 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:23.933797  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.904979  3882 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:23.896442  3931 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:23.927819  3924 consensus_meta.cc:287] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.004s
I20260709 12:58:23.944950  4012 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:23.945744  1683 raft_consensus.cc:2393] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:23.934257  1674 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:23.934137  3991 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.937338  4007 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:23.963974  1680 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.970114  4011 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:23.970795  4011 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.957170  3766 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:23.975821  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1863) took 1404 ms. Trace:
I20260709 12:58:23.976420  1602 rpcz_store.cc:276] 0709 12:58:22.571387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.573347 (+  1960us) service_pool.cc:224] Handling call
0709 12:58:22.573851 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.762911 (+189060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:23.975505 (+1212594us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b54004065d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:23.975753 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205953408}
I20260709 12:58:23.946794  3924 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:23.990785  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 74647.4us
I20260709 12:58:23.991560  2344 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:23.995936  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:23.995734  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:23.997049  1680 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 3: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:23.996575  1532 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:23.991650  3819 raft_consensus.cc:3055] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:24.003288  3973 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:24.006309  4008 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:58:24.008200  4001 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:58:23.996791  4007 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:24.012436  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:24.017458  1676 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:24.023524  4000 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.024246  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:24.001228  3990 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.002388  3819 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:24.008628  3970 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.033710  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 341) took 1575 ms. Trace:
I20260709 12:58:24.034845  3931 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.035519  4011 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.036108  4013 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:24.036356  3990 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.041491  1572 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:24.064708  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:24.047681  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:24.048416  1609 rpcz_store.cc:276] 0709 12:58:22.458726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.514839 (+ 56113us) service_pool.cc:224] Handling call
0709 12:58:22.516510 (+  1671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:23.670148 (+1153638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.033441 (+363293us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003403d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:24.033647 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626779520}
I20260709 12:58:24.048681  3819 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.050318  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.051108  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:24.051179  3989 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:24.017179  4007 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:24.053997  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.057690  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.067201  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:24.091446  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:24.091562  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.091740  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.092262  2475 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:24.092484  2435 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
W20260709 12:58:24.094369  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.094482  3931 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:24.093171  3709 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.095088  3931 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.098865  1497 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:24.081413  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:24.083025   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:24.101905  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:24.103361  1572 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:24.097491  3970 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.108554  1572 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:24.109265  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.110162  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.110195  1572 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:24.112439  1605 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:24.080812  4000 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:24.114281  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:24.116531  3993 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:24.080865  4011 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:24.088267  3997 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:24.089668  4007 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:24.124946  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.095153  3887 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:24.090319  3882 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.104094  4005 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:24.133814  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.107725  4004 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:24.115486  3999 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:24.117374  3930 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:24.118700  3989 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:24.120999  3888 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:24.081722  3990 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.121207  4000 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:24.117528  3933 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:24.140355  3970 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:24.140594  3924 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.156848  4011 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:24.140377  3993 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:24.171895  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 57698.3us
I20260709 12:58:24.172665  1602 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:24.141638  4005 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.194548  4005 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.161437  3766 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.104179  3991 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.170984  3999 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.171720  3709 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.183508  3989 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:24.175166  3930 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.188651  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1871) took 1542 ms. Trace:
I20260709 12:58:24.174321  3819 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.131374  4017 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.168334  4004 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:24.201498  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.183636  4000 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:24.220834  3709 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:24.079627  4013 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.192896  3970 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.191016  3888 raft_consensus.cc:697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:24.208940  1603 rpcz_store.cc:276] 0709 12:58:22.646531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.953276 (+306745us) service_pool.cc:224] Handling call
0709 12:58:22.955186 (+  1910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:23.225871 (+270685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.188358 (+962487us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000848d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:24.188581 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538718080}
I20260709 12:58:24.193487  3933 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:24.214536  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.233975  1605 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:24.220386  4004 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.222123  1608 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:24.234304  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.247056  1608 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:24.248229  1608 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:24.221418  3709 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.202618  4011 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:24.204948  3999 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.234844  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:24.242911  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.287659  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 489) took 2025 ms. Trace:
I20260709 12:58:24.211308  3930 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.210767  3776 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.212620  3953 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 12:58:24.249634  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.210533  4017 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.244007  4005 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.291829  1679 rpcz_store.cc:276] 0709 12:58:22.262436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.364136 (+101700us) service_pool.cc:224] Handling call
0709 12:58:22.364407 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.437852 (+ 73445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.437885 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:22.437925 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:22.437955 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.264140 (+1826185us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b540045b0d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:24.264220 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:24.287576 (+ 23356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168429440}
I20260709 12:58:24.231431  4012 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.250029  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.293538  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:24.257936  4021 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:58:24.305337  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.277199  3990 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.309067  3970 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:24.264621  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1870) took 1665 ms (client timeout 2073 ms). Trace:
W20260709 12:58:24.309831  1601 rpcz_store.cc:269] 0709 12:58:22.599743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.646872 (+ 47129us) service_pool.cc:224] Handling call
0709 12:58:24.247923 (+1601051us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54001c5554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:24.261951 (+ 14028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030001408}
I20260709 12:58:24.312284  4005 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.286235  3709 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.314101  4005 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:24.314529  4005 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:24.315001  1603 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:24.314438  3933 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:24.319231  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:24.276767  4025 log.cc:927] Time spent T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:58:24.250241  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 48817.9us
I20260709 12:58:24.309175  3770 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.323058  1572 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:24.321983  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 223213us
I20260709 12:58:24.327769  3882 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:24.352131  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.349965  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.351714  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:24.354274  1534 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:24.356134  1532 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:24.315501  4005 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.372442  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1865) took 1800 ms. Trace:
I20260709 12:58:24.303908  3989 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.375396  1500 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:24.335536  3770 consensus_queue.cc:1059] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:58:24.380427  1532 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:24.352576  3882 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:24.338637  3953 consensus_queue.cc:1059] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:58:24.379316  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:24.375109  1607 rpcz_store.cc:276] 0709 12:58:22.571942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.651846 (+ 79904us) service_pool.cc:224] Handling call
0709 12:58:22.652142 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.811750 (+159608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.372149 (+1560399us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002a9ed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:24.372342 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248931200}
W20260709 12:58:24.380481  4020 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:58:24.330658  3888 consensus_queue.cc:237] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.322577  4012 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.391296  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60652 (request call id 88) took 1329 ms. Trace:
I20260709 12:58:24.249709  4009 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.265s
I20260709 12:58:24.396155  1606 rpcz_store.cc:276] 0709 12:58:23.062021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.306647 (+244626us) service_pool.cc:224] Handling call
0709 12:58:24.372906 (+1066259us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54001c4b54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199e735 00007f25d19969fa 00007f25d695e4c9 00007f25cfedac54 00007f25cfedabe2 00007f25cfedab11 00007f25cfedaa8c 00007f25cfed9d42 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:24.391231 (+ 18325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677782272}
I20260709 12:58:24.385485  3882 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.386854  1525 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:58:24.404191  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 172d54128ab740c980d9c27aa0ff1761 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:24.398200  3547 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:24.258216  3993 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.394155  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:24.383525  3935 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:58:24.397920  3991 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:24.444676  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.426836  4013 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.373019  4011 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.414191  3770 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:24.442369  4030 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:58:24.422680  1534 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
W20260709 12:58:24.452250  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 65339.4us
W20260709 12:58:24.468575  2339 connection.cc:256] RPC call timeout handler was delayed by -1.2638427480000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23860000000000003s for a response
I20260709 12:58:24.487362  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.488696  1606 raft_consensus.cc:2393] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:24.480896  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:24.437697  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:24.490304  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.500597  4012 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:24.495388  3770 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.501166  4012 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:24.501698  4012 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.502538  3770 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.468737  3776 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.513209  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 330) took 2096 ms. Trace:
I20260709 12:58:24.515002  1602 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:58:24.504292  4017 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.526804  1600 rpcz_store.cc:276] 0709 12:58:22.416365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.416487 (+   122us) service_pool.cc:224] Handling call
0709 12:58:22.416775 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:22.821654 (+404879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.512833 (+1691179us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b540035f554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:24.513125 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929787136}
I20260709 12:58:24.444891  1674 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:24.476980  3861 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:24.526403  4033 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:58:24.527891  3849 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.588165  3849 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.534778  4009 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:24.589833  4009 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.602991  4000 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.545017  3861 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.605139  4000 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.603018  4009 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.640306  4013 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.641012  4013 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:24.641538  4032 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:58:24.640461  4031 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:24.643180  4031 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.646405  3849 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:24.674247  4004 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:24.678297  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.678637  1534 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:24.687458  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.681366  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.687853  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.688341  1604 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:24.688525  1600 raft_consensus.cc:2393] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:24.649312  4007 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.698203  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.699966  3819 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:24.700309  4007 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.696348  3861 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:24.702031  2476 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:24.705335  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.711769  1533 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:24.688407  1606 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:24.721047  2461 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:58:24.742143  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:24.743700  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 46451.3us
I20260709 12:58:24.746568  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.747599  1534 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
W20260709 12:58:24.748414  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.754753  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.675727  3930 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.701066  4007 consensus_queue.cc:1059] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:58:24.701109  3819 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:24.761864  3935 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:24.772794  4009 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:24.798048  3935 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:24.771338  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.783387  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:24.783993  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:24.798173  4009 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.775727  3937 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.819109  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.724126  4004 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.710466  4013 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.710613  3882 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.840723  3845 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:24.846001  3845 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.781890  4037 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:24.688956  3999 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.855499  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.854197  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:24.826541  3819 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:24.857693  1534 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:24.802026  3960 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:58:24.805631  3856 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:58:24.847394  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:24.872429  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:24.878257  2455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 529) took 2098 ms (client timeout 2073 ms). Trace:
I20260709 12:58:24.878660  4009 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:24.879004  2455 rpcz_store.cc:269] 0709 12:58:22.779947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.825190 (+ 45243us) service_pool.cc:224] Handling call
0709 12:58:24.877988 (+2052798us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54007571d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:24.878143 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27156736}
I20260709 12:58:24.879801  3845 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:24.866578  3730 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:24.883427  1500 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:24.884207  4010 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:24.884447  1674 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:24.883708  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.884466  3882 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.859834  3857 consensus_queue.cc:1059] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:58:24.886255  1500 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:24.871220  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:24.890542  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.891908  3935 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.892287  3857 raft_consensus.cc:3055] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:24.892406  3955 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.892777  3857 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:24.890167  4010 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:24.881342  4013 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.899852  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:24.882794  3730 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.860476  4037 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.900579  3857 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.919499  3857 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:24.903021  4013 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:24.906064  3930 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.907143  3845 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:24.908521  3730 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:24.900159  3819 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.914321  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.886123  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:24.930539  4041 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:58:24.930770  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:24.932461  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.933115  3960 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.934087  3960 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:24.934530  4037 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.934861  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:24.936559  1607 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:24.936365  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.937731  2461 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:24.938261  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.939010  1605 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:24.939512  1603 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:24.932332  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.943616  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:24.957986  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.959517  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:24.960770  1600 raft_consensus.cc:2410] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:24.961917  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.962276  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.963531  1531 raft_consensus.cc:2410] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:24.963579  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.964288  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:24.964919  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:24.966845  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.967712  1527 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:24.968712  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:24.966666  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 66904.1us
I20260709 12:58:24.969295  2461 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:24.969579  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.970077  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:24.935684  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:24.971185  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.970721  1679 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:24.957842  3819 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:24.977210  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:24.972860  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:24.978719  1531 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:24.979121  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:24.981453  1530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 1695) took 1815 ms (client timeout 1965 ms). Trace:
W20260709 12:58:24.981904  1530 rpcz_store.cc:269] 0709 12:58:23.162381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.162503 (+   122us) service_pool.cc:224] Handling call
0709 12:58:24.977259 (+1814756us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54003af054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:24.977353 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124772736}
I20260709 12:58:24.967509  3999 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:24.984570  4039 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:58:24.985253  3727 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:24.985613  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:24.985900  1500 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:24.979638  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:25.006515  2455 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.007905  4039 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:24.991426  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:24.992254  3960 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:24.994784  4013 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:24.976437  3837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.668s	user 0.008s	sys 0.032s
I20260709 12:58:25.009052  1534 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:25.009253  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:25.011397  4039 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:25.012041  3999 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:25.006479  4047 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:58:25.019467  2455 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:25.021020  3953 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.043752  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:25.043531  3953 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.044960  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:25.045078  1527 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:25.045392  2455 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.046130  2461 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
W20260709 12:58:25.034987  3837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.727s	user 0.009s	sys 0.033s
I20260709 12:58:25.027254  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.028328  2428 raft_consensus.cc:2410] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:58:25.029510  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:25.019920  1531 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:25.038619  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:25.047596  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.010963  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:25.047991  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:25.055759  1530 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:25.030373  3957 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.057232  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:25.025164  3730 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.060829  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.066990  1534 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:25.067122  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.067394  1534 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:25.067803  2428 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:25.067878  1532 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:25.053141  3999 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:25.068101  1534 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.068620  3999 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.069151  1534 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:25.058861  3957 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:25.062184  3952 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.062691  1525 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:25.074592  3999 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:25.062796  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 618) took 1015 ms. Trace:
I20260709 12:58:25.075474  2451 rpcz_store.cc:276] 0709 12:58:24.047105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.048816 (+  1711us) service_pool.cc:224] Handling call
0709 12:58:25.027091 (+978275us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:25.062717 (+ 35626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724480}
I20260709 12:58:25.075982  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.072299  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:25.077119  1532 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.076432  4012 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:25.070204  3957 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.076608  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:25.079118  3957 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.074172  3857 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:25.079905  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.080780  2451 raft_consensus.cc:2376] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4. Re-sending same reply.
I20260709 12:58:25.080104  4010 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:25.081552  3857 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.081888  4010 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:25.082247  3857 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:25.085865  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1795) took 1577 ms. Trace:
W20260709 12:58:25.086014  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:25.085520  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 74802.4us
I20260709 12:58:25.086707  1528 rpcz_store.cc:276] 0709 12:58:23.508306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.536948 (+ 28642us) service_pool.cc:224] Handling call
0709 12:58:23.586624 (+ 49676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:23.586905 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:23.586942 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:23.599314 (+ 12372us) log.cc:844] Serialized 26 byte log entry
0709 12:58:23.695163 (+ 95849us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:23.696812 (+  1649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:23.697225 (+   413us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:23.783964 (+ 86739us) raft_consensus.cc:1685] finished
0709 12:58:23.783985 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:25.084644 (+1300659us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b54003197d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:25.085800 (+  1156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113210624,"thread_start_us":42133,"threads_started":1,"wal-append.queue_time_us":108954,"wal-append.run_cpu_time_us":2122,"wal-append.run_wall_time_us":1041677}
I20260709 12:58:25.078480  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.090337  1500 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:25.090523  1498 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:25.083634  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:25.081894  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:25.086428  3770 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:25.100168  4054 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:58:25.102063  3770 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.104799  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.106040  3999 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.106829  3999 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.093701  3960 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.108753  4054 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:25.111093  3968 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:25.111541  3968 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:25.110730  1498 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:25.120721  3970 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:25.082894  4010 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.122133  3999 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.122036  4010 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:25.122905  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.126735  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:25.127939  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:25.129070  3915 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:25.126863  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.106057  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:25.130375  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.131024  1608 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:25.131687  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.131996  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.132825  1608 raft_consensus.cc:2393] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:25.133078  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.133708  2423 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:25.134158  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:25.134577  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.134683  1605 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:25.128456  4012 raft_consensus.cc:2764] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:25.139495  4013 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.135767  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.136413  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.137261  1607 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:58:25.129838  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.138295  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.138713  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.144829  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.184311  1532 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:25.184659  1605 raft_consensus.cc:2410] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:25.151858  2339 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:25.121377  3969 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:25.151068  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:25.188601  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 51717.2us
I20260709 12:58:25.190162  1608 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:25.098155  2428 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:25.210620  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:25.213039  2428 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:25.185452  3633 raft_consensus.cc:2764] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:25.130375  2421 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:25.171917  3770 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.176529  3845 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.191409  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:25.214684  1603 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
W20260709 12:58:25.216261  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.217126  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:25.231108  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.231428  1609 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:25.231563  4060 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:25.231756  1500 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:25.232101  4060 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.232458  4060 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.232944  3871 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:25.221617  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.119917  3730 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:25.228986  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.177302  4052 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:25.176607  3861 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:25.234591  4052 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.234928  3861 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.237167  4052 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.238039  3861 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.176739  3972 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:25.239890  1534 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:58:25.240327  1534 pending_rounds.cc:85] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 3
I20260709 12:58:25.233705  3770 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:25.232872  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:25.240725  3770 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:25.241180  3770 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.242172  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.243206  1609 raft_consensus.cc:2393] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:25.244181  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:25.238510  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.233659  3871 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.246098  1609 raft_consensus.cc:2410] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:58:25.247298  3871 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.239629  3972 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.247677  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.248673  1609 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:25.249295  3972 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.249730  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.251484  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.223176  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:25.252796  1534 pending_rounds.cc:107] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 12:58:25.228933  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 94832.4us
I20260709 12:58:25.253144  1534 raft_consensus.cc:2889] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:25.224058  3860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.922s	user 0.014s	sys 0.016s
I20260709 12:58:25.253696  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:25.254280  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:25.258167  1603 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
W20260709 12:58:25.255033  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 63711.7us
I20260709 12:58:25.227507  2455 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:25.219899  3970 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.219478  4012 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:25.113421  3857 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.183705  4039 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:58:25.140105  4013 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.262120  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:25.262200  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:25.264691  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:25.112413  3968 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.255577  4055 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.224982  3969 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:25.272643  3770 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:25.278316  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 127367us
W20260709 12:58:25.257896  3860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.956s	user 0.014s	sys 0.017s
I20260709 12:58:25.283041  2428 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:25.285295  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.286554  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:25.259451  3730 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:25.257620  3871 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:25.287904  1600 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:25.287716  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:25.267778  3961 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:58:25.227272  3993 consensus_queue.cc:1059] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:58:25.302014  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:25.303260  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:25.289323  3547 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.280727  3972 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:25.281262  4012 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:25.253808  3845 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.319036  3931 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.304889  3969 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.324414  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:25.329473  1532 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:25.330065  1527 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:25.316720  3968 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.283762  3970 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.350469  3970 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:25.356000  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:25.335640  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:25.358304  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.316294  3871 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:25.338977  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.326903  3730 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:25.340883  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.341665  3547 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.367880  3730 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.347416  1647 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:25.334118  3972 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.344923  4012 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.361903  3970 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:25.367309  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.346273  3969 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:25.369906  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:25.362349  3931 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.363241  3871 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.314268  4055 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.347213  4052 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:58:25.370105  3861 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.372408  3972 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.397723  1529 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:25.380836  3989 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.408283  4061 consensus_queue.cc:1059] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:25.378755  2451 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:25.402845  3860 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:25.380115  3970 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.432415  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:25.436021  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.405943  4065 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.425670  3770 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.427639  3953 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.428562  3893 raft_consensus.cc:3055] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:58:25.430859  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:25.455386  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.390045  3931 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.409170  4062 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:58:25.457837  4013 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:25.467552  4013 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:25.468060  4013 raft_consensus.cc:697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:25.468892  4013 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.458241  4055 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:25.460300  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:25.423870  3845 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:25.480754  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.480269  3856 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.411826  3989 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.510620  3856 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.513159  3856 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:25.463090  3893 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:25.438867  3860 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.481237  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.552338  4031 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.539314  4036 raft_consensus.cc:3055] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:25.624718  3969 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.766651  4036 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:25.620281  3972 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.525241  4060 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.769894  3969 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.771559  3972 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.769982  3989 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:25.770114  4060 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.778578  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:25.746742  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:25.752056  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 385546us
I20260709 12:58:25.786656  4065 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:25.605423  3861 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.787974  4065 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.789017  4005 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:25.759591  3617 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.791015  4065 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:25.752100  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 273003us
I20260709 12:58:25.740401  1525 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:25.795851  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:25.533471  3970 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:25.739248  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.759456  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:25.734193  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 360181us
I20260709 12:58:25.746821  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:25.800381  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 172d54128ab740c980d9c27aa0ff1761 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:25.803673  3847 raft_consensus.cc:3055] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.809427  3871 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.812171  2455 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:25.810182  3847 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:25.812961  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.623672  4012 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.821910  1609 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.553983  3937 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:25.838924  4069 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.844053  3860 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.843163  4069 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.817597  3847 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:25.845397  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 1801) took 1949 ms (client timeout 2214 ms). Trace:
I20260709 12:58:25.812960  3920 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.845525  3931 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:25.848376  3937 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:25.848707  3968 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:25.846091  1683 rpcz_store.cc:269] 0709 12:58:23.895321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.895495 (+   174us) service_pool.cc:224] Handling call
0709 12:58:25.844603 (+1949108us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b54001c16d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:25.845099 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112770816}
I20260709 12:58:25.850028  3968 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.841114  3893 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.851459  3730 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.851742  3893 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.852360  3730 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.848598  2423 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:25.854775  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.858482  4069 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:25.859467  3547 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:25.860185  3547 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:25.860437  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.850179  3937 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.865898  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 545) took 1366 ms. Trace:
I20260709 12:58:25.866883  3937 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:25.869000  3730 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:25.846099  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:25.873212  2474 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:58:25.877424  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.847947  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:25.875051  3968 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.828378  3989 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.846282  3847 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.772018  4036 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.883327  3856 consensus_queue.cc:1059] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:25.888747  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 559) took 1097 ms. Trace:
I20260709 12:58:25.861043  3547 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.893958  4035 consensus_queue.cc:1059] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:25.895269  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1876) took 1680 ms. Trace:
I20260709 12:58:25.895761  1602 rpcz_store.cc:276] 0709 12:58:24.214965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.246450 (+ 31485us) service_pool.cc:224] Handling call
0709 12:58:24.514617 (+268167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:24.532568 (+ 17951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.894776 (+1362208us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540035f550. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:25.895036 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576621824}
I20260709 12:58:25.890527  2474 rpcz_store.cc:276] 0709 12:58:24.789206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.758148 (+968942us) service_pool.cc:224] Handling call
0709 12:58:25.872525 (+114377us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:25.872750 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:25.882322 (+  9572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.886763 (+  4441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3870080}
W20260709 12:58:25.891600  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 47906.7us
I20260709 12:58:25.879961  3972 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:25.908269  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 553) took 1271 ms. Trace:
W20260709 12:58:25.911495  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.888317  3871 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.910154  3972 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:25.919934  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 114285us
I20260709 12:58:25.877857  2435 rpcz_store.cc:276] 0709 12:58:24.499597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.504524 (+  4927us) service_pool.cc:224] Handling call
0709 12:58:25.860015 (+1355491us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:25.865787 (+  5772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45971200}
I20260709 12:58:25.908921  2428 rpcz_store.cc:276] 0709 12:58:24.636585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.266081 (+629496us) service_pool.cc:224] Handling call
0709 12:58:25.278364 (+ 12283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:25.310304 (+ 31940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.907736 (+597432us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b540046bed0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:25.908030 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3657984}
I20260709 12:58:25.920868  3972 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:25.925096  2342 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:25.931313  4070 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:25.931896  4070 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:25.932178  3547 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.932459  4070 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.939374  1647 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:25.948478  4007 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:25.948805  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 51359us
I20260709 12:58:25.949790  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:25.953769  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.953616  2461 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:25.954991  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 548) took 1014 ms. Trace:
I20260709 12:58:25.955380  2461 rpcz_store.cc:276] 0709 12:58:24.941063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.047311 (+106248us) service_pool.cc:224] Handling call
0709 12:58:25.954795 (+907484us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54007201d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:25.954914 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065495936}
I20260709 12:58:25.958101  3999 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.958555  2474 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:25.958734  3999 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.962910  4075 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:25.963819  4075 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:25.965889  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 180292us
I20260709 12:58:25.967394  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 546) took 1047 ms. Trace:
I20260709 12:58:25.967813  2475 rpcz_store.cc:276] 0709 12:58:24.919476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.758227 (+838751us) service_pool.cc:224] Handling call
0709 12:58:25.966342 (+208115us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:25.966555 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:25.966899 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.966936 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:25.966985 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:25.967012 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.967058 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:25.967191 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11716864}
I20260709 12:58:25.967793  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:25.970674  3914 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:25.971366  3914 raft_consensus.cc:697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:25.973905  1528 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:25.974517  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:25.972765  3914 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.979892  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:25.980373  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 1707) took 2690 ms (client timeout 2070 ms). Trace:
W20260709 12:58:25.980906  1529 rpcz_store.cc:269] 0709 12:58:23.289907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.290285 (+   378us) service_pool.cc:224] Handling call
0709 12:58:25.979941 (+2689656us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540010a754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:25.980131 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4762599168}
I20260709 12:58:25.982081  3770 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:25.982404  4071 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:58:25.982625  3770 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.983112  3770 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.985704  2423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 545) took 1066 ms. Trace:
I20260709 12:58:25.986404  1609 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:25.987560  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:25.989144  4075 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:25.990675  4038 raft_consensus.cc:3055] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:25.991078  4038 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:25.991640  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 63974.9us
I20260709 12:58:25.992249  4038 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:25.993432  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:25.993911  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:25.994571  1683 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:25.994822  1674 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:25.998399  3857 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.998947  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:25.925086  3989 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:25.999835  1674 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:26.000057  1526 raft_consensus.cc:2410] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:26.001621  3989 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:25.986155  2423 rpcz_store.cc:276] 0709 12:58:24.919155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.758171 (+839016us) service_pool.cc:224] Handling call
0709 12:58:25.759045 (+   874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:25.853941 (+ 94896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.985406 (+131465us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b5400792cd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:25.985629 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201773952}
W20260709 12:58:26.002518  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 83683.9us
I20260709 12:58:26.003446  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:25.951450  3617 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:26.004921  3617 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:26.006259  4012 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:26.007812  4061 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:26.008895  4061 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.009174  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 1723) took 1046 ms. Trace:
I20260709 12:58:26.009282  4061 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.009690  1526 rpcz_store.cc:276] 0709 12:58:24.962514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.962638 (+   124us) service_pool.cc:224] Handling call
0709 12:58:26.008875 (+1046237us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540010b154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:26.009109 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349675392}
I20260709 12:58:26.012126  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.006527  3617 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.015787  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 616) took 1969 ms. Trace:
I20260709 12:58:26.016218  2476 rpcz_store.cc:276] 0709 12:58:24.046531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.046653 (+   122us) service_pool.cc:224] Handling call
0709 12:58:24.046967 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:24.718013 (+671046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.015333 (+1297320us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54006ed7d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:26.015585 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506033408}
I20260709 12:58:25.942763  4036 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:26.024690  3776 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:26.025334  3776 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:26.026255  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:26.026599  3776 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.027976  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.028007  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.027032  4062 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:26.029881  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.030813  1608 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:26.032068  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.032807  1609 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
W20260709 12:58:26.033983  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 90871.4us
W20260709 12:58:26.035146  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 83870.4us
I20260709 12:58:26.035710  4062 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.036463  4062 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:26.039095  4062 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:26.039008  2342 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:26.030714  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 56432.8us
I20260709 12:58:26.045933  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.046432  1531 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:58:26.058100  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:26.053361  1500 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:46719 timed out after 2.757s (SENT) [suppressed 26 similar messages]
I20260709 12:58:26.051450  4038 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.046304  3972 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.088160  3972 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.070207  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.076043  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.089942  1679 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.090006  1606 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
W20260709 12:58:26.091820  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 44460.9us
I20260709 12:58:26.077589  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.077849  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.078405  4052 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:26.078856  1680 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:26.079663  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.089077  3972 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:26.095683  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:26.097872  1682 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:26.099542  1526 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:26.104851  2451 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:26.105679  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 563) took 1128 ms. Trace:
I20260709 12:58:26.106122  2421 rpcz_store.cc:276] 0709 12:58:24.925742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.854806 (+929064us) service_pool.cc:224] Handling call
0709 12:58:25.855537 (+   731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:25.856399 (+   862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.856445 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.857345 (+   900us) log.cc:844] Serialized 26 byte log entry
0709 12:58:25.924744 (+ 67399us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:25.927001 (+  2257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.930195 (+  3194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.041354 (+111159us) raft_consensus.cc:1685] finished
0709 12:58:26.043575 (+  2221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.051934 (+  8359us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13341,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":309,"thread_start_us":52253,"threads_started":1,"wal-append.queue_time_us":155791}
I20260709 12:58:26.114912  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.116317  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.117475  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:26.125617  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.131558  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.133750  1678 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:58:26.133852  3770 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.135103  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.136035  1678 raft_consensus.cc:2393] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:26.136384  3770 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.136929  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.138702  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.139052  3617 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.140108  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.140904  1683 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:26.141711  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.162912  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 1726) took 1158 ms. Trace:
W20260709 12:58:26.164150  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.165014  1675 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:26.165273  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.166229  1683 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:26.165968  4052 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:26.167168  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.168277  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.168352  4052 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:26.169930  1680 raft_consensus.cc:2410] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:26.171540  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.172295  1680 raft_consensus.cc:2410] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:26.169749  1678 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:26.173784  1609 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:26.175016  4026 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:26.175482  4026 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:26.175781  1678 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:26.175855  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:26.176585  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 108022us
I20260709 12:58:26.177600  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:26.095300  3999 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:26.169346  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.163321  1531 rpcz_store.cc:276] 0709 12:58:24.963496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.053785 (+ 90289us) service_pool.cc:224] Handling call
0709 12:58:25.825073 (+771288us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873f8c 00007f25ce873ef6 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:26.121777 (+296704us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b54000c76d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:26.121874 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181630848}
W20260709 12:58:26.185201  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 67004.7us
W20260709 12:58:26.190151  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.193982  1675 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:26.195762  1681 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:26.195960  1682 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:26.196131  4070 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.175864  4026 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.202255  1532 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:26.199879  3856 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:26.205206  4070 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.205780  3989 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:26.205874  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 176745us
I20260709 12:58:26.206593  3989 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:26.207193  3989 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.124933  3972 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.212905  1679 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:26.222759  1678 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:26.192633  2428 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:26.228912  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.229593  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:26.232671  4061 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.234015  3617 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:26.197893  4007 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:26.245597  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.248157  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.249269  1677 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 4. Ops: []
I20260709 12:58:26.249543  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.253505  1682 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:26.254707  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.258517  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:26.259280  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 81926.9us
I20260709 12:58:26.260660  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.261252  1679 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:26.270303  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.278146  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 100745us
I20260709 12:58:26.262748  3617 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.291778  1575 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:26.295564  3776 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:26.296321  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:26.297967  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.251868  3999 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:58:26.309248  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.342202  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.287525  3617 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.361688  3617 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:26.345769  2342 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:26.362959  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 83889.2us
W20260709 12:58:26.365366  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 59571.3us
I20260709 12:58:26.384738  3617 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:26.384790  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 137113us
I20260709 12:58:26.385103  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.389357  3857 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:26.392311  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.392870  3857 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.398973  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.399874  3857 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:26.393225  2451 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:26.393900  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.400803  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.401515  2421 raft_consensus.cc:2393] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:58:26.402486  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 109213us
I20260709 12:58:26.404863  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:26.410988  3730 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:26.411218  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:26.411623  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:26.411808  3776 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:26.412417  1530 raft_consensus.cc:2410] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:26.409821  4061 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.409703  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.417250  1678 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:26.410609  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.412184  1526 raft_consensus.cc:2410] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:26.413762  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.381937  4012 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:58:26.385447  3617 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.414472  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:26.415396  1679 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:26.425516  1682 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:26.419083  2476 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:26.385680  3989 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.428763  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.385135  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.412614  3776 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:26.437810  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.441963  1679 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:26.436301  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:26.443713  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.446748  1528 raft_consensus.cc:2410] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:58:26.455354  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 49863.9us
I20260709 12:58:26.440181  3834 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:26.458767  3834 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.432659  3617 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:26.465433  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.433708  2423 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:26.464393  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.470899  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.471179  1677 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:26.471745  3972 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.472483  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.461171  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.500547  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.501291  1677 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.502523  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.503683  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.504192  1682 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:26.505538  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:26.505801  2476 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.507083  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.508277  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.508859  2461 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:26.509882  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 105163us
I20260709 12:58:26.517148  4019 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.518528  2476 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
W20260709 12:58:26.518968  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 60575.8us
I20260709 12:58:26.523255  1677 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:26.461392  3856 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:26.526818  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:26.528012  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.446280  3999 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:26.478107  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.534902  1530 raft_consensus.cc:2393] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:26.532770  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:26.527128  3892 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.540532  3892 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.541709  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:26.542953  3892 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.537025  1677 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:26.528753  3770 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:58:26.541801  2451 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:26.538537  3961 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.560096  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:26.565600  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.543097  3776 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.504208  4026 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.577805  4007 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.561995  4012 consensus_queue.cc:1059] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:58:26.576107  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:26.580621  4007 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.575649  1498 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:26.581714  4026 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.593801  1680 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:26.586707  1572 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:26.588937  3892 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:58:26.585079  3730 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 12:58:26.600814  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.588186  1674 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:26.606786  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:26.568001  3999 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.608445  1681 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:26.609403  1674 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: [1.3-3.4]
I20260709 12:58:26.612964  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:26.562557  4019 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.619164  1683 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:26.591887  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.620692  1674 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:26.623132  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 565) took 1613 ms. Trace:
I20260709 12:58:26.623487  1674 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:26.623840  2428 rpcz_store.cc:276] 0709 12:58:25.009318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.938554 (+929236us) service_pool.cc:224] Handling call
0709 12:58:25.991245 (+ 52691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:26.239638 (+248393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.622813 (+383175us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400783554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:26.623056 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350587648}
I20260709 12:58:26.624989  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:26.626049  1683 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:26.626163  1500 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:26.604838  3989 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:26.631707  3834 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:26.633929  4038 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.005s
I20260709 12:58:26.635389  3999 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.642712  1680 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:26.647212  1678 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:26.657769  3914 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:58:26.659389  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 72809us
I20260709 12:58:26.621608  4026 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:26.661111  4026 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:26.661619  4026 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:26.661849  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 61155.7us
I20260709 12:58:26.665746  3999 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:26.666384  3999 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:26.666857  3999 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:26.667665  3973 raft_consensus.cc:3055] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:26.668216  3973 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:26.675078  3893 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:26.678051  3892 consensus_queue.cc:1059] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:26.679370  3892 raft_consensus.cc:3055] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:26.679780  3892 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:26.682701  4067 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:26.683331  4067 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:26.684549  4067 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.686450  3914 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.741622  3914 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:26.688827  3989 raft_consensus.cc:697] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:26.744992  3989 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.584818  3961 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.751927  3961 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:26.752353  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.752715  3961 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:26.641924  4036 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:26.754163  3847 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.754557  4036 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.755239  4036 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.754866  3847 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.700278  1679 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:26.763749  3961 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:26.764535  3961 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.765137  3961 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.766309  3926 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:26.766994  3926 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:26.741127  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:26.768620  3926 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.702378  3892 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:26.704236  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.706489  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.710065  3617 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.718897  4019 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:26.720356  4007 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:26.694742  1428 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.669341  3973 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.727635  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.727751  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:26.736802  4052 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.783330  4075 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.790623  3847 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.791337  3926 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:26.792599  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 118379us
I20260709 12:58:26.793463  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 361) took 9041 ms. Trace:
I20260709 12:58:26.797637  1649 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:26.801826  3840 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:26.857167  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 59694us
I20260709 12:58:26.856818  3840 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.858074  1649 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:26.860149  3972 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:26.807612  3999 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.860983  3972 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.862548  3999 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.807806  3893 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:26.864044  3893 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.808197  3871 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.803440  2423 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:26.810817  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.867691  3893 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.868773  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.869314  2435 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:26.814329  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.871333  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.859829  3840 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:26.818529  2421 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:26.821355  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.830705  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.830833  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.876698  1600 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:26.822530  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:26.835397  4052 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:26.839357  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:26.791394  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:26.792555  4081 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.407s	user 0.003s	sys 0.000s
I20260709 12:58:26.879832  4052 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:26.831476  1603 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:26.881517  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.827296  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:26.866274  3871 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:26.882961  1602 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.884897  3871 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:26.853663  1432 rpcz_store.cc:276] 0709 12:58:17.752353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.752533 (+   180us) service_pool.cc:224] Handling call
0709 12:58:26.793172 (+9040639us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:23.731559 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:24.261301 (+529742us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b540012e9a8. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7d549e1 00007f25d7d5364c 00007f25d53e2d5d 00007f25d53ce0a6 00007f25d53cdd58 00007f25d53d29f1 00007f25d53d29a9 00007f25d53d2939 00007f25d53d2901 00007f25d53d1b2d 000000000038f354
0709 12:58:24.271706 (+ 10405us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:24.274278 (+  2572us) write_op.cc:435] Acquired schema lock
0709 12:58:24.290361 (+ 16083us) tablet.cc:662] Decoding operations
0709 12:58:24.339458 (+ 49097us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:24.341800 (+  2342us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:24.349767 (+  7967us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:24.369302 (+ 19535us) tablet.cc:701] Row locks acquired
0709 12:58:24.372389 (+  3087us) write_op.cc:260] PREPARE: finished
0709 12:58:24.385614 (+ 13225us) write_op.cc:270] Start()
0709 12:58:24.397242 (+ 11628us) write_op.cc:276] Timestamp: P: 1783601904383224 usec, L: 0
0709 12:58:24.397295 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:58:24.428644 (+ 31349us) log.cc:844] Serialized 541 byte log entry
0709 12:58:25.368369 (+939725us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b1800110800. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:58:25.849484 (+481115us) op_driver.cc:464] REPLICATION: finished
0709 12:58:26.012801 (+163317us) write_op.cc:301] APPLY: starting
0709 12:58:26.013051 (+   250us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:26.013319 (+   268us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:26.013383 (+    64us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:26.013994 (+   611us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:26.014626 (+   632us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:26.014815 (+   189us) write_op.cc:312] APPLY: finished
0709 12:58:26.015525 (+   710us) log.cc:844] Serialized 23 byte log entry
0709 12:58:26.017170 (+  1645us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:26.017415 (+   245us) write_op.cc:454] Released schema lock
0709 12:58:26.017551 (+   136us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:26.021497 (+  3946us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:26.021555 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2525,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":162673,"apply.run_cpu_time_us":3231,"apply.run_wall_time_us":8649,"num_ops":1,"prepare.queue_time_us":452902,"prepare.run_cpu_time_us":35510,"prepare.run_wall_time_us":1037130,"raft.queue_time_us":425408,"raft.run_cpu_time_us":21867,"raft.run_wall_time_us":71814,"replication_time_us":1451745,"spinlock_wait_cycles":80175872,"thread_start_us":830958,"threads_started":4,"wal-append.queue_time_us":349430}]]}
I20260709 12:58:26.808754  4093 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:26.886942  4093 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.798381  3892 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.838405  4007 consensus_queue.cc:1059] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:58:26.892825  4007 raft_consensus.cc:3055] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:58:26.893133  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.793918  4088 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.145s	user 0.000s	sys 0.003s
I20260709 12:58:26.893909  4007 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:26.813027  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:26.895208  2428 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:26.859864  1649 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:26.898237  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:26.897364  4007 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.814447  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.901062  4007 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:26.901718  2455 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:26.741132  4067 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.904944  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.906122  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.906294  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.906889  1600 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:26.907369  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:26.907673  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:26.908746  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:26.909343  1609 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:26.835923  3973 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.910244  1600 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:26.911775  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.913348  1603 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:26.913736  4093 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:26.915813  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.905354  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:26.916998  3871 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.918077  3871 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:26.920049  1606 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:26.920758  3871 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:26.921911  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:26.779915  3914 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:26.917102  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:26.930189  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 397477us
I20260709 12:58:26.833923  1428 catalog_manager.cc:5697] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 1 to 3, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.950733  2461 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:26.952684  1602 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:27.014457  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:27.026218  1678 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:27.027518  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:27.020706  1609 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
W20260709 12:58:27.015188  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 167049us
W20260709 12:58:27.021831  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 395687us
I20260709 12:58:27.021970  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:26.979465  1605 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.820693  3617 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:27.034461  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 136288us
I20260709 12:58:26.963819  3847 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.038375  2461 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:58:27.039919  1600 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:27.039973  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:27.042136  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.975044  4052 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:58:27.043570  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.049757  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:27.064400  1601 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:27.090262  3920 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.090875  3920 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.092929  3920 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.093024  4052 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:27.094453  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:27.096163  4052 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:27.096629  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 564107us
I20260709 12:58:27.097271  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.098129  1498 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.099383  3972 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:27.077340  2451 consensus_meta.cc:287] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.008s
I20260709 12:58:27.100026  4100 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.100266  1498 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.100418  2451 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:27.101253  3857 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.082119  3779 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:27.096644  4052 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:27.101545  4100 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:27.104279  4100 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:27.101850  3857 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.108556  4036 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.109751  2475 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:27.082434  2455 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:27.112346  1607 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:27.103590  4052 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.114333  4052 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:27.118126  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:27.119061  2476 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:58:27.102357  3779 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:27.121381  3779 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:27.121922  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.128553  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:27.118855  2435 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:27.129104  1605 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:27.126155  1428 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 5, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.085956  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:27.051779  3776 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:58:27.139736  2421 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:27.139842  1683 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:27.140552  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:27.130304  3857 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.141398  2455 raft_consensus.cc:2393] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:27.141711  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:27.141022  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 84401.9us
I20260709 12:58:27.142041  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:27.150552  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 60635.6us
I20260709 12:58:27.142758  4026 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.142985  1428 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.144218  3961 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.145947  4036 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:27.147253  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.150903  1682 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:27.064888  3770 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:27.166805  1647 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.159691  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:27.165158  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:27.177834  1428 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:27.167068  3999 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:27.185379  1498 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.170157  4038 consensus_queue.cc:1059] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 12:58:27.189205  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.177006  3847 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:27.187883  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:27.195883  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 123048us
I20260709 12:58:27.181758  4036 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.188095  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:27.177237  3972 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:58:27.209869  4103 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:27.190833  4097 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:58:27.211618  4005 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:27.211951  4097 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:27.212072  4005 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:27.212486  4097 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:27.212884  3779 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.182693  4061 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:27.221738  3892 consensus_queue.cc:1059] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:27.222640  3892 raft_consensus.cc:3055] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:27.223436  4036 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.223940  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.228430  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.229333  1608 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:27.223016  3892 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:27.213068  4005 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:27.230350  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.213546  4097 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.231297  3972 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:27.231789  4097 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.232630  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:27.213943  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 49066.8us
I20260709 12:58:27.214706  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:27.190833  3969 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:58:27.209822  4106 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:58:27.210101  4109 raft_consensus.cc:3055] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:27.240854  4109 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:27.215916  1498 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.216144  3776 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:27.242161  3779 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.187188  4101 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.219866  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:27.244619  1607 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:27.221006  4075 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.171065  3770 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.206924  4026 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:27.231976  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 44168us
W20260709 12:58:27.200755  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 125959us
I20260709 12:58:27.230464  4005 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:27.238478  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.238962  2455 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:27.232659  3999 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:27.274745  3999 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.231834  3972 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:27.240417  4106 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:27.241781  4109 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.216802  3961 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:27.230417  3892 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:27.244987  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 56990.4us
I20260709 12:58:27.276732  4036 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.277245  3892 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.277916  1500 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:27.249040  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.279006  1608 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:27.249244  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.237797  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.250336  1498 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:27.251381  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:27.252532  3770 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:27.286598  3770 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:27.286705  1500 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:27.287055  3770 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:27.287456  3770 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:27.289067  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.252547  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:27.289981  1605 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:27.289990  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 52254.1us
I20260709 12:58:27.255600  1674 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:27.257742  3920 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:27.258795  3973 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:27.260650  3969 consensus_queue.cc:1059] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:27.302071  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 51810us
I20260709 12:58:27.262442  4110 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:27.272779  1607 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:27.260753  1647 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:27.291648  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:27.294168  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 79538.7us
I20260709 12:58:27.308027  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:27.314399  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.316182  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:27.318482  3847 raft_consensus.cc:3055] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:27.318621  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 57931.3us
I20260709 12:58:27.318984  3847 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:27.325724  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.278134  4106 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:27.299608  4075 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:27.328310  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:27.290896  2428 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:27.334372  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.350454  1607 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:58:27.299302  4101 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:27.355324  2342 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:27.357067  1529 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:27.309437  3920 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:27.323650  3961 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:27.292429  4026 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:58:27.329071  4007 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:27.360520  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:27.323472  4036 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:27.366745  4067 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:27.332742  4062 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:27.373437  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 53462.1us
I20260709 12:58:27.368300  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:27.347213  3969 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:27.356093  4101 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.301203  3972 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.350267  4109 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:27.362507  4075 raft_consensus.cc:697] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:27.379833  3847 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.385288  2421 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:27.385442  3847 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:27.347415  4103 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:58:27.386518  4103 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:27.387038  4103 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:27.388088  4103 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.393173  1533 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:27.393976  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:27.394511  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:27.355835  4052 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:58:27.354076  3730 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:58:27.370539  4007 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:27.398200  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:27.398614  4007 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:27.400350  1526 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:27.401576  1525 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:27.401789  1526 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:58:27.402165  2428 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:27.402765  1532 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:27.403954  1531 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:58:27.428177  1534 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:27.428881  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.380692  3871 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:27.432755  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:27.434280  1532 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:27.402168  1526 pending_rounds.cc:85] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 6
I20260709 12:58:27.328830  3617 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:58:27.366304  3961 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.362677  3840 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:27.362134  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:27.376219  1529 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:27.356809  4110 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:27.435249  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.404877  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:27.442281  1497 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.444175  1528 raft_consensus.cc:2368] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6.
I20260709 12:58:27.369930  3779 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:27.376379  1649 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.404388  1531 pending_rounds.cc:85] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 5
W20260709 12:58:27.430503  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 172d54128ab740c980d9c27aa0ff1761 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:27.404426  1530 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:27.380847  4101 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:27.436093  1526 pending_rounds.cc:107] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:58:27.460620  1526 raft_consensus.cc:2889] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:27.380577  4012 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:27.447674  1531 pending_rounds.cc:107] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:58:27.461601  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:27.461978  1531 raft_consensus.cc:2889] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:27.449134  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:27.449901  4094 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:27.446094  4026 consensus_queue.cc:1059] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:58:27.451150  4105 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:58:27.451957  4111 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:27.451974  1532 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:58:27.438225  3961 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:27.455976  1601 raft_consensus.cc:2410] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:27.458011  3840 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:27.460768  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 92985.5us
I20260709 12:58:27.470692  2342 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:27.472857  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.462262  1497 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:27.461408  1533 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:27.465265  2339 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:27.438195  4103 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:27.468628  1532 pending_rounds.cc:85] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 4
I20260709 12:58:27.446449  2435 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.440812  3871 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:27.405797  4067 raft_consensus.cc:697] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:27.504664  1532 pending_rounds.cc:107] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:58:27.511087  1532 raft_consensus.cc:2889] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:27.436988  3999 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.507035  1497 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.464035  4012 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.465471  4097 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:27.475198  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:27.505705  4110 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:27.465940  4094 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.463575  3920 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.516264  3840 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.518594  3999 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:27.515673  3871 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:27.511627  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 135314us
I20260709 12:58:27.469355  4111 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:27.515408  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:27.505451  4061 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.539938  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:27.542755  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.525914  1674 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:27.504947  3617 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:27.506491  4036 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:27.511525  3969 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:27.382607  4106 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.531570  1526 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:27.527679  4097 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.533377  4111 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.550213  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:27.555207  1532 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:27.523588  4012 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:27.552134  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 77532.3us
I20260709 12:58:27.554066  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.526167  3973 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:27.529290  4094 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.550467  4036 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.584514  1682 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:27.563431  3617 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:27.565212  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:27.566443  4111 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.567672  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:27.566938  1649 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.568614  4052 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:27.571462  1529 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:58:27.574156  4097 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.571772  4075 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.576258  3893 raft_consensus.cc:3055] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:27.561954  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:27.651525  1529 pending_rounds.cc:85] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 5
I20260709 12:58:27.589686  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:27.652944  1531 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:27.652413  1529 pending_rounds.cc:107] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:58:27.588958  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.653383  1529 raft_consensus.cc:2889] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:27.657490  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 68626.9us
I20260709 12:58:27.658138  1497 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.585592  4036 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:27.652756  1532 raft_consensus.cc:2376] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
I20260709 12:58:27.590111  3999 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:27.656417  2421 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.653571  3893 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:27.652837  4052 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:27.660871  3770 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.666551  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:27.671592  3999 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:27.677925  4127 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:27.678205  3999 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.678457  4127 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:27.679081  4127 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:27.685756  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.666208  4100 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:27.686654  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 119840us
I20260709 12:58:27.687400  1649 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.665290  4110 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:27.704435  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.705156  1605 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:27.683524  4052 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:27.706163  1607 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:27.706529  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.668265  4062 raft_consensus.cc:697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:27.708405  4100 raft_consensus.cc:697] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:27.709080  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:27.725916  1604 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.709604  4125 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.710587  4122 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:27.734205  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.717659  1526 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:27.719866  1603 raft_consensus.cc:2410] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:58:27.676111  3893 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:27.720536  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:27.721237  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.666893  4067 consensus_queue.cc:237] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.722944  1497 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:27.704149  4124 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 12:58:27.729543  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:27.729768  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:27.731295  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 44006.4us
W20260709 12:58:27.752636  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.735407  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:27.753697  1602 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:27.740389  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:27.745020  1606 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:27.749922  1600 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:27.757841  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.672176  3969 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.787052  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.770916  4005 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:27.810241  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.812999  4129 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.769941  3834 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:27.703961  3617 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.813582  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:27.772019  4109 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:27.823673  1649 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.810864  3973 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.833910  3973 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.836791  3973 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:27.828634  1602 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:27.829277  4130 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.815904  3834 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.830981  4100 consensus_queue.cc:237] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.857897  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.861936  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:27.822269  4129 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:27.823421  4109 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:27.877349  1604 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:27.837533  3973 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.859016  3834 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:27.836966  3999 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:27.869007  4132 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.053s	user 0.001s	sys 0.002s
I20260709 12:58:27.879144  4125 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:27.863673  3847 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:27.823894  4101 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.882180  3920 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:27.914467  3920 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.916836  3920 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:27.917742  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.879383  3973 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.896930  4123 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.895102  4129 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:27.921415  4038 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:27.923278  3973 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.923623  4129 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.925676  4129 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:27.923293  4038 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.869282  4130 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.932492  4038 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.934015  4130 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:27.936059  4110 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:27.942545  4097 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.945120  4097 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.936070  4036 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.957181  4036 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.933105  4012 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.959935  4120 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:27.989625  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:27.963460  4101 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:27.964471  4109 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.967059  2421 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:27.969484  3999 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:27.897850  3961 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.898540  4007 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:27.903769  3770 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:27.861124  4062 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:27.973489  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.980597  2342 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.979099  4061 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.988914  3914 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.994596  4012 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:27.976266  4106 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:28.011011  1527 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:27.985632  3989 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.022387  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 160544us
I20260709 12:58:28.023438  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:28.007593  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:28.046063  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.049057  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.050981  1649 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:27.999792  4097 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:27.992408  4120 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:27.974428  4094 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:27.991923  4127 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.010099  4036 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:28.075311  1604 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:28.078967  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.079829  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.003985  2435 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:28.101009  1683 raft_consensus.cc:2376] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4. Re-sending same reply.
I20260709 12:58:28.101929  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:28.008142  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 237736us
I20260709 12:58:28.096309  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:28.090397  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:28.098084  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.103888  1682 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:28.104313  1572 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:28.106937  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.107345  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.107930  1677 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.108575  1500 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:28.109485  3770 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:28.110075  3770 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:28.111078  3770 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.112201  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.114534  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.055617  3776 consensus_queue.cc:1059] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:58:28.115290  1681 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:28.001412  3892 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:58:28.115769  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.051218  4123 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:28.116508  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.116686  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.123045  1674 raft_consensus.cc:2376] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6. Re-sending same reply.
I20260709 12:58:28.117259  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.119429  1675 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:28.115875  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.125864  1680 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:28.126652  3847 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:28.085733  4122 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:28.139744  3892 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:28.139922  1676 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:28.011521  3914 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.142774  2476 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:28.142764  1678 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:28.144364  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:28.150377  3999 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:28.151065  3999 raft_consensus.cc:697] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:28.153292  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.155318  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.127431  3847 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.163525  1526 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:28.161398  1677 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:28.166144  1530 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:28.183513  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:28.187850  1529 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:28.051008  3989 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.190470  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.190662  2474 raft_consensus.cc:1240] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:28.192842  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:28.191303  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.195009  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.195792  1531 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:28.152295  3999 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.202781  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.203567  1526 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:28.154520  4005 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.216560  1530 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:28.222482  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 227484us
I20260709 12:58:28.121371  4097 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.206823  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:28.182819  4019 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.234901  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.236554  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:28.221149  4111 consensus_meta.cc:287] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 12:58:28.235661  1498 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:28.248332  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.247619  1533 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:28.226982  3892 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.264395  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:28.265480  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:28.226079  4100 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.226327  4130 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.283529  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.230844  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:28.231792  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:28.293963  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 189751us
I20260709 12:58:28.247577  4067 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.264365  3730 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.300954  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:28.308866  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 73276us
I20260709 12:58:28.270931  3892 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:28.299983  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 52155.4us
I20260709 12:58:28.330313  1534 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:28.274544  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:28.332736  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:28.337219  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.338261  1677 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:28.339906  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.243398  4019 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.346060  1532 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:28.303541  3961 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:28.351186  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.352341  1528 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:28.353953  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.191223  4120 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.351897  1527 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:28.335281  3892 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.335038  4005 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.391369  4005 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.391830  4005 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.343648  3857 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.395332  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 397536us
I20260709 12:58:28.344328  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:28.365015  4121 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:58:28.390388  1497 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.537s (SENT)
I20260709 12:58:28.299001  4100 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.374194  1525 raft_consensus.cc:2410] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:28.395821   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:28.404095  1498 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:28.304409  4130 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.313937  4067 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.333441  3730 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.406032  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:28.401610  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:28.388172  4007 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:28.387259  3973 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:58:28.400355  4110 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:28.473768  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.406694  4052 consensus_meta.cc:287] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.000s
I20260709 12:58:28.333045  3770 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:58:28.439853  4127 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:28.495050  4155 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:28.493906  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.496778  4155 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:28.497807  4145 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:58:28.440935  3920 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:28.465273  1527 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:28.390414  3989 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:28.442313  3914 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:28.477851  1532 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:28.404032  3776 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:58:28.508293  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.477667  3730 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:28.464303  4148 consensus_queue.cc:1059] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:58:28.401381  4093 consensus_queue.cc:1059] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:58:28.484356  1533 raft_consensus.cc:1240] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:28.484546  4100 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:28.484962  4137 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:58:28.462198  4120 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:28.484860  4110 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.491813  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:28.492749  3834 consensus_meta.cc:287] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.003s
I20260709 12:58:28.526459  3834 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.528234  4105 raft_consensus.cc:3055] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:28.528610  3834 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:28.492988  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.530021  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:28.530725  1601 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:28.493849  4144 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:28.493902  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.494642  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.533949  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:28.534178  1680 raft_consensus.cc:2376] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5. Re-sending same reply.
W20260709 12:58:28.466950  4143 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.109s	user 0.001s	sys 0.001s
I20260709 12:58:28.534668  4019 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:28.535137  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:28.493290  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.402390  3857 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.501499  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.498802  4153 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:28.506642  1681 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:28.490957  4052 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:28.510351  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 120014us
I20260709 12:58:28.562434  1529 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
W20260709 12:58:28.562651  1497 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.579s (SENT)
I20260709 12:58:28.486548  4130 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:28.497838  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:28.517496  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:28.520493  4142 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:58:28.533288  1674 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:28.533949  1675 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:28.546568  2475 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:28.547271  1676 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:28.537912  3857 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:28.575526  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 83473.7us
I20260709 12:58:28.528663  4105 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:28.565774  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 97925.5us
I20260709 12:58:28.561807  1683 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:28.578466  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.581543  1676 raft_consensus.cc:2376] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5. Re-sending same reply.
I20260709 12:58:28.492532  3847 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:28.565454  4101 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.583292  1525 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.596334  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.597479  1676 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:28.576112  4005 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.611809  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.612483  1682 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:28.615291  1675 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:28.622217  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:28.625197  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.630270  1500 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:28.631889  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:28.632164  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:28.633031  2475 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:28.609738  4052 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:28.598910  4153 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:58:28.645308  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.646700  4164 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:28.647368  1572 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:28.647850  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.648734  1526 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:28.596733  4101 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.628082  4093 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:28.651758  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.652424  1675 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:28.654364  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.654847  1500 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:28.655246  1674 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:28.648492  1676 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:28.668829  4164 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:28.669979  4174 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:28.664245  1682 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:28.606858  4156 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:58:28.673581  1600 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:28.671629  1500 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:28.680814  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 48998.5us
I20260709 12:58:28.682303  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:28.680003  4144 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:28.683018  1675 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
W20260709 12:58:28.683254  4147 log.cc:927] Time spent T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.283s	user 0.003s	sys 0.002s
I20260709 12:58:28.686692  2475 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:28.687482  1497 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:28.679847  3770 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:28.696421  4144 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:28.697419  4144 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.630544  4105 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.701788  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:28.681945  3999 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:28.706612  3770 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:28.707114  1498 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:28.708098  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:28.708745  4174 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:28.679617  4093 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:28.700865  4100 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:28.716802  2451 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:28.683749  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:28.718173  1678 raft_consensus.cc:2410] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:28.672430  3914 consensus_queue.cc:1059] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:58:28.712333  3999 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:28.766925  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 145389us
W20260709 12:58:28.775265  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.793373  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 144953us
I20260709 12:58:28.805975  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:28.807066  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.728982  4100 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:28.773612  3999 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:28.818472  1649 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:28.818317  2476 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:28.818359  2475 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:58:28.769846  4174 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:28.774317  4093 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:28.820688  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.818671  1575 leader_election.cc:400] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6.
I20260709 12:58:28.829152  1575 leader_election.cc:403] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:58:28.835199  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.835485  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.814232  4100 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:28.836021  1674 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:28.835014  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.837241  1676 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:28.835027  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.822348  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.822324  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:28.820429  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.842221  1675 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:28.799839  4101 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:28.821691  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:28.861315  1681 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:28.823782  4106 consensus_meta.cc:287] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.808s	user 0.006s	sys 0.006s
I20260709 12:58:28.869053  4156 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.867555  4173 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 12:58:28.871240  4173 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:28.871793  4173 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.872277  1525 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:28.827607  3847 raft_consensus.cc:2764] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:28.813125  3776 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:58:28.823935  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:28.868515  3892 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.878165  4093 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.867275  3893 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:28.879441  4067 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:28.880594  3892 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:28.881003  4172 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:58:28.877822  4156 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:28.866250  4165 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.206s	user 0.000s	sys 0.002s
I20260709 12:58:28.881664  1604 raft_consensus.cc:2393] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:28.867426  4171 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.886673  4105 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:28.827780  4052 consensus_queue.cc:1059] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:58:28.889683  4062 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.868582  2455 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:28.891754  4110 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:28.827976  4005 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:28.893920  4026 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6.
I20260709 12:58:28.894999  4173 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:28.895210  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 87915.7us
I20260709 12:58:28.896142  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:28.897082  4106 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.886826  4156 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:28.885190  2451 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:58:28.898034  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 56927.6us
I20260709 12:58:28.883740  1681 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:28.899741  4178 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.910912  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 263641us
I20260709 12:58:28.906390  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:28.897166  4100 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.915292  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:28.913800  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:28.915915  4178 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.920110  4167 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:58:28.921222  4178 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:28.914379  3847 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:58:28.904953  4120 consensus_queue.cc:1059] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:58:28.924070  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:28.925377  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:28.867761  3770 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.910221  4052 raft_consensus.cc:3055] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:28.928454  1572 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:28.911661  3892 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:58:28.900032  3776 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:58:28.934522  4164 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:28.926056  4026 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:28.935195  4062 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:58:28.940171  4026 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.940608  4026 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:28.913174  4156 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:58:28.960942  4178 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:28.961817  3973 raft_consensus.cc:3055] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:28.962320  3973 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:28.927956  3914 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:28.927278  4052 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:28.971530  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:28.974547  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.963210  3973 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.978575  4176 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.989687  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:28.945465  3989 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:28.992587  4176 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.981823  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:28.994029  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 65654.8us
I20260709 12:58:28.995052  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:28.995929  4153 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:28.996045  2344 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:28.996320  1572 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:28.997685  1606 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:28.997913  4153 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:28.998531  4153 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:28.999519  4153 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.002055  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:28.994102  2421 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.003762  3857 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.004328  3857 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.006623  3857 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:28.979489  3914 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:29.009989  3914 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:29.011269  4160 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.011884  2421 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:29.011855  4160 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.013764  4161 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:29.014539  4161 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:28.997736  4176 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.016638  2339 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:29.016916  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.021724  2474 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
W20260709 12:58:29.019187  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 311129us
I20260709 12:58:29.020067  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.002807  4026 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:28.978853  2455 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:28.982528  3776 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.982650  3961 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:29.029798  1572 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:29.028388  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:29.033070  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:29.056039  1675 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:29.033839  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:28.986732  3893 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:29.047151  3989 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:29.053416  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.067835  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:29.021865  4169 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:29.074682  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.077396  2474 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:29.076099  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47820.5us
I20260709 12:58:29.078307  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.078634  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:28.985136  3892 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:58:29.037390  4019 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:29.079677  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.036700  4097 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.083662  4160 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:29.084184  3834 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.083973  4184 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:29.053098  4167 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:29.084933  4174 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:29.085453  4177 raft_consensus.cc:2764] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:29.081506  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.047981  4005 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:29.050730  4094 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.136897  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:29.024729  4183 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:58:29.025617  4148 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:58:29.075193  3871 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.048422  4173 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:58:29.072932  3961 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.125169  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:29.088744  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.092882  4164 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:29.089210  3776 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.133713  4100 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.153836  3973 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.041987  3857 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:58:29.139761  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 58360.9us
I20260709 12:58:29.158128  1607 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:29.158466  1609 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:29.179437  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.158360  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:29.154194  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:29.101629  4019 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:29.169600  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 138694us
I20260709 12:58:29.137981  1608 raft_consensus.cc:2410] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:29.107146  4160 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:29.153854  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:29.137918  4167 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:29.189921  1605 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:29.180850  1606 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:29.156742  4184 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:29.094063  4052 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.138671  4178 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:58:29.100842  3999 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.176226  4177 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.177119  4094 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:29.157827  4120 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:58:29.194119  2339 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:29.207140  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 177398us
I20260709 12:58:29.196683  4005 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:29.205615  3847 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.209775  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:29.198308  4184 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.208290  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:29.215292  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:29.216979  4164 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:29.217585  4164 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:29.217787  1572 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:29.219615  1572 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:29.221767  4176 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:29.222503  4176 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:29.222947  4176 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:29.223795  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:29.223798  4176 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.227948  4164 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.229856  4130 raft_consensus.cc:3055] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:29.229866  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:29.230394  4130 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:29.230712  1530 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:29.231297  4130 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.231679  4173 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.232539  4130 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:29.232445  4173 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.235502  4173 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.236212  4178 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:29.237459  1497 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.238343  4173 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:29.239293  4173 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:29.239737  1530 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:29.240729  4173 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.232373  4100 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:29.307443  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 99274.8us
I20260709 12:58:29.308557  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:29.308370  4100 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.246220  1530 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:29.310678  4100 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.310757  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:29.208173  4185 log.cc:927] Time spent T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:58:29.308750  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:29.202219  4168 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:29.312155  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:29.313477  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 186790us
I20260709 12:58:29.161319  3989 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.328346  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:29.329435  1526 raft_consensus.cc:2393] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:29.201519  4160 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:29.332159  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.208806  3893 raft_consensus.cc:697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:29.326226  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:29.339722  1533 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:29.242898  4120 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:29.306684  3920 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:29.335041  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:29.243134  4183 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:29.242278  4184 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:29.330828  4140 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.208926  4094 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.322907  4110 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.326752  4067 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:29.324828  4171 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.357060  4200 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:29.323948  4100 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:29.206306  4177 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.364676  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:29.242429  3847 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.376190  1500 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:29.346392  4120 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:29.339653  4161 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:29.383028  1530 raft_consensus.cc:2368] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:29.383199  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.385951  2342 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.348366  3920 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:29.390143  1500 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.391148  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.362216  4067 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.359731  4192 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:29.351365  4026 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.395530  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:29.336906  4168 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:29.399477  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.400863  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.306521  4167 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.391024  4148 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:29.343497  4019 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.397810  4192 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.406817  1601 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:58:29.423629  4187 log.cc:927] Time spent T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:58:29.396796  4183 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:29.424840  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:29.397800  4067 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:29.373548  4140 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:29.422843  4190 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:58:29.371863  4110 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.374681  4200 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.389895  4100 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.398633  4144 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.430938  3893 consensus_queue.cc:237] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.464535  3834 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:29.464907  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:29.466210  4186 log.cc:927] Time spent T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:58:29.466408  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:29.466665  1603 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:29.467057  1528 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:29.467952  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:29.468961  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:29.433673  4192 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.419852  4148 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.417416  4201 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:29.424799  3961 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.381536  4171 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.450570  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:29.460893  4177 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.469383  4110 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.398205  4161 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:29.436592  4167 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:29.435446  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 290303us
I20260709 12:58:29.442605  4005 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.453218  3999 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.466588  4100 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.471177  3776 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.492133  3857 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.433997  4120 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.517468  1606 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
W20260709 12:58:29.529863  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.498028  4148 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.545926  4160 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:29.535341  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:29.501976  4191 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:58:29.525720  3914 consensus_meta.cc:287] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 12:58:29.557895  1603 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:29.443320  3920 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.561671  1531 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:58:29.570353  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 212420us
I20260709 12:58:29.578110  1575 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:29.561066  4155 raft_consensus.cc:3055] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:29.583493  1601 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:58:29.589138  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 52999.4us
I20260709 12:58:29.560990  3999 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.561512  4160 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:29.594666  1606 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:58:29.595854  1606 pending_rounds.cc:85] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 6
I20260709 12:58:29.535503  4005 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.596256  1606 pending_rounds.cc:107] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:58:29.599802  1606 raft_consensus.cc:2889] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:29.585320  4120 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:29.602910  1603 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:29.605540  4200 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:29.596654  3999 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:29.606215  4200 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.587327  3776 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:29.547446  3857 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.587087  3920 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.629470  4207 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.606732  4200 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.629921  3999 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.630180  4207 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.630849  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:29.631614  4200 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.631848  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:29.632540  1603 raft_consensus.cc:2368] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:29.563645  3914 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.606698  3776 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.519183  4201 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.640269  2339 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:29.584309  4171 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.591643  3847 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:29.588407  4155 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:29.654328  1681 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:58:29.656570  1681 pending_rounds.cc:85] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 6
I20260709 12:58:29.656423  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:29.656904  1681 pending_rounds.cc:107] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:58:29.657191  1681 raft_consensus.cc:2889] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:29.659346  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:29.660059  1526 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:29.631633  1601 raft_consensus.cc:2368] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6.
I20260709 12:58:29.661813  4168 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.663758  4201 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.667017  1602 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:29.673491  1680 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:29.668058  1608 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:58:29.673938  1608 pending_rounds.cc:85] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 5
I20260709 12:58:29.674189  1608 pending_rounds.cc:107] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:58:29.674432  1608 raft_consensus.cc:2889] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:29.672852  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:29.675767  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 289845us
I20260709 12:58:29.680202  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:29.657210  3776 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:29.681221  1529 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 1.
I20260709 12:58:29.646673  4140 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:29.684880  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:29.685590  1526 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
W20260709 12:58:29.691553  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.692647  1575 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:29.670830  3871 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:29.703204  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:29.591384  4100 consensus_queue.cc:1175] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e45ac8b66854c2f905bf2c4114cb489" responder_term: 3 status { last_received { term: 3 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 3 index: 6 } }
I20260709 12:58:29.707489  1529 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:29.707986  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:29.708664  1529 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:29.680001  4201 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.683418  4168 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:29.756126  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.705579  4205 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:29.760641  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 120440us
I20260709 12:58:29.762511  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:29.682729  4161 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:29.766345  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:29.769769  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 168938us
W20260709 12:58:29.758713  4206 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:29.707168  4140 consensus_queue.cc:1059] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:58:29.765697  3914 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:29.757547  4193 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:29.763625  4205 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.801156  1528 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:29.754045  3871 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:58:29.819128  4062 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:29.821429  4094 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:29.804780  4223 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:29.787194  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:29.757735  4201 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.837175  4219 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:29.845896  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 53480.1us
I20260709 12:58:29.817080  4205 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.762019  4168 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:29.890033  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:29.891700  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 184348us
I20260709 12:58:29.893041  1649 leader_election.cc:400] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:29.893393  1649 leader_election.cc:403] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:58:29.894112  1649 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.895293  1649 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:29.896797  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:29.904163  4220 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:58:29.900828  4222 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:58:29.761523  4155 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.872996  4223 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.887012  4219 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:29.909847  4223 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:29.912214  2451 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:58:29.915560  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 236658us
W20260709 12:58:29.906308  4214 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:58:29.913450  4155 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:29.924675  3973 consensus_meta.cc:287] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.000s
W20260709 12:58:29.925668  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.925743  3857 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:29.914215  4215 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:58:29.925668  1601 raft_consensus.cc:2410] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:29.929716  4005 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:29.915527  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 249296us
I20260709 12:58:29.912590  4203 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.933349  2342 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:29.934360  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:29.936961  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.815550  4193 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.958928  2342 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:29.933182  4219 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.902962  4062 consensus_queue.cc:1059] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 12:58:29.978024  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 81218.9us
I20260709 12:58:29.983489  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.984382  4229 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:29.984877  4229 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:29.985273  4229 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:29.985816  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:29.986380  1680 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:29.988250  4230 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:29.988641  4230 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:29.950068  4232 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.989511  4230 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:29.991101  4230 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:29.992409  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 89158.2us
I20260709 12:58:29.998481  1680 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:29.999536  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.002430  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.002641  1680 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:30.003034  1681 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:30.004164  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:30.005812  2451 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:30.007184  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:30.007798  1674 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:30.007411  3776 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.011211  4235 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:30.011931  4235 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:30.012212  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.017838  1674 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:30.003157  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:30.018561  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.019784  1679 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:58:30.024379  4189 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.644s	user 0.002s	sys 0.001s
I20260709 12:58:30.031133  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.033241  1674 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:29.976660  4225 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:30.033951  4225 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:30.034314  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 654) took 1087 ms. Trace:
I20260709 12:58:30.034739  2428 rpcz_store.cc:276] 0709 12:58:28.947418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:28.961700 (+ 14282us) service_pool.cc:224] Handling call
0709 12:58:28.962172 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:28.962602 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:28.962634 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:28.963141 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:58:29.203612 (+240471us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:29.205995 (+  2383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.212833 (+  6838us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:30.023882 (+811049us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b24003d0fe8. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7319c4 00007f25ce72facb 00007f25ce8eadc9 00007f25ce8eaa55 00007f25ce8ea09d 00007f25d151c10e 00007f25d153388c 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221
0709 12:58:30.034021 (+ 10139us) raft_consensus.cc:1685] finished
0709 12:58:30.034054 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:30.034248 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":590,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":85122304,"thread_start_us":232256,"threads_started":1,"wal-append.queue_time_us":359306}
I20260709 12:58:29.938808  4161 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.027084  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.033942  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.039016  1675 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:30.026213  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.040144  1677 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:30.035866  4148 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.042035  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:30.034337  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.046200  1497 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:30.044726  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.051245  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:30.054176  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 51108.4us
W20260709 12:58:30.058516  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 125704us
I20260709 12:58:30.059068  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.061110  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.066540  1526 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:30.070763  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:30.079063  1530 raft_consensus.cc:2368] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:30.080889  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.034340  4225 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:30.103567  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.053438  4100 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:30.106048  4100 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:30.107280  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.078047  4097 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:58:30.108021  1677 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:30.108857  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:30.057138  3920 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:30.111963  4207 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:30.112533  4207 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:30.114886  4005 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:30.115456  4005 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:30.116403  4005 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.117960  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.118606  1677 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:30.119414  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.123055  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.120975  4229 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.124279  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.125398  4229 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:30.083783  1647 leader_election.cc:400] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:30.012758  4235 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.125613  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.126436  4205 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.127123  1534 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:30.127559  4173 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:30.128067  4173 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.128547  4205 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:30.129163  4174 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:30.129583  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 53728.4us
I20260709 12:58:30.129720  4174 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.130208  4173 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:30.131011  1647 leader_election.cc:400] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6.
W20260709 12:58:30.131390  4144 consensus_meta.cc:287] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.003s
I20260709 12:58:30.131608  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.131779  4144 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:30.132906  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:30.134033  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.090425  4201 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:30.130168  4120 consensus_meta.cc:287] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 12:58:30.092339  4168 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:30.093456  4094 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:30.097939  4211 raft_consensus.cc:3055] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:30.099514  4052 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.100701  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.171021  1678 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:30.056959  3730 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:30.170282  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.106418  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:30.120276  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:30.065891  3857 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:30.120678  4212 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
W20260709 12:58:30.122566  4167 consensus_meta.cc:287] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.002s
I20260709 12:58:30.123374  1677 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:30.126053  1682 raft_consensus.cc:2393] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:30.084625  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:29.942656  4203 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.131800  4174 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:30.091437  4234 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:30.082408  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.146486  1675 raft_consensus.cc:2410] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:58:30.140509  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.140195  1529 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:30.185215  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:30.244174  1528 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:30.187729  4232 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
W20260709 12:58:30.248299  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 63194.6us
I20260709 12:58:30.250321  1609 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:58:30.182101  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.203733  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:30.205325  1680 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
W20260709 12:58:30.226904  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:30.191829  4067 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.000s
I20260709 12:58:30.230605  1683 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:30.170324  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.134053  4207 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:58:30.256876  2421 raft_consensus.cc:2410] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:58:30.259393  1602 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:58:30.286616  1602 pending_rounds.cc:85] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 2
I20260709 12:58:30.286904  1602 pending_rounds.cc:107] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:58:30.287181  1602 raft_consensus.cc:2889] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:30.265039  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:30.247871  4205 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.266391  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:30.266510  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:30.267824  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:30.201938  2428 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:30.270819  1532 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:30.275240  1675 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:30.167507  4211 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:30.275911  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.185320  3834 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:58:30.161468  3920 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:58:30.280673  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:30.284570  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:30.107293  4100 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.185618  4144 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:58:30.242605  4234 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:30.191395  4120 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:58:30.277375  2344 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:30.200711  2451 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:30.193630  4201 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:58:30.246003  4167 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:30.499622  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.295847  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:30.297047  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:30.523723  1603 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:30.524142  1533 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:30.296391  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.510771  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:30.525275  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 248006us
W20260709 12:58:30.350108  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:30.510828  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 551996us
I20260709 12:58:30.417428  1679 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:58:30.340927  4232 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:30.416786  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 59886.4us
I20260709 12:58:30.280869  4203 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:30.572218  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:30.674275  1527 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:30.273574  3776 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:30.574374  4019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.027s	sys 0.025s
I20260709 12:58:30.579996  4160 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:30.661161  4231 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.453s	user 0.000s	sys 0.001s
W20260709 12:58:30.339841  4184 consensus_meta.cc:287] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.966s	user 0.012s	sys 0.000s
I20260709 12:58:30.662485  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.663134  4148 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:30.302696  1681 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:30.667722  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:30.698597  1528 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:30.339613  4205 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.568831  4167 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.528565  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:30.708321  1605 raft_consensus.cc:2393] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:30.529263  4234 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:30.674974  2342 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:30.286238  4193 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:30.444851  4153 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:30.316924  4174 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.569104  4238 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.280673  4067 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:30.692521  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.008s	sys 0.035s
W20260709 12:58:30.737788  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.008s	sys 0.035s
W20260709 12:58:30.693117  2343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.021s	sys 0.020s
W20260709 12:58:30.738790  2343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.021s	sys 0.020s
I20260709 12:58:30.693681  1526 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:30.575352  4218 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:30.686167  4019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.028s	sys 0.026s
I20260709 12:58:30.528100  4097 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.669648  1531 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:30.682832  4160 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:30.721448  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 46578.4us
I20260709 12:58:30.675468  4140 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:58:30.674942  4169 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:58:30.730262  4120 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.750712  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:30.755247  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:30.723671  1498 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:30.677589  4232 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.683135  4207 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:58:30.732685  1528 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:58:30.733639  4235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.031s
W20260709 12:58:30.733969  4062 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.005s	sys 0.026s
W20260709 12:58:30.731065  4192 consensus_meta.cc:287] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.222s	user 0.013s	sys 0.000s
I20260709 12:58:30.748508  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.730039  4193 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:30.700101  4184 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.746488  1649 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:30.759264  4169 consensus_queue.cc:1243] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:30.762880  1528 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:30.774044  1528 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:30.711390  4211 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.766294  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:30.767583  2474 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:30.776226  1530 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:30.776607  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.755389  4160 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:30.775774  1531 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:30.780153  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:30.829311  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 49275.7us
I20260709 12:58:30.831060  1649 leader_election.cc:400] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:30.831540  1649 leader_election.cc:403] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:58:30.833817  1572 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:30.779963  4205 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:30.755821  4236 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:30.724812  4153 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.817507  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:30.737353  4174 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:30.759351  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.788830  1528 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:30.849866  2474 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:30.749809  4233 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:30.825237  4193 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:30.859360  4193 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.862607  4174 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:30.863987  4174 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:30.864531  4174 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.838347  4246 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:30.865999  4200 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:30.812778  4237 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:58:30.866533  4200 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.868234  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 606) took 1028 ms. Trace:
I20260709 12:58:30.868623  4200 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:30.870302  4242 log.cc:927] Time spent T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:58:30.868578  2476 rpcz_store.cc:276] 0709 12:58:29.839995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.840139 (+   144us) service_pool.cc:224] Handling call
0709 12:58:29.899033 (+ 58894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:29.909296 (+ 10263us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:29.912487 (+  3191us) log.cc:844] Serialized 14 byte log entry
0709 12:58:30.369734 (+457247us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.551782 (+182048us) log.cc:844] Serialized 26 byte log entry
0709 12:58:30.569172 (+ 17390us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:30.569209 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:30.569280 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:30.571794 (+  2514us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b48000cc3d8. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d68c1aa1 00007f25d68b8b37 00007f25d68b89ca 00007f25d69b026f 00007f25d69aff37 00007f25d69c455c 00007f25d69c4508 00007f25d69c4488 00007f25d69c4443 00007f25d69c36ec 00007f25d58eda96
0709 12:58:30.867974 (+296180us) raft_consensus.cc:1685] finished
0709 12:58:30.868068 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:30.868178 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236078,"prepare.queue_time_us":19733,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2777,"raft.queue_time_us":186028,"raft.run_cpu_time_us":7300,"raft.run_wall_time_us":525436,"spinlock_wait_cycles":46603648,"thread_start_us":369849,"threads_started":1,"wal-append.queue_time_us":807213}
W20260709 12:58:30.825981  1676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.008s	sys 0.016s
I20260709 12:58:30.814219  4169 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.838414  4201 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:30.771844  3857 consensus_queue.cc:1059] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:58:30.767681  4120 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.742105  4238 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.816454  4239 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:30.833897  1525 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:30.903447  4120 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:30.905088  4153 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:30.907800  4238 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:30.767108  4062 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.006s	sys 0.026s
I20260709 12:58:30.828423  4005 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:30.913383  2476 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:30.914533  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.915650  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.916595  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.917114  2476 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:30.917985  4140 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.918450  4140 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:30.918957  2428 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:58:30.919682  2421 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:30.837280  1572 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:30.922789  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 85627.5us
I20260709 12:58:30.923768  1533 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:30.924134  1572 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:30.775121  4192 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:30.874385  1677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.005s	sys 0.026s
W20260709 12:58:30.985251  1677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.005s	sys 0.026s
I20260709 12:58:30.758162  4097 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:30.873207  1676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.008s	sys 0.017s
I20260709 12:58:30.781805  4241 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 12:58:31.008617  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:30.769301  4235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.002s	sys 0.031s
I20260709 12:58:30.887637  1531 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:30.841213  4168 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:30.886801  4169 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:30.907912  4052 consensus_meta.cc:287] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.000s
W20260709 12:58:30.924295  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 518) took 1615 ms (client timeout 1574 ms). Trace:
I20260709 12:58:30.815057  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:30.854446  4248 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.925900  1572 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:30.876006  4219 consensus_meta.cc:287] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.001s
I20260709 12:58:31.004742  2476 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:30.869343  4200 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:30.890902  4201 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:31.112317  4219 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.113188  4201 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:31.113257  4200 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.115506  4200 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:31.115628  4219 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:31.118952  4248 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.035313  3776 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:31.073459  1530 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:58:31.057199  1678 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:31.122910  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1848) took 1093 ms. Trace:
I20260709 12:58:31.123333  1678 rpcz_store.cc:276] 0709 12:58:30.029042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.171763 (+142721us) service_pool.cc:224] Handling call
0709 12:58:30.184092 (+ 12329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.056994 (+872902us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54003d0ca0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d190fdc0 00007f25d199a1c0 00007f25d199b231 00007f25d1997d8f 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c
0709 12:58:31.122612 (+ 65618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.122835 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792062848}
I20260709 12:58:31.124622  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:31.125394  1678 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:31.126435  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:31.121809  3776 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:31.128027  3776 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:31.129591  3776 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:31.086239  1533 rpcz_store.cc:269] 0709 12:58:29.309263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.340479 (+ 31216us) service_pool.cc:224] Handling call
0709 12:58:30.266385 (+925906us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:30.924225 (+657840us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11555712}
I20260709 12:58:31.052963  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1770) took 1050 ms. Trace:
I20260709 12:58:31.134379  1681 rpcz_store.cc:276] 0709 12:58:30.003594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.003955 (+   361us) service_pool.cc:224] Handling call
0709 12:58:31.052713 (+1048758us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400320854. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:31.052887 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636160384}
I20260709 12:58:31.135939  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:31.137286  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:31.138273  1681 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
W20260709 12:58:31.048604  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.140441  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:31.054032  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1768) took 1053 ms. Trace:
I20260709 12:58:31.142321  1683 rpcz_store.cc:276] 0709 12:58:30.000288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.000423 (+   135us) service_pool.cc:224] Handling call
0709 12:58:30.000749 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:30.268930 (+268181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.053708 (+784778us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54001b9754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:31.053954 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527376256}
I20260709 12:58:31.143769  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:31.145052  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:31.149331  1683 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:31.145753  4148 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:31.149832  4148 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:31.149907  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:31.150305  4148 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:31.150529  1678 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:31.154062  4201 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:31.148623  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:31.141347  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:31.126974  1530 pending_rounds.cc:85] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 3
W20260709 12:58:31.121758  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 105428us
I20260709 12:58:31.005280  4067 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:31.018882  4062 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.005734  4205 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:31.157766  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:31.159478  1530 pending_rounds.cc:107] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:58:31.200400  1530 raft_consensus.cc:2889] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:31.060070  4211 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:31.195751  1676 raft_consensus.cc:2955] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:31.164001  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:31.005987  4153 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:30.853664  4236 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.028571  4238 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.854454  4233 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.159983  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:31.198553  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 474924us
I20260709 12:58:31.089599  4174 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:31.050541  4005 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:31.208185  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 44259.6us
I20260709 12:58:31.079254  4195 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.077906  4230 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:30.893112  2474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:31.062188  4026 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:31.157411  3973 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:31.216962  1681 raft_consensus.cc:2410] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:31.217123  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:31.157342  4201 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:31.162985  4167 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:31.201789  4205 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:31.229090  1497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.809s (SENT) [suppressed 20 similar messages]
I20260709 12:58:31.222280  2474 raft_consensus.cc:606] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:31.213718  4200 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:31.268455  1683 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:31.263800  1498 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:31.270120  1678 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:31.214843  4168 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:31.155364  4248 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:31.277823  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 58053us
W20260709 12:58:31.287770  1527 consensus_meta.cc:287] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.000s
I20260709 12:58:31.290601  1527 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:31.229943  4174 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:31.292585  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:31.231532  3973 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.208570  4062 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:31.302066  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.005s	sys 0.029s
W20260709 12:58:31.321766  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.005s	sys 0.031s
I20260709 12:58:31.262208  4205 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:31.323087  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.266793  4200 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.225273  4005 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:31.292987  4232 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:31.279840  4153 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:31.314656  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.013s	sys 0.023s
W20260709 12:58:31.366307  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 440486us
W20260709 12:58:31.366587  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.014s	sys 0.023s
W20260709 12:58:31.302259  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.009s	sys 0.025s
W20260709 12:58:31.367221  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.010s	sys 0.026s
I20260709 12:58:31.367110  1572 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:31.324980  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:31.289494  4094 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:31.327502  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1776) took 1305 ms. Trace:
I20260709 12:58:31.219050  4238 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.327981  1683 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:31.319433  4100 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.368976  1682 rpcz_store.cc:276] 0709 12:58:30.022079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.026805 (+  4726us) service_pool.cc:224] Handling call
0709 12:58:31.327194 (+1300389us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b54002800d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:31.327441 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203299712}
W20260709 12:58:31.302461  2344 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.007s	sys 0.027s
I20260709 12:58:31.321391  4174 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.356062  1608 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:31.370590  4238 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:31.370759  2344 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.007s	sys 0.029s
I20260709 12:58:31.369542  4100 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:31.321986  3973 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:31.373273  4100 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:31.328477  4176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.649s	user 0.014s	sys 0.037s
I20260709 12:58:31.356207  1602 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:31.336113  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.231781  4230 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:31.371232  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 687492us
I20260709 12:58:31.378821  1605 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:31.231365  4026 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.315668  4201 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:58:31.331278  4200 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:31.327404  4184 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:31.357304  4052 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:31.379593  3617 raft_consensus.cc:3055] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:58:31.382136  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 153081us
I20260709 12:58:31.378443  4261 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:58:31.362254  4244 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.527s	user 0.001s	sys 0.001s
I20260709 12:58:31.391096  4233 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:31.392724  4230 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:31.231921  4195 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:31.377807  4176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.703s	user 0.015s	sys 0.037s
I20260709 12:58:31.292701  4168 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:31.332195  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:31.370851  4174 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:31.387512  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 521) took 1865 ms. Trace:
I20260709 12:58:31.438338  1529 rpcz_store.cc:276] 0709 12:58:29.522172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.745221 (+223049us) service_pool.cc:224] Handling call
0709 12:58:29.758221 (+ 13000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:30.245654 (+487433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.381582 (+1135928us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54003ae154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:31.387450 (+  5868us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866100608}
I20260709 12:58:31.379873  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:31.405845  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1869) took 1367 ms. Trace:
I20260709 12:58:31.450928  1682 rpcz_store.cc:276] 0709 12:58:30.038233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.371703 (+1333470us) service_pool.cc:224] Handling call
0709 12:58:31.371979 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.405397 (+ 33418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.405440 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:31.405494 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:31.405554 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.405644 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.405778 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33073}
I20260709 12:58:31.418551  1527 raft_consensus.cc:1240] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:31.393836  4097 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:31.403007  4249 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:58:31.432574  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:31.432283  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 514) took 2124 ms (client timeout 1631 ms). Trace:
I20260709 12:58:31.439967  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:31.404551  4254 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.401467  4264 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:31.416278  4219 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:31.483264  1532 rpcz_store.cc:269] 0709 12:58:29.308145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.308280 (+   135us) service_pool.cc:224] Handling call
0709 12:58:31.432113 (+2123833us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400198054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:31.432215 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434159360}
I20260709 12:58:31.407958  3617 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:31.493048  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 385) took 2326 ms. Trace:
I20260709 12:58:31.409263  4260 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.453784  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:31.426206  4067 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:31.414636  4169 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:31.504621  4105 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:31.393886  4266 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 12:58:31.611871  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:31.544965  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 177601us
W20260709 12:58:31.549238  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 109362us
I20260709 12:58:31.613835  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:31.616740  1527 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:31.617959  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:31.618160  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:31.620518  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:31.437739  4094 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.194s
I20260709 12:58:31.633118  4067 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.713689  1527 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:31.546226  4219 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.637722  4120 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:31.638227  4260 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.639128  4105 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.532138  4254 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.510607  4264 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:31.578275  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 251274us
I20260709 12:58:31.641060  1530 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:31.642711  4168 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:31.644299  4026 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:31.646118  4062 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:31.647325  4148 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:31.596817  4267 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:31.648674  4248 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.649142  4235 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:31.650303  4236 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:31.652141  4223 consensus_meta.cc:287] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.701s	user 0.003s	sys 0.008s
I20260709 12:58:31.415081  4052 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.611912  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:31.673827  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 55764.6us
I20260709 12:58:31.511502  1604 rpcz_store.cc:276] 0709 12:58:29.123006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.123181 (+   175us) service_pool.cc:224] Handling call
0709 12:58:29.133733 (+ 10552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:29.425199 (+291466us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:29.442207 (+ 17008us) log.cc:844] Serialized 14 byte log entry
0709 12:58:30.038120 (+595913us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b1800488920. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d153823a 00007f25d19a2a2a
0709 12:58:30.317311 (+279191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:30.317363 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:30.317413 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.448808 (+1131395us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400267ad4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:31.448882 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.449025 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104906,"prepare.queue_time_us":16786,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5551,"raft.queue_time_us":31241,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":18180,"spinlock_wait_cycles":684298880,"thread_start_us":248069,"threads_started":1,"wal-append.queue_time_us":1294300}
I20260709 12:58:31.479790  4192 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:31.546622  4176 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:31.616909  4225 consensus_meta.cc:287] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.515s	user 0.012s	sys 0.002s
W20260709 12:58:31.709826  4246 consensus_meta.cc:287] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.000s
W20260709 12:58:31.800887  4251 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.517s	user 0.000s	sys 0.001s
I20260709 12:58:31.549270  4230 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:31.641461  4234 consensus_meta.cc:287] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.915s	user 0.008s	sys 0.000s
I20260709 12:58:31.672632  3893 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.675420  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:31.718029  4224 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:31.807605  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:31.806269  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:31.853684  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1865) took 1816 ms. Trace:
W20260709 12:58:31.641461  3776 consensus_meta.cc:287] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
W20260709 12:58:31.810964  4211 consensus_meta.cc:287] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.002s
I20260709 12:58:31.821465  4195 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:31.823570  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 205019us
W20260709 12:58:31.801534  4269 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.398s	user 0.001s	sys 0.000s
I20260709 12:58:31.857455  1678 rpcz_store.cc:276] 0709 12:58:30.036973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.271889 (+1234916us) service_pool.cc:224] Handling call
0709 12:58:31.272241 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.325998 (+ 53757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.326037 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.356484 (+ 30447us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.503661 (+147177us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:31.503719 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.503818 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.853397 (+349579us) raft_consensus.cc:1685] finished
0709 12:58:31.853420 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.853615 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47657,"raft.queue_time_us":64678,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":24908,"thread_start_us":99426,"threads_started":1,"wal-append.queue_time_us":464706}
I20260709 12:58:31.820281  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:31.857448  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 51270.2us
W20260709 12:58:31.815332  4247 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.532s	user 0.000s	sys 0.001s
I20260709 12:58:31.876358  1572 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:31.828568  4246 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:31.805112  4236 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:31.848517  4184 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:31.805281  3973 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:31.826175  4250 log.cc:927] Time spent T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.536s	user 0.001s	sys 0.000s
I20260709 12:58:31.871727  4283 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:31.875451  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1852) took 1845 ms. Trace:
I20260709 12:58:31.794518  4248 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:31.863701  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 56209.6us
W20260709 12:58:31.878141  4256 log.cc:927] Time spent T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.582s	user 0.000s	sys 0.003s
I20260709 12:58:31.879587  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.880116  4161 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:31.880278  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.880983  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.881173  4168 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:58:31.810979  4223 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.881937  1600 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:31.881837  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.882393  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.882925  4140 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:31.884173  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1862) took 1847 ms. Trace:
I20260709 12:58:31.885967  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.848917  4153 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.785081  4267 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.827876  3920 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:31.753669  4264 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:31.804889  4235 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.877345  1500 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:31.983203  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:31.924585  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:31.984097  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1794) took 1317 ms. Trace:
I20260709 12:58:31.828287  4192 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.988827  1526 rpcz_store.cc:276] 0709 12:58:30.666287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.804175 (+137888us) service_pool.cc:224] Handling call
0709 12:58:30.832490 (+ 28315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.271332 (+438842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.271362 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.271816 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.387653 (+115837us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:31.387705 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.387787 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.983862 (+596075us) raft_consensus.cc:1685] finished
0709 12:58:31.983888 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.984037 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30924,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":512147,"threads_started":2,"wal-append.queue_time_us":472212}
I20260709 12:58:31.862689  4254 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:31.855578  4268 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:58:31.980998  4290 log.cc:927] Time spent T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:58:31.956871  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 588) took 1209 ms. Trace:
W20260709 12:58:31.905481  4160 consensus_meta.cc:287] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.075s	user 0.012s	sys 0.000s
I20260709 12:58:31.987562  1605 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:31.850754  3893 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.987165  1602 raft_consensus.cc:2410] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:31.849692  4280 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:31.854897  4234 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.955873  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1864) took 1919 ms. Trace:
I20260709 12:58:31.986470  1681 rpcz_store.cc:276] 0709 12:58:30.036261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.226363 (+1190102us) service_pool.cc:224] Handling call
0709 12:58:31.226801 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.277955 (+ 51154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.277985 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.318233 (+ 40248us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.448435 (+130202us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:31.448492 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.448589 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.883958 (+435369us) raft_consensus.cc:1685] finished
0709 12:58:31.883971 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.884115 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57517,"raft.queue_time_us":56418,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":33914,"thread_start_us":82508,"threads_started":1,"wal-append.queue_time_us":551782}
I20260709 12:58:32.122987  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:32.123759  1681 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:32.122303  1683 rpcz_store.cc:276] 0709 12:58:30.036727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.269349 (+1232622us) service_pool.cc:224] Handling call
0709 12:58:31.327814 (+ 58465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.369173 (+ 41359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.955063 (+585890us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b54002800d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:31.955802 (+   739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133334400}
I20260709 12:58:32.124909  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:31.856667  4224 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.991169  1609 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:31.900200  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:32.201953  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 301847us
I20260709 12:58:32.202705  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:31.994496  1677 rpcz_store.cc:276] 0709 12:58:30.030004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.196993 (+166989us) service_pool.cc:224] Handling call
0709 12:58:30.197351 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:30.245601 (+ 48250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.245633 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:30.246648 (+  1015us) log.cc:844] Serialized 52 byte log entry
0709 12:58:30.985738 (+739090us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:30.985783 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:30.985862 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.875210 (+889348us) raft_consensus.cc:1685] finished
0709 12:58:31.875235 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.875392 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51978,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":27375,"thread_start_us":634855,"threads_started":1,"wal-append.queue_time_us":879859}
I20260709 12:58:32.203801  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:32.204733  1677 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:32.014035  2475 rpcz_store.cc:276] 0709 12:58:30.747138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.749162 (+  2024us) service_pool.cc:224] Handling call
0709 12:58:30.763462 (+ 14300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.230740 (+467278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.230769 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:31.230813 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:31.230867 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.956659 (+725792us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54004cd454. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:31.956704 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.956812 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074070272}
I20260709 12:58:31.933531  4229 raft_consensus.cc:3055] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:31.901429  4220 raft_consensus.cc:3055] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:31.953017  4271 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.876997  4094 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:31.987478  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 110207us
I20260709 12:58:31.933369  2423 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:31.956277  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 530) took 1679 ms. Trace:
I20260709 12:58:32.018106  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.955992  4148 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:31.951651  4105 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:31.882968  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:31.854948  4230 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.908066  4211 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:32.139968  4052 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.208165  4224 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:31.992616  4067 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.118853  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.009449  4192 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.119037  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:31.885447  4005 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:31.824216  4225 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:31.993631  4261 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:32.126047  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:32.206903  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:31.887248  4169 consensus_queue.cc:1059] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 12:58:32.273154  4169 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:32.273782  4169 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:32.273249  4224 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.274969  4169 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:32.276441  4224 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.276612  4169 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:32.217089  1534 rpcz_store.cc:276] 0709 12:58:30.276663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.276825 (+   162us) service_pool.cc:224] Handling call
0709 12:58:30.313069 (+ 36244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.510906 (+197837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.510941 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.590106 (+ 79165us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.167096 (+576990us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:31.167149 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.167386 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.956030 (+788644us) raft_consensus.cc:1685] finished
0709 12:58:31.956050 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.956195 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3479,"raft.queue_time_us":3628,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":18318,"thread_start_us":466085,"threads_started":1,"wal-append.queue_time_us":1180992}
I20260709 12:58:31.895772  4266 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:31.993330  4184 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.221277  1500 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:31.996711  4153 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:31.996908  3920 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:32.224423  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:32.222229  4193 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:32.035424  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.005s	sys 0.021s
I20260709 12:58:32.232224  1605 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:32.286448  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.006s	sys 0.022s
I20260709 12:58:32.119542  4160 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:32.218070  4200 consensus_meta.cc:287] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.805s	user 0.005s	sys 0.005s
W20260709 12:58:32.233165  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 462038us
I20260709 12:58:32.211951  3776 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:32.209372  4229 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:31.998260  4236 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.234339  2421 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:32.298668  4160 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.286057  4005 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:32.299577  4005 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:32.300794  4236 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.208675  4280 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.300621  4005 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.234452  2451 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:32.245071  3973 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.246037  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.247308  1432 catalog_manager.cc:5697] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 4 to 7, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:32.335263  2343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.071s	sys 0.083s
I20260709 12:58:32.215396  4293 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:32.251861  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1861) took 2215 ms. Trace:
W20260709 12:58:32.255097  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41270 (request call id 227) took 14020 ms (client timeout 15000 ms). Trace:
I20260709 12:58:32.243031  4219 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.242273  4235 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.294751  4200 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:32.251866  4205 consensus_meta.cc:287] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.920s	user 0.008s	sys 0.002s
I20260709 12:58:32.261972  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.245072  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.214192  4220 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:32.278523  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 57335.2us
I20260709 12:58:32.282481  2475 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:32.363005  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 595) took 1025 ms. Trace:
I20260709 12:58:32.363236  2475 rpcz_store.cc:276] 0709 12:58:31.337856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.362407 (+1024551us) service_pool.cc:224] Handling call
0709 12:58:32.362678 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.362801 (+   123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.362815 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:32.362843 (+    28us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:32.362870 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.362901 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.362967 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.283880  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:32.286994  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 1.02315e+06us
I20260709 12:58:32.288218  1677 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:32.364676  2476 raft_consensus.cc:2393] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:32.364812  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1782) took 1520 ms. Trace:
I20260709 12:58:32.289712  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 573) took 2628 ms. Trace:
I20260709 12:58:32.292647  1674 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:32.295337  1681 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:32.365163  1677 rpcz_store.cc:276] 0709 12:58:30.848715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.284985 (+1436270us) service_pool.cc:224] Handling call
0709 12:58:32.285346 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.364561 (+ 79215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.364760 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.290910  4193 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:32.297541  4286 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:58:32.223168  4094 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.301774  3776 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:32.305379  1647 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:32.308812  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.269457  4261 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:32.313005  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.040s	sys 0.107s
I20260709 12:58:32.335734  1432 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 5 to 6, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:32.335743  2343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.071s	sys 0.083s
W20260709 12:58:32.381011  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.040s	sys 0.108s
I20260709 12:58:32.381798  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1853) took 1056 ms. Trace:
I20260709 12:58:32.381634  1432 catalog_manager.cc:5697] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: config changed from index 3 to 4, 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:32.344368  1679 rpcz_store.cc:276] 0709 12:58:30.036024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.560187 (+524163us) service_pool.cc:224] Handling call
0709 12:58:30.560622 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.569780 (+  9158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.663381 (+ 93601us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.664158 (+   777us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.367608 (+703450us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:31.367646 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.367708 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:32.251566 (+883858us) raft_consensus.cc:1685] finished
0709 12:58:32.251596 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.251772 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126115,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":9520,"thread_start_us":661130,"threads_started":1,"wal-append.queue_time_us":1519365}
I20260709 12:58:32.243873  4234 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:32.303078  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 605) took 2459 ms. Trace:
W20260709 12:58:32.313750  4239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.034s	sys 0.063s
I20260709 12:58:32.277962  4266 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.314273  4260 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.365772  1498 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:32.369637  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.050s	sys 0.052s
W20260709 12:58:32.392586  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.051s	sys 0.052s
I20260709 12:58:32.370405  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 668) took 1078 ms. Trace:
I20260709 12:58:32.393335  2476 rpcz_store.cc:276] 0709 12:58:31.292041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.330936 (+ 38895us) service_pool.cc:224] Handling call
0709 12:58:32.244910 (+913974us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:32.370341 (+125431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618112}
I20260709 12:58:32.394444  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.394963  2476 raft_consensus.cc:2410] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:58:32.343695  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.365723  1676 rpcz_store.cc:276] 0709 12:58:29.661519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.665659 (+  4140us) service_pool.cc:224] Handling call
0709 12:58:29.666212 (+   553us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:58:30.043401 (+377189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.043515 (+   114us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:58:30.169465 (+125950us) log.cc:844] Serialized 616 byte log entry
0709 12:58:31.005516 (+836051us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:31.282605 (+277089us) log.cc:844] Serialized 14 byte log entry
0709 12:58:31.320164 (+ 37559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.320278 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:32.289368 (+969090us) raft_consensus.cc:1685] finished
0709 12:58:32.289399 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.289628 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37598,"raft.queue_time_us":201582,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":46089,"thread_start_us":1125554,"threads_started":2,"wal-append.queue_time_us":888523}
I20260709 12:58:32.402204  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 578) took 1539 ms. Trace:
I20260709 12:58:32.402688  1676 rpcz_store.cc:276] 0709 12:58:30.862827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.401157 (+1538330us) service_pool.cc:224] Handling call
0709 12:58:32.401536 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.401807 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.401845 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:32.401903 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:32.401958 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.402016 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.402134 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.373463  2475 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:32.374431  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 141710us
I20260709 12:58:32.231825  4271 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:32.376003  1678 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:32.378391  1677 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:58:32.344481  1428 rpcz_store.cc:269] 0709 12:58:18.234938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.235206 (+   268us) service_pool.cc:224] Handling call
0709 12:58:32.254999 (+14019793us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:27.402704 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:27.403633 (+   929us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:27.403700 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:58:27.403719 (+    19us) tablet.cc:662] Decoding operations
0709 12:58:27.428067 (+ 24348us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:27.428181 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:27.428213 (+    32us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:58:27.429049 (+   836us) tablet.cc:701] Row locks acquired
0709 12:58:27.429107 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:58:27.429332 (+   225us) write_op.cc:270] Start()
0709 12:58:27.429500 (+   168us) write_op.cc:276] Timestamp: P: 1783601907429258 usec, L: 0
0709 12:58:27.429524 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:58:27.433822 (+  4298us) log.cc:844] Serialized 2069 byte log entry
0709 12:58:27.808287 (+374465us) op_driver.cc:464] REPLICATION: finished
0709 12:58:28.281710 (+473423us) write_op.cc:301] APPLY: starting
0709 12:58:28.289027 (+  7317us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:28.336110 (+ 47083us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:28.395451 (+ 59341us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:28.480973 (+ 85522us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:28.481222 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:58:28.481401 (+   179us) write_op.cc:312] APPLY: finished
0709 12:58:28.481718 (+   317us) log.cc:844] Serialized 47 byte log entry
0709 12:58:28.481909 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:28.482058 (+   149us) write_op.cc:454] Released schema lock
0709 12:58:28.482129 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:28.482613 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:28.482652 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":449995,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":423334,"apply.run_cpu_time_us":5032,"apply.run_wall_time_us":218372,"num_ops":5,"prepare.queue_time_us":174172,"prepare.run_cpu_time_us":37934,"prepare.run_wall_time_us":248589,"raft.queue_time_us":96022,"raft.run_cpu_time_us":32655,"raft.run_wall_time_us":247911,"replication_time_us":378535,"thread_start_us":484944,"threads_started":4,"wal-append.queue_time_us":247777,"wal-append.run_cpu_time_us":40475,"wal-append.run_wall_time_us":1812301}]]}
I20260709 12:58:32.313088  4246 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 12:58:32.380062  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 74792.7us
I20260709 12:58:32.384181  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 577) took 1521 ms. Trace:
I20260709 12:58:32.414916  1679 rpcz_store.cc:276] 0709 12:58:30.862584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.383531 (+1520947us) service_pool.cc:224] Handling call
0709 12:58:32.383824 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.383981 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.383996 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:32.384022 (+    26us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:32.384045 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.384077 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.384142 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.416807  1679 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:32.417461  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1873) took 1402 ms. Trace:
I20260709 12:58:32.369026  4205 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.359305  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1777) took 3109 ms. Trace:
I20260709 12:58:32.266304  4264 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.386152  1432 catalog_manager.cc:5697] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 5, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.423772  4267 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:32.418591  4174 consensus_meta.cc:287] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.908s	user 0.006s	sys 0.007s
I20260709 12:58:32.374138  4280 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.368132  4062 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.360083  4293 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:32.382233  1606 rpcz_store.cc:276] 0709 12:58:31.324906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.325249 (+   343us) service_pool.cc:224] Handling call
0709 12:58:31.334095 (+  8846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.712264 (+378169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.712294 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.712722 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:58:32.381412 (+668690us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:32.381458 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.381538 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:32.381615 (+    77us) raft_consensus.cc:1685] finished
0709 12:58:32.381626 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.381747 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71847,"raft.queue_time_us":115159,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":31514,"thread_start_us":1046005,"threads_started":2,"wal-append.queue_time_us":625776}
I20260709 12:58:32.458770  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47496 (request call id 3) took 1583 ms. Trace:
I20260709 12:58:32.460865  1531 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:58:32.472919  1531 pending_rounds.cc:85] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 2
I20260709 12:58:32.473214  1531 pending_rounds.cc:107] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:58:32.473517  1531 raft_consensus.cc:2889] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:32.474443  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1797) took 1774 ms. Trace:
I20260709 12:58:32.474926  1531 rpcz_store.cc:276] 0709 12:58:30.700511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.020930 (+320419us) service_pool.cc:224] Handling call
0709 12:58:32.460251 (+1439321us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:32.460469 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.474107 (+ 13638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.474367 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13363584}
I20260709 12:58:32.461383  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 591) took 1702 ms. Trace:
I20260709 12:58:32.476531  2461 rpcz_store.cc:276] 0709 12:58:30.758647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.773712 (+ 15065us) service_pool.cc:224] Handling call
0709 12:58:30.774489 (+   777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.266577 (+492088us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:31.266606 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:31.266654 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:31.266706 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.461114 (+1194408us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540046bed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:32.461166 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.461316 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132060800}
I20260709 12:58:32.399531  1498 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:32.378851  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 661) took 1089 ms. Trace:
I20260709 12:58:32.385377  4261 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:32.411027  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.407552  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:32.395305  4239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.034s	sys 0.064s
I20260709 12:58:32.388453  4219 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:32.531744  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 132298us
I20260709 12:58:32.408375  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1871) took 1554 ms. Trace:
I20260709 12:58:32.417954  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:32.417850  1679 rpcz_store.cc:276] 0709 12:58:31.015456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.416071 (+1400615us) service_pool.cc:224] Handling call
0709 12:58:32.416400 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.417212 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.417405 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:32.534264  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 116344us
I20260709 12:58:32.534578  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:32.533939  1677 rpcz_store.cc:276] 0709 12:58:30.853972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.366188 (+1512216us) service_pool.cc:224] Handling call
0709 12:58:32.366438 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.408094 (+ 41656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.408309 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.535997  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:32.536345  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:32.333984  4254 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:58:32.422567  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.424875  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.427333  1676 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:32.422122  4193 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.464444  1432 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 4, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.465149  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 584) took 1719 ms. Trace:
I20260709 12:58:32.471697  2474 rpcz_store.cc:276] 0709 12:58:30.888057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.888366 (+   309us) service_pool.cc:224] Handling call
0709 12:58:32.458472 (+1570106us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4c004ff5c0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25cfc64a20 00007f25cfc75a29 00007f25cfc3b644 00007f25cfc62f2d 00007f25cfc62b93 00007f25d1992c92 00007f25d199284a 00007f25d696060a 00007f25cfee67d4 00007f25cfee6762 00007f25cfee6691
0709 12:58:32.458631 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4754688}
I20260709 12:58:32.404623  4248 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:32.409312  4148 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:32.523298  1603 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:32.376178  4229 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:32.528777  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.537109  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:32.553938  1677 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:32.528468  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:32.537820  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1872) took 1522 ms. Trace:
W20260709 12:58:32.466694  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.459226  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.548938  1432 catalog_manager.cc:5697] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 5 to 8, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.556813  1432 catalog_manager.cc:5697] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 4 to 6, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:32.550678  4192 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.549074  2451 rpcz_store.cc:276] 0709 12:58:30.745680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.750049 (+  4369us) service_pool.cc:224] Handling call
0709 12:58:30.778994 (+ 28945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.333632 (+1554638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.464895 (+131263us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54007201d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:32.465088 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3245200768}
I20260709 12:58:32.486548  2455 rpcz_store.cc:276] 0709 12:58:31.289887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.292065 (+  2178us) service_pool.cc:224] Handling call
0709 12:58:32.245932 (+953867us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:32.375806 (+129874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8118656}
I20260709 12:58:32.548162  4280 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:32.486449  4223 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.552747  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1781) took 1708 ms. Trace:
I20260709 12:58:32.556332  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:32.523468  3730 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.549551  3973 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:32.560827  1432 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 5, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:32.566483  1677 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:32.465348  4174 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:32.572669  1682 rpcz_store.cc:276] 0709 12:58:30.844389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.452298 (+607909us) service_pool.cc:224] Handling call
0709 12:58:31.453264 (+   966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.492763 (+ 39499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.492803 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.555375 (+ 62572us) log.cc:844] Serialized 26 byte log entry
0709 12:58:32.393071 (+837696us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:32.393116 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.393181 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:32.552442 (+159261us) raft_consensus.cc:1685] finished
0709 12:58:32.552486 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.552669 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":183896,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":48,"thread_start_us":648872,"threads_started":1,"wal-append.queue_time_us":732669}
I20260709 12:58:32.586601  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:32.587419  1682 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:32.588575  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:32.534915  4184 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.527460  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 667) took 1235 ms. Trace:
I20260709 12:58:32.524781  3893 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.576500  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:32.561010  1676 rpcz_store.cc:276] 0709 12:58:31.015068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.403880 (+1388812us) service_pool.cc:224] Handling call
0709 12:58:32.420125 (+ 16245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.537580 (+117455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.537771 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.427110  4220 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.561753  4230 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.576591  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:32.530608  4219 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:32.490033  4062 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.582461  2339 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:32.583216  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:32.557786  3834 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:32.579839  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.582648  1432 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 4 to 7, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:32.642345  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 65844.7us
I20260709 12:58:32.643157  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:32.644408  2342 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:32.645705  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63320.4us
I20260709 12:58:32.646934  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:32.647774  2339 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:32.596700  4205 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.575263  4193 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:58:32.598271  4271 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.643061  1432 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:32.456441  1525 rpcz_store.cc:276] 0709 12:58:29.246549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.307202 (+ 60653us) service_pool.cc:224] Handling call
0709 12:58:29.350162 (+ 42960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.902066 (+1551904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.333142 (+1431076us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003af054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:32.355524 (+ 22382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3386020608}
I20260709 12:58:32.607643  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.387995  2435 rpcz_store.cc:276] 0709 12:58:29.830951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.873353 (+ 42402us) service_pool.cc:224] Handling call
0709 12:58:29.913010 (+ 39657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.296163 (+383153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.312547 (+ 16384us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.512551 (+200004us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.029372 (+516821us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:31.029430 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.029536 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.874137 (+844601us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:32.236081 (+361944us) raft_consensus.cc:1685] finished
0709 12:58:32.266910 (+ 30829us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.289922 (+ 23012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20164,"raft.queue_time_us":131585,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":26170,"spinlock_wait_cycles":19494784,"thread_start_us":662316,"threads_started":2,"wal-append.queue_time_us":557341}
I20260709 12:58:32.610535  4293 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.592186  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:32.584787  4297 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:58:32.575568  4280 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:32.572021  4225 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:32.525182  3776 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:32.632318  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:32.557235  4105 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:58:32.572641  2428 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:32.590612  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:32.635301  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.638123  1677 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:32.640410  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:32.594482  4229 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:32.650149  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:32.583447  4153 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.598785  4200 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.618148  3920 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:32.574791  4211 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:58:32.659374  1679 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:32.660328  4245 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:32.665124  1605 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:32.664148  1432 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 5, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.691231  1432 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 3, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.692595  1432 catalog_manager.cc:5697] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 4, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.653076  4220 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.583827  3730 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.674351  1676 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:32.653918  4298 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:32.675393  1533 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:32.699450  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 1850) took 1194 ms. Trace:
I20260709 12:58:32.653950  4161 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:32.679930  3973 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.627779  4219 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:32.681619  1530 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:32.659273  4192 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:32.682545  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.699796  4245 raft_consensus.cc:697] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:32.666103  3834 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:32.683043  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.717335  1526 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:32.683339  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.719426  1532 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:32.684067  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.684999  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.685065  4223 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:32.686581  4148 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.665717  4280 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:32.669008  4205 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.687376  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 664) took 1389 ms. Trace:
I20260709 12:58:32.688225  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.718570  3973 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.734230  2428 rpcz_store.cc:276] 0709 12:58:31.290880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.313526 (+ 22646us) service_pool.cc:224] Handling call
0709 12:58:32.459106 (+1145580us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:32.680550 (+221444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9558912}
I20260709 12:58:32.735616  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:32.735785  2428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:32.736346  2423 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:32.693531  1432 catalog_manager.cc:5697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.738276  1432 catalog_manager.cc:5697] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 5, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.738579  4245 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.699803  1533 rpcz_store.cc:276] 0709 12:58:31.505581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.632071 (+1126490us) service_pool.cc:224] Handling call
0709 12:58:32.699388 (+ 67317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.742539  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.743665  1533 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:32.741479  3973 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.745023  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.674839  4266 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.701814  1679 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
W20260709 12:58:32.702266  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 136061us
I20260709 12:58:32.676949  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.679646  4230 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:32.703539  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.710660  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.722316  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 583) took 1079 ms. Trace:
I20260709 12:58:32.723287  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.699832  4298 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:32.706135  3920 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:32.754513  1676 rpcz_store.cc:276] 0709 12:58:31.643119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.703180 (+1060061us) service_pool.cc:224] Handling call
0709 12:58:32.721848 (+ 18668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.722027 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.722049 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:32.722086 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:32.722121 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.722169 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.722260 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.775012  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.788771  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.792076  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:32.740327  1432 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 4, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.794581  1432 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 5, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:32.798043  4308 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:58:32.729001  4148 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.593274  2421 rpcz_store.cc:276] 0709 12:58:31.291792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.298449 (+1006657us) service_pool.cc:224] Handling call
0709 12:58:32.298809 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.299048 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:32.338995 (+ 39947us) log.cc:844] Serialized 14 byte log entry
0709 12:58:32.415505 (+ 76510us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:32.419649 (+  4144us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:32.456101 (+ 36452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.487673 (+ 31572us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.524031 (+ 36358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18493,"prepare.queue_time_us":259434,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":25582,"raft.run_cpu_time_us":8906,"raft.run_wall_time_us":78111,"thread_start_us":83457,"threads_started":2,"wal-append.queue_time_us":211487}
I20260709 12:58:32.804875  1676 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:32.858669  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:32.877425  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 124449us
I20260709 12:58:32.831051  1681 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:58:32.775141  4298 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:32.796803  1432 catalog_manager.cc:5697] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 2 to 5, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:32.829167  4169 consensus_meta.cc:287] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 12:58:32.898138  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 584) took 1254 ms. Trace:
I20260709 12:58:32.857975  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1795) took 2179 ms. Trace:
I20260709 12:58:32.843129  4281 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:32.910363  1676 rpcz_store.cc:276] 0709 12:58:31.643552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.776436 (+1132884us) service_pool.cc:224] Handling call
0709 12:58:32.804672 (+ 28236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.897799 (+ 93127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.898076 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:32.828758  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45362 (request call id 587) took 1184 ms (client timeout 1563 ms). Trace:
W20260709 12:58:32.914232  1678 rpcz_store.cc:269] 0709 12:58:31.644703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.896562 (+251859us) service_pool.cc:224] Handling call
0709 12:58:32.828505 (+931943us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400354dd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:32.828686 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885201792}
I20260709 12:58:32.915022  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:32.892834  4235 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.916051  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 588) took 1271 ms. Trace:
I20260709 12:58:32.774931  4205 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:32.915719  3893 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:58:32.920166  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 586) took 1275 ms. Trace:
I20260709 12:58:32.920576  1676 rpcz_store.cc:276] 0709 12:58:31.644335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.914044 (+1269709us) service_pool.cc:224] Handling call
0709 12:58:32.919638 (+  5594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.919830 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.919865 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:32.919911 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:32.919952 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.920007 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.920111 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.922353  1676 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:32.922919  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 589) took 1277 ms. Trace:
I20260709 12:58:32.923236  1676 rpcz_store.cc:276] 0709 12:58:31.645431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.921486 (+1276055us) service_pool.cc:224] Handling call
0709 12:58:32.922012 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.922673 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.922867 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.924595  1676 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:32.925176  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 590) took 1279 ms. Trace:
I20260709 12:58:32.925580  4211 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:32.925482  1676 rpcz_store.cc:276] 0709 12:58:31.645801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.923956 (+1278155us) service_pool.cc:224] Handling call
0709 12:58:32.924267 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.924952 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.925125 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.926864  1676 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:32.927345  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1787) took 1179 ms. Trace:
I20260709 12:58:32.927619  1676 rpcz_store.cc:276] 0709 12:58:31.747859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.926310 (+1178451us) service_pool.cc:224] Handling call
0709 12:58:32.926580 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.927139 (+   559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.927297 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.916288  4266 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:32.928813  4266 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.930896  4148 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.931020  4266 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.934952  4094 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:32.939613  1647 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:32.940594  4232 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:32.943424  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:32.943714  4309 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:58:32.944762  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.918011  4153 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:58:32.944648  4309 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:32.945544  1602 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:32.858357  3730 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:32.916425  1678 rpcz_store.cc:276] 0709 12:58:31.645048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.915207 (+1270159us) service_pool.cc:224] Handling call
0709 12:58:32.915494 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.915679 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.915715 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:32.915765 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:32.915837 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.915893 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.916000 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:32.911329  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.954532  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.955173  1526 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:32.911563  1528 rpcz_store.cc:276] 0709 12:58:30.678612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.850215 (+171603us) service_pool.cc:224] Handling call
0709 12:58:30.850918 (+   703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.205985 (+355067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.206017 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.206533 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.394563 (+188030us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:31.394605 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.857521 (+1462916us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540010b154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:32.857602 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:32.857651 (+    49us) raft_consensus.cc:1685] finished
0709 12:58:32.857664 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.857892 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8655,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":23651584,"thread_start_us":424997,"threads_started":2,"wal-append.queue_time_us":662838}
I20260709 12:58:32.947786  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:32.946466  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 403) took 1063 ms. Trace:
I20260709 12:58:32.900708  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:32.899541  1529 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:32.952847  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.965519  1602 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:32.966555  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:32.793095  3920 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:32.967865  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 537) took 1539 ms. Trace:
I20260709 12:58:32.951136  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:32.974570  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.975410  1528 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:58:32.963618  1603 rpcz_store.cc:276] 0709 12:58:31.883117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.885685 (+  2568us) service_pool.cc:224] Handling call
0709 12:58:32.946216 (+1060531us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54002558d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:32.946384 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214719232}
I20260709 12:58:32.983652  1529 rpcz_store.cc:276] 0709 12:58:31.428525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.858382 (+1429857us) service_pool.cc:224] Handling call
0709 12:58:32.967792 (+109410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:32.913805  4281 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:32.990548  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.990882  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:32.991736  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:32.995690  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:32.996918  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:32.997761  1608 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:32.996061  1602 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:58:32.910737  3776 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:58:32.998232  1530 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:32.998690  1602 pending_rounds.cc:85] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 3
I20260709 12:58:32.951093  4309 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:33.003852  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:33.001860  1602 pending_rounds.cc:107] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:58:33.004786  1602 raft_consensus.cc:2889] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:32.826309  3617 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:33.006278  2342 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:32.974485  4232 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:32.994297  4200 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:33.017081  2342 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:33.009115  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:32.989121  4225 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:33.018784  1683 raft_consensus.cc:2410] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:32.947988  4235 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:33.007452  4271 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:33.001735  3893 consensus_queue.cc:1059] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:58:33.019498  4200 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.032203  4281 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:33.026147  4232 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:33.039014  3920 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:33.031222  4225 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:33.043078  4219 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:33.026984  4193 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:33.112378  4301 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.738s	user 0.000s	sys 0.001s
I20260709 12:58:33.045205  4205 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:33.045713  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:33.046228  2428 raft_consensus.cc:606] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:33.047354  1528 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:33.050122  3617 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:33.005930  4246 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:33.082100  4298 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:33.086905  4252 log.cc:927] Time spent T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.773s	user 0.004s	sys 0.008s
W20260709 12:58:33.087926  4313 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:33.088253  4280 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:33.088311  4309 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:33.090648  4235 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:33.092260  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:33.069979  4211 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:33.097747  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:33.146078  1526 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
W20260709 12:58:33.146250  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 54068.5us
I20260709 12:58:33.147256  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:33.101074  1608 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:33.068477  4271 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:33.108747  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.072178  4200 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:33.118424  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:33.130959  1682 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:58:33.155952  1528 raft_consensus.cc:2376] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5. Re-sending same reply.
W20260709 12:58:33.120214  4261 consensus_meta.cc:287] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 12:58:33.116585  2428 raft_consensus.cc:614] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:33.147063  2339 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:33.108914  4220 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:33.157168  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:33.159801  4309 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:33.182977  3834 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:33.185977  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1854) took 3155 ms. Trace:
I20260709 12:58:33.221000  1680 rpcz_store.cc:276] 0709 12:58:30.030470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.256208 (+225738us) service_pool.cc:224] Handling call
0709 12:58:30.286544 (+ 30336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:30.314796 (+ 28252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.314843 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:30.350633 (+ 35790us) log.cc:844] Serialized 52 byte log entry
0709 12:58:30.845741 (+495108us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:31.261389 (+415648us) log.cc:844] Serialized 14 byte log entry
0709 12:58:31.293984 (+ 32595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.294084 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:33.086339 (+1792255us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:33.160399 (+ 74060us) raft_consensus.cc:1685] finished
0709 12:58:33.185690 (+ 25291us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.185900 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39033,"prepare.queue_time_us":589150,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":14053,"raft.queue_time_us":173397,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":24403,"spinlock_wait_cycles":10578176,"thread_start_us":765633,"threads_started":2,"wal-append.queue_time_us":790334}
I20260709 12:58:33.186488  4229 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.223493  4229 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:33.156821  4271 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:33.187570  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:33.226900  1526 raft_consensus.cc:2376] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6. Re-sending same reply.
I20260709 12:58:33.188261  1608 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:58:33.209944  4298 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:33.227753  1608 pending_rounds.cc:85] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 3
I20260709 12:58:33.228060  1608 pending_rounds.cc:107] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:58:33.228302  1608 raft_consensus.cc:2889] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:33.229594  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:33.230235  1608 raft_consensus.cc:2368] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5.
I20260709 12:58:33.231455  2342 leader_election.cc:400] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5.
I20260709 12:58:33.231868  2342 leader_election.cc:403] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:58:33.231341  4220 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:33.212533  4200 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:33.214605  4278 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:33.214653  4223 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:33.155421  4161 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:33.215761  4219 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:34.033439  1498 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:34.033519  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:33.279341  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 582) took 1636 ms. Trace:
I20260709 12:58:33.161247  4246 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:33.277097  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.041702  4246 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:34.044147  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:34.045228  1528 raft_consensus.cc:2376] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7. Re-sending same reply.
I20260709 12:58:34.039054  1526 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:58:34.016341  4323 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.549s	user 0.000s	sys 0.000s
I20260709 12:58:34.039212  4223 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.161907  4235 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.041296  1677 rpcz_store.cc:276] 0709 12:58:31.642741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.672433 (+1029692us) service_pool.cc:224] Handling call
0709 12:58:32.672793 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:32.673229 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:32.673271 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:32.673994 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 12:58:32.726770 (+ 52776us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:32.726805 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.726865 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:33.279068 (+552203us) raft_consensus.cc:1685] finished
0709 12:58:33.279097 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.279266 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3567,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5905,"thread_start_us":25033,"threads_started":1,"wal-append.queue_time_us":291286}
W20260709 12:58:33.246301  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:33.330827  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.446130  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:33.244612  4229 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:33.504669  1675 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:33.853904  4294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.000s	sys 0.007s
W20260709 12:58:33.501547  1674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1779) took 3473 ms (client timeout 1761 ms). Trace:
W20260709 12:58:34.038074  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 880890us
I20260709 12:58:34.150450  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:34.041317  1676 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:34.052686  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.052392  4308 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:34.053053  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 405) took 2169 ms. Trace:
W20260709 12:58:34.054868  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.149765  1674 rpcz_store.cc:269] 0709 12:58:30.028336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.034044 (+  5708us) service_pool.cc:224] Handling call
0709 12:58:33.501231 (+3467187us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b54000fa354. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:33.501455 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5165843328}
W20260709 12:58:34.156837  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.058000  4293 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:34.058951  4062 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:34.161653  4062 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:34.161484  4293 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.163697  4293 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:34.164187  4293 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:34.164649  4293 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:34.060184  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1789) took 2311 ms (client timeout 2307 ms). Trace:
W20260709 12:58:34.165758  1683 rpcz_store.cc:269] 0709 12:58:31.748383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.283546 (+535163us) service_pool.cc:224] Handling call
0709 12:58:34.059942 (+1776396us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540045bad4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:34.060102 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503741696}
I20260709 12:58:34.079083  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:34.167018  2461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 600) took 1775 ms (client timeout 1914 ms). Trace:
W20260709 12:58:34.167413  2461 rpcz_store.cc:269] 0709 12:58:32.392423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.078624 (+1686201us) service_pool.cc:224] Handling call
0709 12:58:34.166948 (+ 88324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:34.168439  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:34.081504  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1784) took 3232 ms. Trace:
I20260709 12:58:34.086371  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 1812) took 1143 ms. Trace:
I20260709 12:58:33.263077  4298 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:34.169734  1530 rpcz_store.cc:276] 0709 12:58:32.943298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.947558 (+  4260us) service_pool.cc:224] Handling call
0709 12:58:34.086121 (+1138563us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b54002d82d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:34.086271 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79341312}
I20260709 12:58:34.170775  1607 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:34.170888  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:34.171527  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 419) took 1238 ms. Trace:
I20260709 12:58:34.169095  1681 rpcz_store.cc:276] 0709 12:58:30.852958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.366175 (+1513217us) service_pool.cc:224] Handling call
0709 12:58:32.830710 (+464535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:32.900185 (+ 69475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.081206 (+1181021us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400354dd0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:34.081417 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067515008}
I20260709 12:58:34.171976  1607 rpcz_store.cc:276] 0709 12:58:32.933278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.155631 (+1222353us) service_pool.cc:224] Handling call
0709 12:58:34.155953 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.171294 (+ 15341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.171474 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:34.091496  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:34.174075  1605 raft_consensus.cc:2410] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:34.174496  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1955) took 1495 ms. Trace:
I20260709 12:58:34.174780  1605 rpcz_store.cc:276] 0709 12:58:32.679075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.091150 (+1412075us) service_pool.cc:224] Handling call
0709 12:58:34.174439 (+ 83289us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:34.100338  4289 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 1.892s	user 0.010s	sys 0.000s
I20260709 12:58:34.102313  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:33.247048  4232 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:34.106300  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:34.108100  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 598) took 2766 ms. Trace:
I20260709 12:58:34.204180  2475 rpcz_store.cc:276] 0709 12:58:31.341462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.363861 (+1022399us) service_pool.cc:224] Handling call
0709 12:58:32.373235 (+  9374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.405286 (+ 32051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.107823 (+1702537us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b540059f950. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:34.108020 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21046528}
I20260709 12:58:34.205860  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:34.111042  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47496 (request call id 4) took 1505 ms. Trace:
I20260709 12:58:34.116489  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 581) took 2474 ms. Trace:
I20260709 12:58:34.203658  1527 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
W20260709 12:58:34.117813  2476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 673) took 1670 ms (client timeout 1654 ms). Trace:
I20260709 12:58:34.119071  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:34.120842  4200 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:34.125640  4153 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.128134  4234 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:34.128342  3834 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:34.136968  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.136045  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 415) took 1219 ms. Trace:
I20260709 12:58:34.138477  1532 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:58:34.153077  4220 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:34.220855  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:34.221550  1532 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:34.222440  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:34.143567  1677 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:34.222664  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1818) took 1210 ms. Trace:
I20260709 12:58:34.219962  1608 rpcz_store.cc:276] 0709 12:58:32.916593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.232913 (+316320us) service_pool.cc:224] Handling call
0709 12:58:33.266328 (+ 33415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.037833 (+771505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.037877 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:34.135627 (+ 97750us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:34.135697 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.135808 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.135969 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9332,"raft.queue_time_us":785737,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104}
I20260709 12:58:34.223167  1529 rpcz_store.cc:276] 0709 12:58:33.012295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.012417 (+   122us) service_pool.cc:224] Handling call
0709 12:58:33.024534 (+ 12117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:33.024993 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:33.025053 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:33.029485 (+  4432us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.126757 (+ 97272us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:33.126815 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.126923 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.222426 (+1095503us) raft_consensus.cc:1685] finished
0709 12:58:34.222451 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.222598 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1947,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":14927,"thread_start_us":92705,"threads_started":1,"wal-append.queue_time_us":214666}
I20260709 12:58:34.227301  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:34.151319  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 409) took 2266 ms. Trace:
W20260709 12:58:34.032382  4318 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.585s	user 0.001s	sys 0.000s
W20260709 12:58:33.418977  4319 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 12:58:33.934192  4245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.008s
I20260709 12:58:34.141018  4233 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.246745  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:34.046237  4148 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:34.158756  4174 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:34.155643  1604 rpcz_store.cc:276] 0709 12:58:31.883749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.989660 (+105911us) service_pool.cc:224] Handling call
0709 12:58:32.011626 (+ 21966us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:32.202668 (+191042us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:32.202722 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:32.203627 (+   905us) log.cc:844] Serialized 52 byte log entry
0709 12:58:32.351109 (+147482us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:32.351145 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.111790 (+760645us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:34.052508 (+940718us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b54000ed654. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:34.052557 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.052598 (+    41us) raft_consensus.cc:1685] finished
0709 12:58:34.052611 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.052987 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80185,"raft.queue_time_us":80451,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":48014,"spinlock_wait_cycles":12982400,"thread_start_us":129014,"threads_started":1,"wal-append.queue_time_us":151758,"wal-append.run_cpu_time_us":4361,"wal-append.run_wall_time_us":1740136}
I20260709 12:58:34.158769  4308 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.159948  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:34.248893  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 89027.8us
I20260709 12:58:34.160805  4176 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.171497  1530 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:34.234078  3834 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:34.001807  4193 consensus_meta.cc:287] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.000s
I20260709 12:58:33.365305  4052 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:34.177517  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:34.136910  2423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.010s	sys 0.039s
I20260709 12:58:34.188462  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 421) took 1254 ms. Trace:
I20260709 12:58:34.032807  4280 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:33.432992  4167 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.362465  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:33.207695  4261 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.193598  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:34.290879  1526 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 3: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:34.102962  1528 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:34.155112  4254 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.197045  3776 raft_consensus.cc:3055] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:34.141625  4168 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:34.200268  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1854) took 2875 ms. Trace:
I20260709 12:58:33.419305  4278 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:34.137813  4223 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:34.208392  1682 rpcz_store.cc:276] 0709 12:58:31.642315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.672115 (+1029800us) service_pool.cc:224] Handling call
0709 12:58:32.672447 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:33.156062 (+483615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.116101 (+960039us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b5400066654. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:34.116399 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053915520}
I20260709 12:58:34.126259  4264 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:34.129920  3973 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:34.209211  2476 rpcz_store.cc:269] 0709 12:58:32.447581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.117492 (+1669911us) service_pool.cc:211] Skipping call since client already timed out
0709 12:58:34.117700 (+   208us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:58:34.150115  4205 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.230197  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1868) took 1293 ms. Trace:
I20260709 12:58:34.329907  1608 rpcz_store.cc:276] 0709 12:58:32.937274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.225070 (+1287796us) service_pool.cc:224] Handling call
0709 12:58:34.225388 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.229832 (+  4444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.229864 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:34.229915 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:34.229967 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.230030 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.230142 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:34.231552  4062 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:34.328079  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 157928us
I20260709 12:58:34.228451  1609 rpcz_store.cc:276] 0709 12:58:31.885027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.201500 (+316473us) service_pool.cc:224] Handling call
0709 12:58:32.217102 (+ 15602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:32.230197 (+ 13095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.230239 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:32.271290 (+ 41051us) log.cc:844] Serialized 26 byte log entry
0709 12:58:32.524016 (+252726us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:32.524059 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.140361 (+1616302us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b54000ecc54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:34.140419 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.140465 (+    46us) raft_consensus.cc:1685] finished
0709 12:58:34.140477 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.151176 (+ 10699us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40557,"raft.queue_time_us":11569,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10431,"spinlock_wait_cycles":2990464,"thread_start_us":190042,"threads_started":1,"wal-append.queue_time_us":311151,"wal-append.run_cpu_time_us":1551,"wal-append.run_wall_time_us":1114004}
I20260709 12:58:34.153438  4235 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:34.250960  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:34.340113  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 89251.8us
I20260709 12:58:34.089238  4230 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.341895  4230 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:34.342753  3834 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:34.237449  4245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.002s	sys 0.012s
I20260709 12:58:34.280807  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1817) took 1274 ms. Trace:
I20260709 12:58:34.281533  1607 rpcz_store.cc:276] 0709 12:58:32.933906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.172891 (+1238985us) service_pool.cc:224] Handling call
0709 12:58:34.173192 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.173366 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.173395 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:34.173436 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:34.173473 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.173522 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.188369 (+ 14847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:34.219919  4153 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:34.208323  2428 rpcz_store.cc:276] 0709 12:58:32.605864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.735645 (+129781us) service_pool.cc:224] Handling call
0709 12:58:34.110761 (+1375116us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54005f46d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1992853 00007f25d696060a 00007f25cfee67d4 00007f25cfee6762 00007f25cfee6691 00007f25cfee660c 00007f25cfee58c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:34.110946 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712578304}
I20260709 12:58:34.253505  4200 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:34.281458  2423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.011s	sys 0.039s
I20260709 12:58:34.232141  4234 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.282359  4193 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:34.278439  4052 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:34.298089  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 65470.6us
I20260709 12:58:34.240777  4331 consensus_queue.cc:1059] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:58:34.284817  4174 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:34.314216  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 1.12076e+06us
I20260709 12:58:34.249596  4233 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:34.321333  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 172307us
I20260709 12:58:34.291142  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 674) took 1189 ms. Trace:
I20260709 12:58:34.233363  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:34.334455  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:34.295995  3776 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:34.253856  4148 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.297155  4232 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:34.297379  4254 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:34.282588  4176 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.293120  4167 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:34.943312  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.567s	user 0.019s	sys 0.138s
W20260709 12:58:34.978574  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.602s	user 0.023s	sys 0.138s
I20260709 12:58:34.979107  4343 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:34.955376  1497 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.006s	sys 0.007s
W20260709 12:58:34.979782  2476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 676) took 1870 ms (client timeout 2082 ms). Trace:
I20260709 12:58:34.979727  4343 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:34.980448  1497 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.007s	sys 0.007s
W20260709 12:58:34.980826  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 583609us
W20260709 12:58:34.980648  2476 rpcz_store.cc:269] 0709 12:58:33.109739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.334171 (+1224432us) service_pool.cc:224] Handling call
0709 12:58:34.979702 (+645531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:34.981770  4294 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.982308  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:34.982421  4294 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:34.984840  4343 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:34.977291  3617 consensus_meta.cc:287] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.846s	user 0.011s	sys 0.000s
I20260709 12:58:34.494766  4062 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.986218  3730 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.986588  4062 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:34.986712  3730 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.987174  4294 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:34.988358  2476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 675) took 1880 ms (client timeout 2127 ms). Trace:
I20260709 12:58:34.983402  4234 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:34.983717  2474 raft_consensus.cc:2410] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:34.988827  4062 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:34.350899  4205 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:34.990867  1606 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:34.991458  3730 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:34.992573  4232 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:34.994339  4235 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:34.994508  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1950) took 2324 ms. Trace:
W20260709 12:58:34.863966  4326 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.668s	user 0.004s	sys 0.000s
I20260709 12:58:34.995379  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1960) took 2291 ms. Trace:
W20260709 12:58:34.628661  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.995175  1606 rpcz_store.cc:276] 0709 12:58:32.670021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.200890 (+1530869us) service_pool.cc:224] Handling call
0709 12:58:34.201174 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.991244 (+790070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.994173 (+  2929us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54002a9ed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:34.994428 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815311616}
I20260709 12:58:34.995877  1603 rpcz_store.cc:276] 0709 12:58:32.704017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.255041 (+551024us) service_pool.cc:224] Handling call
0709 12:58:33.264691 (+  9650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:33.266200 (+  1509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:33.266233 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:33.266690 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:58:34.245893 (+979203us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:34.245940 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.246013 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.995172 (+749159us) raft_consensus.cc:1685] finished
0709 12:58:34.995194 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.995324 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":950,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":264678,"threads_started":1,"wal-append.queue_time_us":463711}
W20260709 12:58:34.997067  2474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 599) took 2605 ms (client timeout 3026 ms). Trace:
I20260709 12:58:34.984354  4200 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:35.078096  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 99088.3us
W20260709 12:58:34.988835  2476 rpcz_store.cc:269] 0709 12:58:33.107582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.981985 (+1874403us) service_pool.cc:224] Handling call
0709 12:58:34.988283 (+  6298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.000479  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:34.997288  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:34.345516  1534 rpcz_store.cc:276] 0709 12:58:33.006079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.007435 (+  1356us) service_pool.cc:224] Handling call
0709 12:58:33.023705 (+ 16270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:33.023904 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:33.045398 (+ 21494us) log.cc:844] Serialized 14 byte log entry
0709 12:58:34.280451 (+1235053us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:34.280505 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:34.280560 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.280625 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.280750 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":813311,"prepare.queue_time_us":21848,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":857487,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1838,"spinlock_wait_cycles":28539136,"thread_start_us":421153,"threads_started":2,"wal-append.queue_time_us":1151115}
W20260709 12:58:35.159513  2474 rpcz_store.cc:269] 0709 12:58:32.391671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.569794 (+178123us) service_pool.cc:224] Handling call
0709 12:58:34.118857 (+1549063us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:34.996754 (+877897us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540067a2d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:34.996958 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787703296}
I20260709 12:58:34.320245  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 671) took 1903 ms. Trace:
W20260709 12:58:34.804183  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.126812  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.011s
I20260709 12:58:35.162918  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:34.929975  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:35.011298  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.004s	sys 0.018s
W20260709 12:58:34.453383  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 112166us
I20260709 12:58:34.403856  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:34.357942  4264 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.501727  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1859) took 4466 ms. Trace:
I20260709 12:58:35.208360  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:34.455319  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 144196us
I20260709 12:58:35.202150  1608 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:35.158353  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.001s	sys 0.009s
W20260709 12:58:34.981770  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4157603279999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 12:58:35.163156  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 183735us
I20260709 12:58:35.202865  2474 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:58:35.216812  1497 connection.cc:256] RPC call timeout handler was delayed by -1.3150251360000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 12:58:34.320734  4278 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:34.774923  4309 consensus_meta.cc:287] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.553s	user 0.007s	sys 0.005s
I20260709 12:58:35.173641  2475 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
W20260709 12:58:35.203418  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1962) took 2479 ms (client timeout 3128 ms). Trace:
W20260709 12:58:35.002627  4192 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.011s	sys 0.014s
W20260709 12:58:35.202090  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.009s	sys 0.019s
W20260709 12:58:35.228698  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.930774  2455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.012s
W20260709 12:58:35.224166  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63106.3us
I20260709 12:58:35.216185  1606 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
W20260709 12:58:35.216398  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.003s	sys 0.010s
I20260709 12:58:35.216595  1498 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:35.180508  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:35.211638  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 50189.1us
I20260709 12:58:35.213943  1675 rpcz_store.cc:276] 0709 12:58:30.035352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.524372 (+489020us) service_pool.cc:224] Handling call
0709 12:58:33.504406 (+2980034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.143425 (+639019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.501456 (+358031us) spinlock_profiling.cc:243] Waited 2.98 s on lock 0x7b54000fa350. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:34.501656 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6852711296}
W20260709 12:58:34.414992  4325 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:58:35.219653  2461 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:35.235430  1682 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:35.165061  1607 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:34.399783  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 61517.9us
I20260709 12:58:35.002924  4153 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:35.222957  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.224004  2339 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:35.218219  1497 connection.cc:256] RPC call timeout handler was delayed by -1.1664603280000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 12:58:35.215603  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 84435.2us
W20260709 12:58:35.222196  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.002s	sys 0.011s
I20260709 12:58:34.724053  4246 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:35.269083  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:35.226573  1600 rpcz_store.cc:269] 0709 12:58:32.725417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.929609 (+2204192us) service_pool.cc:224] Handling call
0709 12:58:35.203352 (+273743us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:35.232038  4192 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.019s	sys 0.017s
W20260709 12:58:35.009037  4298 consensus_meta.cc:287] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.839s	user 0.011s	sys 0.000s
I20260709 12:58:34.358129  3834 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:34.300143  4168 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.998956  4308 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:35.049947  4271 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.824s	user 0.013s	sys 0.002s
I20260709 12:58:34.414189  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:34.493801  4161 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:35.003921  4225 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:34.462147  3973 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:34.785116  4261 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:34.357946  4229 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:34.994951  4232 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:34.999640  4293 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:35.270336  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:34.725387  4245 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:35.269573  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:35.261754  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.127545  4349 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:34.739851  4219 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.229214  4344 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:35.239054  4340 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:58:35.306923  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:35.248908  4352 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:58:35.501668  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 243132us
I20260709 12:58:35.001886  4281 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:35.235530  2455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.012s	sys 0.021s
I20260709 12:58:35.276479  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.527163  1675 raft_consensus.cc:2410] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:35.218319  2421 rpcz_store.cc:276] 0709 12:58:32.415882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.910965 (+495083us) service_pool.cc:224] Handling call
0709 12:58:32.921960 (+ 10995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:32.922350 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.922395 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:32.922913 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.142668 (+219755us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:33.151621 (+  8953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.161702 (+ 10081us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.293546 (+1131844us) raft_consensus.cc:1685] finished
0709 12:58:34.293582 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.318878 (+ 25296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13326,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":127,"thread_start_us":203049,"threads_started":1,"wal-append.queue_time_us":313055}
I20260709 12:58:35.277902  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.530196  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.530616  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.530979  1675 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:35.531251  1681 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:35.532266  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.278836  4062 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.296257  1601 rpcz_store.cc:276] 0709 12:58:31.325195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.326755 (+  1560us) service_pool.cc:224] Handling call
0709 12:58:31.394316 (+ 67561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.402637 (+  8321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.402681 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.403184 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.504115 (+100931us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:31.504171 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.504264 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.099536 (+2595272us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:34.199965 (+100429us) raft_consensus.cc:1685] finished
0709 12:58:34.199992 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.200208 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":409,"raft.queue_time_us":194323,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":60039,"spinlock_wait_cycles":8943872,"thread_start_us":100485,"threads_started":1,"wal-append.queue_time_us":514176,"wal-append.run_cpu_time_us":13894,"wal-append.run_wall_time_us":3279973}
I20260709 12:58:34.349455  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 607) took 1376 ms. Trace:
I20260709 12:58:34.483810  4345 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:35.283180  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:35.539001  1532 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:34.412845  4156 consensus_queue.cc:1059] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.819s
I20260709 12:58:34.716064  4342 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:35.287703  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.551064  1679 raft_consensus.cc:2393] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:35.287722  1608 raft_consensus.cc:2410] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:35.526574  3617 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:35.223763  4294 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:35.011454  4343 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.242s
I20260709 12:58:35.173657  4174 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:34.420658  4336 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.895s
I20260709 12:58:35.209213  4356 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 12:58:35.211005  4200 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.035540  4052 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:35.223708  4264 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.035650  3776 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.532121  4261 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:35.506585  4353 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:35.294661  1600 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:35.523801  3973 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.327907  4309 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.236780  4346 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:58:35.328862  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:35.508276  1677 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:35.732753  1527 raft_consensus.cc:2376] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8. Re-sending same reply.
I20260709 12:58:35.733930  1677 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:35.508643  1534 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
W20260709 12:58:35.736554  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.509286  1528 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:35.305604  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:35.738372  1529 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:35.311335  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 678) took 2191 ms. Trace:
W20260709 12:58:35.442338  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 224004us
I20260709 12:58:35.739636  2476 rpcz_store.cc:276] 0709 12:58:33.119909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.180070 (+2060161us) service_pool.cc:224] Handling call
0709 12:58:35.311242 (+131172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.354969  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:35.740757  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:35.401798  2475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 680) took 2269 ms (client timeout 1966 ms). Trace:
I20260709 12:58:35.741161  1680 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:35.517673  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:35.518430  1609 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
W20260709 12:58:35.519418  1649 connection.cc:256] RPC call timeout handler was delayed by -2.2013213879999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:58:35.881367  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 1876) took 1550 ms (client timeout 1652 ms). Trace:
I20260709 12:58:35.341252  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:35.512036  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1957) took 2815 ms. Trace:
I20260709 12:58:35.882750  1602 rpcz_store.cc:276] 0709 12:58:32.696543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.029970 (+333427us) service_pool.cc:224] Handling call
0709 12:58:33.030959 (+   989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:33.031348 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:33.031380 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:33.031843 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.155368 (+123525us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:33.155408 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.155467 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:35.511804 (+2356337us) raft_consensus.cc:1685] finished
0709 12:58:35.511826 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.511973 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2875,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":83534,"threads_started":1,"wal-append.queue_time_us":1166490}
I20260709 12:58:35.885066  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 428) took 1555 ms. Trace:
W20260709 12:58:35.507341  4341 log.cc:927] Time spent T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 12:58:35.403852  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.524427  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 427) took 2305 ms. Trace:
I20260709 12:58:35.893150  1607 rpcz_store.cc:276] 0709 12:58:33.218714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.285274 (+2066560us) service_pool.cc:224] Handling call
0709 12:58:35.523894 (+238620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.524089 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.524115 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.524167 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:35.524213 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.524276 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.524372 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.895570  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 429) took 1565 ms. Trace:
I20260709 12:58:35.896009  1607 rpcz_store.cc:276] 0709 12:58:34.330101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.894446 (+1564345us) service_pool.cc:224] Handling call
0709 12:58:35.894880 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.895115 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.895152 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.895212 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:35.895267 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.895353 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.895499 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:35.479884  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 263344us
W20260709 12:58:35.525229  2344 connection.cc:256] RPC call timeout handler was delayed by -1.1714026829999398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 12:58:35.532999  1681 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:34.978232  2451 rpcz_store.cc:276] 0709 12:58:33.098900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.246398 (+147498us) service_pool.cc:224] Handling call
0709 12:58:34.288102 (+1041704us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:35.442344  4223 consensus_meta.cc:287] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.112s	user 0.011s	sys 0.002s
I20260709 12:58:35.534435  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:35.535054  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 311116us
I20260709 12:58:35.498076  4338 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.279984  4280 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.310654  4153 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.299481  2423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 609) took 2250 ms. Trace:
I20260709 12:58:35.507784  4219 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:35.551961  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 1874) took 1221 ms (client timeout 1524 ms). Trace:
W20260709 12:58:35.948446  1608 rpcz_store.cc:269] 0709 12:58:34.330874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.330952 (+    78us) service_pool.cc:224] Handling call
0709 12:58:35.551863 (+1220911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.294039  1676 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:58:35.517900  4229 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:35.400993  4193 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 12:58:35.526976  4344 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.593080  1679 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:58:35.554629  2461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 677) took 2439 ms (client timeout 1913 ms). Trace:
W20260709 12:58:35.958326  2461 rpcz_store.cc:269] 0709 12:58:33.115077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.168198 (+1053121us) service_pool.cc:224] Handling call
0709 12:58:35.554357 (+1386159us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54005f46d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:35.554525 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2416175360}
I20260709 12:58:35.959774  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:35.505501  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:35.961051  1683 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:35.688067  2474 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:58:35.962630  2474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 612) took 1663 ms (client timeout 1968 ms). Trace:
W20260709 12:58:35.963099  2474 rpcz_store.cc:269] 0709 12:58:34.299313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.162636 (+863323us) service_pool.cc:224] Handling call
0709 12:58:35.962555 (+799919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.964290  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:35.689267  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:35.552886  1606 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:35.528425  4298 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5.
I20260709 12:58:35.695276  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1871) took 2412 ms. Trace:
I20260709 12:58:35.966521  1600 rpcz_store.cc:276] 0709 12:58:33.283198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.293818 (+2010620us) service_pool.cc:224] Handling call
0709 12:58:35.294428 (+   610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:35.694958 (+400530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.695208 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.506707  4245 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:35.724650  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.728138  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.666823  4308 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:35.793711  1575 connection.cc:256] RPC call timeout handler was delayed by -1.1121857240000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:58:35.578050  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 618) took 3550 ms. Trace:
I20260709 12:58:35.538380  4211 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.202s
I20260709 12:58:35.691301  4254 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:35.523456  4349 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.540059  4062 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:35.538498  2435 rpcz_store.cc:276] 0709 12:58:32.955713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.044577 (+ 88864us) service_pool.cc:224] Handling call
0709 12:58:33.362174 (+317597us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:34.331842 (+969668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3149184}
I20260709 12:58:35.885519  4225 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.958091  4229 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:36.001089  1675 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:35.970382  4167 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:35.527370  4271 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.570257  4148 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:35.695977  4355 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.529426  4161 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.879766  1680 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:35.847784  4261 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:35.881547  1649 connection.cc:256] RPC call timeout handler was delayed by -2.0685115899999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:58:36.014110  1649 connection.cc:256] RPC call timeout handler was delayed by -2.0267213879999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:58:36.015738  1649 connection.cc:256] RPC call timeout handler was delayed by -1.9551911479999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 12:58:36.016311  1649 connection.cc:256] RPC call timeout handler was delayed by -1.6739213879999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2602s for a response
W20260709 12:58:36.016710  1649 connection.cc:256] RPC call timeout handler was delayed by -1.6325213879999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26480000000000004s for a response
I20260709 12:58:35.520299  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.017616  1678 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:35.742412  3776 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:35.737555  4052 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:35.718750  4357 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.197s
I20260709 12:58:35.893199  4233 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:35.736835  4309 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:35.902930  2344 connection.cc:256] RPC call timeout handler was delayed by -1.1201026829999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 12:58:35.905172  4230 consensus_meta.cc:287] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.550s	user 0.019s	sys 0.006s
I20260709 12:58:35.976886  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:35.794083  4294 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.664642  4342 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.582417  4345 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:35.741396  2475 rpcz_store.cc:269] 0709 12:58:33.132586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.205511 (+1072925us) service_pool.cc:224] Handling call
0709 12:58:35.401549 (+1196038us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54005d0a54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:35.401708 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223902976}
I20260709 12:58:35.980073  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:35.935714  4223 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.569242  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:35.943853  4280 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:35.947851  4153 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:35.992563  3617 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:35.945977  4338 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:35.995814  4375 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:58:35.981451  4308 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.029836  4364 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:35.997191  4225 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:36.039628  4205 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.058797  4176 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:36.075228  4360 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.507s	user 0.004s	sys 0.004s
I20260709 12:58:36.067355  4261 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:36.071583  4374 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:58:36.072398  4219 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.047595  4230 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.064733  4364 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:36.073496  4223 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.074020  4271 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.075066  4345 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.030494  4355 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.065521  4375 consensus_queue.cc:1243] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer 3cabc5110903443ba3beb5cbb14afa91 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:36.067625  4264 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.072772  4342 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:36.087270  4364 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.101977  4355 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.102516  4338 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.103412  4344 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.104568  4349 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:35.807526  1526 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:35.574061  1525 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:36.139717  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 237303us
I20260709 12:58:36.140530  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.144703  1525 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:36.147643  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:35.872597  1528 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:36.150743  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1816) took 3174 ms. Trace:
I20260709 12:58:36.151463  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.152690  1528 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:36.151365  1533 rpcz_store.cc:276] 0709 12:58:32.976624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.976833 (+   209us) service_pool.cc:224] Handling call
0709 12:58:32.977257 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:32.990049 (+ 12792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.990078 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:32.990501 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.376005 (+385504us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18004829e0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d15380d1 00007f25d1953a0f
0709 12:58:34.979059 (+1603054us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:34.979099 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.979166 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:36.149912 (+1170746us) raft_consensus.cc:1685] finished
0709 12:58:36.149968 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.150501 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17158,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4791,"spinlock_wait_cycles":5095680,"thread_start_us":1602845,"threads_started":1,"wal-append.queue_time_us":2059693}
I20260709 12:58:35.793340  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.154474  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:35.869549  1531 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:35.876353  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.157922  1534 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:35.806349  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:36.159503  1527 raft_consensus.cc:2376] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8. Re-sending same reply.
I20260709 12:58:36.163942  1525 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:35.970803  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.189625  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.063220  4174 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:36.190415  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.190816  1575 connection.cc:256] RPC call timeout handler was delayed by -1.0009400060000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 12:58:36.190928  4174 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:35.927474  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1870) took 2988 ms. Trace:
I20260709 12:58:36.193257  3617 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.077616  3973 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.194022  1603 rpcz_store.cc:276] 0709 12:58:32.939103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.204133 (+2265030us) service_pool.cc:224] Handling call
0709 12:58:35.218676 (+ 14543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.234164 (+ 15488us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:35.281841 (+ 47677us) log.cc:844] Serialized 14 byte log entry
0709 12:58:35.580532 (+298691us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b1800471b20. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d153823a 00007f25d19a2a2a
0709 12:58:35.927110 (+346578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.927167 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:35.927214 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.927279 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.927416 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49915,"prepare.queue_time_us":45552,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":29570,"raft.queue_time_us":36480,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":7408,"spinlock_wait_cycles":24989440,"thread_start_us":310401,"threads_started":1,"wal-append.queue_time_us":710190}
I20260709 12:58:35.901149  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1872) took 1570 ms. Trace:
I20260709 12:58:36.198000  4167 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:36.197966  1607 rpcz_store.cc:276] 0709 12:58:34.330372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.897162 (+1566790us) service_pool.cc:224] Handling call
0709 12:58:35.897541 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.900690 (+  3149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.900729 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.900785 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:35.900828 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.900907 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.901075 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.199173  4167 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:35.886574  1609 rpcz_store.cc:269] 0709 12:58:34.331442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.413857 (+ 82415us) service_pool.cc:224] Handling call
0709 12:58:35.881291 (+1467434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.200958  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.166286  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:36.166286  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.202874  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.203188  4062 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:36.203336  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:36.203913  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:36.168043  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 230794us
W20260709 12:58:36.033149  2344 connection.cc:256] RPC call timeout handler was delayed by -1.0754679099999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 12:58:36.205520  1608 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:36.208014  4161 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:35.885424  1602 rpcz_store.cc:276] 0709 12:58:34.329791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.884197 (+1554406us) service_pool.cc:224] Handling call
0709 12:58:35.884499 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.884701 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.884734 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.884782 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:35.884838 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.884904 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.885016 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.209131  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.209184  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:35.944147  2423 rpcz_store.cc:276] 0709 12:58:33.048711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.092558 (+ 43847us) service_pool.cc:224] Handling call
0709 12:58:33.092865 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:33.093100 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:33.093498 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 12:58:34.097648 (+1004150us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b18003e24e0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:58:35.196786 (+1099138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.220931 (+ 24145us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:35.225214 (+  4283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.237544 (+ 12330us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.284758 (+ 47214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":420,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":35753,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":12774272,"thread_start_us":1981113,"threads_started":2,"wal-append.queue_time_us":942671,"wal-append.run_cpu_time_us":1209,"wal-append.run_wall_time_us":1001216}
I20260709 12:58:36.174458  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:36.021963  2435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:36.211514  1676 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:36.212139  2435 raft_consensus.cc:606] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:36.212700  2435 raft_consensus.cc:614] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:36.212853  2423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 614) took 1872 ms. Trace:
I20260709 12:58:35.974440  2455 rpcz_store.cc:276] 0709 12:58:32.027698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.199638 (+2171940us) service_pool.cc:224] Handling call
0709 12:58:34.200000 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.335722 (+135722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.335760 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:34.336496 (+   736us) log.cc:844] Serialized 26 byte log entry
0709 12:58:35.535938 (+1199442us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:35.538317 (+  2379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.577624 (+ 39307us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:35.577720 (+    96us) raft_consensus.cc:1685] finished
0709 12:58:35.577744 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.577966 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38078,"raft.queue_time_us":130059,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":29225,"thread_start_us":1324767,"threads_started":2,"wal-append.queue_time_us":655843}
I20260709 12:58:36.210283  1608 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:36.176065  2476 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:36.176064  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:36.206297  2344 connection.cc:256] RPC call timeout handler was delayed by -1.0499026829999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 12:58:36.215286  1678 raft_consensus.cc:2376] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7. Re-sending same reply.
I20260709 12:58:36.215405  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 615) took 1873 ms. Trace:
I20260709 12:58:36.177583  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.049981  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 679) took 2923 ms. Trace:
I20260709 12:58:36.216439  1679 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:36.172053  2421 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:36.003630  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.050494  2475 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:58:36.268389  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 611) took 3134 ms. Trace:
I20260709 12:58:36.268819  2475 rpcz_store.cc:276] 0709 12:58:33.134104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.049859 (+2915755us) service_pool.cc:224] Handling call
0709 12:58:36.050198 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.267701 (+217503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.268183 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.181502  1601 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.269698  4223 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.270288  1534 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:36.270558  4223 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.272089  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.182400  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.199637  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.273710  1680 raft_consensus.cc:2393] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:36.204198  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.169512  4387 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:36.207542  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.202884  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.216991  2474 rpcz_store.cc:276] 0709 12:58:33.126318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.049087 (+2922769us) service_pool.cc:224] Handling call
0709 12:58:36.049440 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.049655 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.049682 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.049727 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:36.049763 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.049815 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.049924 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.197372  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.179102  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:36.170372  1604 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:58:36.177892  1682 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:36.058141  4278 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.220826  4161 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:36.206213  4153 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.203933  4062 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.224125  4167 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.215955  2435 rpcz_store.cc:276] 0709 12:58:34.342074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.213951 (+1871877us) service_pool.cc:224] Handling call
0709 12:58:36.214512 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.214962 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.215001 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.215074 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:36.215132 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.215212 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.215341 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.088407  4294 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.237232  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:36.240080  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 898755us
W20260709 12:58:36.284413  2344 leader_election.cc:336] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.563s (SENT)
I20260709 12:58:36.292788  4161 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.293185  2344 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:36.293998  4230 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.203990  1528 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:36.295163  4230 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:36.296401  4161 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.080648  4200 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:36.290172  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.297446  4062 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:36.298097  4200 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:36.298921  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.876s (SENT) [suppressed 32 similar messages]
I20260709 12:58:36.283799  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.300271  4062 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:36.213456  1676 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:36.263942  3834 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:58:36.278820  1600 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:36.301205  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.298897  4200 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.302845  4153 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:36.303046  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.303802  4153 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.280177  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.213361  2423 rpcz_store.cc:276] 0709 12:58:34.340573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.211289 (+1870716us) service_pool.cc:224] Handling call
0709 12:58:36.211768 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.212309 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.212350 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.212425 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:36.212501 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.212559 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.212683 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.304546  4200 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:36.306702  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 69760.7us
I20260709 12:58:36.308178  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.279789  1533 raft_consensus.cc:2410] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:36.308360  4260 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:36.309212  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.309767  4260 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:36.310019  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.310959  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.292250  4245 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.311160  4260 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.311903  4168 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.313441  4156 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:36.301857  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.313925  4156 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:36.315387  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.315511  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:36.315235  4156 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.316676  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.311177  1680 raft_consensus.cc:2410] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:58:36.318742  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:36.318899  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.319638  1680 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:36.320164  1676 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:36.330490  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.330932  4385 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:36.328694  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:36.306680  4148 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:36.280329  1609 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:36.320501  4234 raft_consensus.cc:3055] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:36.305472  4363 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:36.323822  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.310077  1679 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:36.334033  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:36.321887  4223 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.336012  4308 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.336324  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.326297  4153 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.283573  1681 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:36.288738  1529 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:36.319088  4233 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:36.262880  4225 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:36.325155  2474 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:36.322892  4156 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:36.311913  1678 raft_consensus.cc:2410] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:58:36.309368  1603 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:36.282548  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 613) took 1950 ms. Trace:
I20260709 12:58:36.304931  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:36.240502  1526 raft_consensus.cc:2410] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:36.326887  4309 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:36.357008  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 72740us
I20260709 12:58:36.344156  4385 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:36.351414  4234 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:36.406467  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.407326  1609 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:36.407747  4234 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.408422  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.408939  4234 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:36.409829  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:36.410879  4281 consensus_meta.cc:287] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.884s	user 0.014s	sys 0.010s
I20260709 12:58:36.368304  4355 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:36.363417  4233 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:36.414582  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:36.382781  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 94184.7us
I20260709 12:58:36.367803  2475 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:36.392638  1681 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
W20260709 12:58:36.394096  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.000s	sys 0.008s
I20260709 12:58:36.394986  2435 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:36.384938  2421 rpcz_store.cc:276] 0709 12:58:34.332545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.170484 (+1837939us) service_pool.cc:224] Handling call
0709 12:58:36.171366 (+   882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.251853 (+ 80487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.282446 (+ 30593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.399230  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 425) took 3340 ms. Trace:
I20260709 12:58:36.401803  1682 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:36.405121  1607 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:36.405783  4383 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:36.405988  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 90871.8us
W20260709 12:58:36.420678  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.000s	sys 0.010s
I20260709 12:58:36.417399  1528 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:36.417382  1606 rpcz_store.cc:276] 0709 12:58:33.059130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.230662 (+2171532us) service_pool.cc:224] Handling call
0709 12:58:35.552634 (+321972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.966159 (+413525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.398527 (+432368us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400268ed0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:36.398901 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739576064}
I20260709 12:58:36.429353  4211 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.430032  4385 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.431797  4385 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:36.433724  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 53187.2us
I20260709 12:58:36.434249  4366 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.434888  4366 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:36.436793  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 132077us
I20260709 12:58:36.437377  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 682) took 1079 ms. Trace:
I20260709 12:58:36.437954  2461 rpcz_store.cc:276] 0709 12:58:35.358005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.975741 (+617736us) service_pool.cc:224] Handling call
0709 12:58:36.436968 (+461227us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400542254. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:36.437169 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479350144}
I20260709 12:58:36.438441  4148 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:36.439203  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.439611  1608 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:58:36.440065  1608 pending_rounds.cc:85] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 10
I20260709 12:58:36.440387  1608 pending_rounds.cc:107] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:58:36.440320  4387 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:36.440701  4148 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:36.440865  1608 raft_consensus.cc:2889] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:36.442185  4382 consensus_queue.cc:1059] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:36.443238  4387 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:36.444288  4387 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:36.445375  4233 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.446118  2421 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:58:36.446887  4233 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:36.446694  4387 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.448287  4387 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:36.430047  4211 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.452279  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:36.433446  2344 leader_election.cc:336] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.574s (SENT)
I20260709 12:58:36.420137  4383 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:36.486706  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 53331.8us
I20260709 12:58:36.483867  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 543) took 1215 ms. Trace:
W20260709 12:58:36.516865  1575 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.832s (SENT)
I20260709 12:58:36.482573  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 1891) took 1183 ms. Trace:
I20260709 12:58:36.427342  4363 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:36.526682  1675 rpcz_store.cc:276] 0709 12:58:35.298462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.534205 (+235743us) service_pool.cc:224] Handling call
0709 12:58:36.482116 (+947911us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b540015e354. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:36.482310 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148812160}
I20260709 12:58:36.487648  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:36.525223  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.455132  4355 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:36.524004  1677 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.000s	sys 0.014s
I20260709 12:58:36.522950  1526 rpcz_store.cc:276] 0709 12:58:35.268579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.268736 (+   157us) service_pool.cc:224] Handling call
0709 12:58:36.483533 (+1214797us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b5400198f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:36.483763 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211174656}
I20260709 12:58:36.486677  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:36.479166  4384 log.cc:927] Time spent T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
W20260709 12:58:36.534229  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 77540.1us
I20260709 12:58:36.537150  1680 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
W20260709 12:58:36.466555  4393 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 12:58:36.516040  4365 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:36.528681  4383 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:36.466318  4174 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:36.542327  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 83727.8us
W20260709 12:58:36.542469  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.546515  1677 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.000s	sys 0.015s
I20260709 12:58:36.516353  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:36.535784  4377 log.cc:927] Time spent T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.405s	user 0.002s	sys 0.000s
I20260709 12:58:36.523957  4352 raft_consensus.cc:3055] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.561071  4352 raft_consensus.cc:740] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:36.554345  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:36.565802  1498 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:36.564755  4225 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:36.569787  4294 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:36.570480  4294 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.570892  4294 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.468679  4148 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.583515  4280 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.477725  4229 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.584913  4174 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.552296  4365 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:36.551712  4363 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:36.596541  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1893) took 1297 ms. Trace:
I20260709 12:58:36.597937  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 422) took 3663 ms. Trace:
I20260709 12:58:36.598093  1498 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:36.598428  1605 rpcz_store.cc:276] 0709 12:58:32.935576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.175597 (+1240021us) service_pool.cc:224] Handling call
0709 12:58:34.216684 (+ 41087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:35.532639 (+1315955us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:35.532687 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:35.686728 (+154041us) log.cc:844] Serialized 26 byte log entry
0709 12:58:35.949749 (+263021us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:35.949815 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.999113 (+ 49298us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001559d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:35.999181 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:36.476547 (+477366us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:36.597402 (+120855us) raft_consensus.cc:1685] finished
0709 12:58:36.597429 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.597702 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57505,"raft.queue_time_us":271807,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":15322,"spinlock_wait_cycles":2717704448,"thread_start_us":399697,"threads_started":2,"wal-append.queue_time_us":328835}
I20260709 12:58:36.601364  4344 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:36.601868  4344 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.602334  4344 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:36.603338  4365 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:36.604163  4174 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.604841  4174 raft_consensus.cc:2764] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:58:36.605969  4363 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.611477  1530 raft_consensus.cc:2410] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:36.611610  1683 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:36.612759  4229 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.613255  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 610) took 3521 ms. Trace:
W20260709 12:58:36.614346  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.621104  4230 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:36.621757  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1869) took 3684 ms. Trace:
I20260709 12:58:36.622396  1604 rpcz_store.cc:276] 0709 12:58:32.937541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.248358 (+1310817us) service_pool.cc:224] Handling call
0709 12:58:34.281986 (+ 33628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.281878 (+1999892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.621302 (+339424us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54002ab2d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:36.621664 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4341107968}
I20260709 12:58:36.625694  4356 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:36.626139  4366 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.626449  4356 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:36.627643  2476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 616) took 1385 ms (client timeout 1730 ms). Trace:
W20260709 12:58:36.628238  2476 rpcz_store.cc:269] 0709 12:58:35.242194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.740483 (+498289us) service_pool.cc:224] Handling call
0709 12:58:36.627345 (+886862us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54006a63d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:36.627561 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998909184}
W20260709 12:58:36.630448  4364 consensus_meta.cc:287] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.004s
W20260709 12:58:36.630739  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 83995.1us
I20260709 12:58:36.630965  4364 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:36.632174  1649 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.597147  1677 rpcz_store.cc:276] 0709 12:58:35.299129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.735013 (+435884us) service_pool.cc:224] Handling call
0709 12:58:35.735349 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.735603 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:36.561713 (+826110us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.595925 (+ 34212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.596028 (+   103us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:36.596118 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.596234 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.596438 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":309422,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":220,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"thread_start_us":778702,"threads_started":2}
W20260709 12:58:36.637046  2344 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.631s (SENT)
W20260709 12:58:36.636338  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 118997us
I20260709 12:58:36.604844  4365 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:36.642660  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.643814  2344 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.648717  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:36.649775  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:36.650467  4371 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.908s	user 0.002s	sys 0.012s
I20260709 12:58:36.636802  4356 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:36.648798  1530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 551) took 1365 ms (client timeout 1563 ms). Trace:
I20260709 12:58:36.650403  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.613893  2428 rpcz_store.cc:276] 0709 12:58:33.091602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.207965 (+2116363us) service_pool.cc:224] Handling call
0709 12:58:35.208337 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.175583 (+967246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.175658 (+    75us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.175718 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:36.175785 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.612734 (+436949us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400441bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:36.612801 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.613018 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222962944}
I20260709 12:58:36.642215  4364 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:36.652307  1530 rpcz_store.cc:269] 0709 12:58:35.283818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.527514 (+243696us) service_pool.cc:224] Handling call
0709 12:58:36.486253 (+958739us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:58:36.648534 (+162281us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b5400198a54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:36.648720 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172732672}
I20260709 12:58:36.669673  1528 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
W20260709 12:58:36.669947  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 210674us
I20260709 12:58:36.669019  4344 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:36.670570  1526 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:36.671993  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 552) took 1387 ms (client timeout 1604 ms). Trace:
I20260709 12:58:36.672596  4344 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:36.672746  4390 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:36.670637  1575 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.876s (SENT)
I20260709 12:58:36.659075  4356 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:36.681665  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:36.683182  1575 leader_election.cc:336] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.040s (SENT)
I20260709 12:58:36.683674  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:36.684530  4280 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:36.685276  4280 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:58:36.688179  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.689757  4211 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.636559  4148 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:36.694207  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 100414us
W20260709 12:58:36.694703  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.698089  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:36.703008  1649 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:36.703859  2344 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.020s (SENT)
I20260709 12:58:36.704130  4229 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:36.704667  4229 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:36.705129  4229 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:36.638914  4352 consensus_queue.cc:260] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:36.705873  4352 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.705974  4148 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:36.672394  1532 rpcz_store.cc:269] 0709 12:58:35.284098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.539918 (+255820us) service_pool.cc:224] Handling call
0709 12:58:36.671629 (+1131711us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54002d9bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:36.671791 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433888512}
I20260709 12:58:36.710896  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.712383  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:36.712636  2344 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.017s (SENT)
I20260709 12:58:36.713205  2475 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:36.713101  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.713413  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.714135  2428 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:36.714576  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.699342  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:36.700672  4386 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.038s
I20260709 12:58:36.722508  4383 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.729971  4225 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.733366  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:36.719820  4386 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.008s	sys 0.039s
I20260709 12:58:36.711786  4390 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:36.737385  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.738119  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.740253  1575 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.229s (SENT)
W20260709 12:58:36.741937  1575 leader_election.cc:336] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.524s (SENT)
I20260709 12:58:36.742312  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:36.726092  4383 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:36.750115  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.754362  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.769465  1600 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
W20260709 12:58:36.754828  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.755432  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:36.761711  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.773379  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.773638  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.774420  2428 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:36.775245  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.775542  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.776278  2461 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:36.773211  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.762339  2435 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:36.762991  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.779356  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:36.762705  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 63551.8us
I20260709 12:58:36.763360  4390 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:36.764319  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:36.770725  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:36.771226  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.777410  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.775900  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.761831  4211 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:36.763666  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:36.794886  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.794824  1526 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:36.795913  2451 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:36.796042  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.731490  4225 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:36.775569  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1882) took 1490 ms. Trace:
I20260709 12:58:36.798012  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.794178  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.777196  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.768463  4356 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:36.800786  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 54050.2us
W20260709 12:58:36.834314  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 125717us
W20260709 12:58:36.811172  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.835009  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.814564  1498 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:36.819212  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 684) took 1419 ms. Trace:
I20260709 12:58:36.835875  2455 rpcz_store.cc:276] 0709 12:58:35.399568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.214029 (+814461us) service_pool.cc:224] Handling call
0709 12:58:36.635848 (+421819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.649875 (+ 14027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.649911 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.649996 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:36.650040 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.650101 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.818889 (+168788us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54006a63d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:36.819035 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964888832}
I20260709 12:58:36.820793  4363 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:36.823436  1528 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:36.807756  2461 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:36.773330  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:36.806650  4366 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:36.858256  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.859141  1532 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:36.860275  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.860399  4271 consensus_queue.cc:1059] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:36.850175  1531 raft_consensus.cc:2393] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:36.851094  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.851758  2476 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:36.838348  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.853211  2428 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:36.864681  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.863355  4280 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:36.866044  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:36.866382  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 93170.7us
I20260709 12:58:36.757393  4294 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.866961  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:36.867980  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.871189  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:36.874046  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.874437  4225 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:36.874908  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.862082  2455 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:58:36.875780  1530 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:36.876434  1605 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:36.807437  4390 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:36.862772  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.870405  1527 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:36.805895  4229 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:36.861943  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:36.882753  2344 leader_election.cc:336] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.101s (SENT)
I20260709 12:58:36.832551  1674 rpcz_store.cc:276] 0709 12:58:35.284782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.284946 (+   164us) service_pool.cc:224] Handling call
0709 12:58:35.285291 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.734201 (+448910us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:35.976907 (+242706us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.385853 (+408946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.424084 (+ 38231us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:36.429074 (+  4990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.478052 (+ 48978us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:36.774894 (+296842us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001b9254. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:36.774943 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.775222 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19006,"prepare.queue_time_us":276881,"prepare.run_cpu_time_us":832,"prepare.run_wall_time_us":6872,"raft.queue_time_us":99520,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":116,"spinlock_wait_cycles":1354401536,"thread_start_us":601960,"threads_started":3,"wal-append.queue_time_us":110365}
I20260709 12:58:36.878050  4383 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:36.896163  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:36.897868  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.903831  2461 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
W20260709 12:58:36.908836  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 70606.6us
I20260709 12:58:36.916174  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.916880  1528 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:36.912343  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.918378  1531 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:36.915038  4383 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.919344  4383 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:36.919425  2344 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:36.920758  4298 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:36.921005  2344 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.120s (SENT)
I20260709 12:58:36.921551  2344 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.924064  1680 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:36.924459  1529 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:36.924862  1600 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:36.929643  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:36.933508  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:36.912360  4390 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:36.939038  1682 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:36.939272  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:36.936779  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.942889  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:36.943449  1680 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:36.933529  4156 raft_consensus.cc:3055] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:36.945742  1534 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:36.942153  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:36.954304  1526 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:36.956887  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.957393  1525 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:36.947197  3617 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:36.924108  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60652
I20260709 12:58:36.949452  4156 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:36.973227  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 52306.2us
I20260709 12:58:36.968201  1602 raft_consensus.cc:606] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:58:36.960232  3973 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:36.981062  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.971036  2421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:36.976023  4387 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:36.991544  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:36.996217  1680 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:37.002394  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:36.966460  4148 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:58:37.005160  2455 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:37.010820  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:37.011686  2461 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:37.016474  1500 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:36.993958  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:37.024633  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.031922  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.032886  1678 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:37.032682  1674 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:37.050585  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:37.058480  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.066998  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:37.106385  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:37.107524  1500 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:37.111672  1605 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:37.109429  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:37.113706  1680 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
W20260709 12:58:37.116513  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 45620us
I20260709 12:58:37.119136  2455 raft_consensus.cc:2368] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:37.071305  4229 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:37.069350  4156 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:37.130182  4156 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.134006  1674 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:37.134955  2339 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:37.135839  2339 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:37.137020  4385 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:37.137398  4385 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.137784  4234 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:37.138247  4385 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:37.139585  4409 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:58:37.141191  4411 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:58:37.127358  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:37.145903  2428 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
W20260709 12:58:37.148116  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 167902us
I20260709 12:58:37.152535  1534 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:37.106483  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:37.157424  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 89662.2us
I20260709 12:58:37.161736  2474 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:37.160883  2339 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:37.172163  1525 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:37.158631  4363 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:37.177107  4408 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:58:37.176853  1500 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:37.179893  4385 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.183461  2451 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:37.187322  4261 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:37.187865  4261 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:37.188323  4261 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:37.188472  4364 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:37.188930  4364 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.189280  4364 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:37.193778  4344 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:37.187698  1500 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:37.200114  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:37.199230  1497 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.809s (SENT)
I20260709 12:58:37.209395  1497 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:37.197744  3973 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:37.211987  2344 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:37.219215  4148 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:37.225242  4343 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:37.225281  4356 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.225980  4343 raft_consensus.cc:697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:37.226132  4356 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:37.226774  4356 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.227140  4343 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.210181  3834 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:58:37.236953  4192 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:37.237666  4192 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.238171  4192 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:37.239465  4418 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:58:37.242233  1497 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.928s (SENT)
I20260709 12:58:37.243468  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:37.244566  4390 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:37.213788  4357 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:58:37.256721  3973 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.272557  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:37.273222  1677 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:37.279196  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.279590  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.261539  3834 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:37.283273  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 348326us
I20260709 12:58:37.283511  4385 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:37.285274  4352 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:37.294250  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 401768us
W20260709 12:58:37.302282  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 60085us
I20260709 12:58:37.288926  1677 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:37.294498  4372 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:37.258903  4383 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:37.295740  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.291455  3834 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:37.316012  2339 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:37.326802  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.332486  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.333449  1525 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:37.335753  1532 raft_consensus.cc:2393] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:37.337028  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:37.341977  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.341696  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.344369  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.345147  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.345697  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:37.291592  4364 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.347078  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.368419  1529 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:37.358086  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.365779  1572 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:37.359603  1528 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:37.362114  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.373375  1533 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:37.373883  2476 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:37.375932  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:37.376252  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.379138  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:37.379886  1528 raft_consensus.cc:2368] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
W20260709 12:58:37.379963  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 49109.7us
I20260709 12:58:37.383687  1676 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:58:37.385263  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.386209  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.386749  1534 raft_consensus.cc:2368] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:37.388227  1683 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:37.392984  1529 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:37.362290  4427 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:37.401018  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.402978  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.404009  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:37.380738  4234 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:37.385725  4365 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.415290  4230 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.416220  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.365317  4281 consensus_queue.cc:1059] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:58:37.366019  4352 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:58:37.419010  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.400323  4427 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.425982  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:37.426220  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50545.6us
I20260709 12:58:37.427366  1676 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:37.433609  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:37.353996  3834 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.419556  4365 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.447883  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.450903  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.451383  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:37.452561  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:37.453330  1533 raft_consensus.cc:2410] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:37.454649  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.455435  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:37.456100  1534 raft_consensus.cc:2376] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7. Re-sending same reply.
I20260709 12:58:37.454582  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.455368  1529 raft_consensus.cc:2376] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5. Re-sending same reply.
I20260709 12:58:37.462159  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.443040  4427 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:37.464501  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.465745  1528 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 2.
I20260709 12:58:37.457204  4365 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.473224  1679 raft_consensus.cc:2410] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:37.474082  1525 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:37.474435  1525 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:37.475350  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:37.476418  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:37.477056  1608 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:37.477864  4364 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:37.479045  4430 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:37.479389  2421 raft_consensus.cc:606] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:37.479489  4430 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:37.479836  2421 raft_consensus.cc:614] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:37.487617  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.487090  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.491883  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:37.486022  4390 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:37.495030  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:37.495827  1681 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.473482  3834 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:37.499794  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.502013  1676 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.496169  4383 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:37.460204  4230 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.516760  1683 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:37.485455  4430 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:37.524308  1681 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:37.516121  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.491147  4352 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:37.535804  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.515810  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60652
I20260709 12:58:37.538189  1609 raft_consensus.cc:606] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:58:37.539387  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.540576  1676 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:37.499101  4344 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 12:58:37.548962  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 104754us
I20260709 12:58:37.547282  2339 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:37.549998  1675 raft_consensus.cc:2393] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:37.553732  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 82867.3us
I20260709 12:58:37.556233  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:37.546195  1525 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:37.615152  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.615005  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.615743  1683 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:37.542137  4234 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:37.516597  4260 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:37.617425  1676 raft_consensus.cc:2376] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7. Re-sending same reply.
I20260709 12:58:37.622539  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.623149  1676 raft_consensus.cc:2410] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:37.625497  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:37.620179  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:37.558869  4424 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:58:37.630082  1679 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:37.631708  4356 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.633150  2475 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:37.558418  4438 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:37.502861  4192 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.641944  1683 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:37.500810  4432 consensus_queue.cc:1059] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 12:58:37.649907  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.650938  1675 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:37.658034  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.620867  4260 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:37.669734  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.672854  4230 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:37.680404  4356 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:37.680658  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:37.682888  4192 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:37.648973  4444 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:58:37.690533  4444 consensus_queue.cc:1243] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:37.692013  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:37.693921  4281 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:37.673095  4435 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:58:37.707650  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.712024  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.712867  1683 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:37.718413  1608 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:37.720729  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:37.721096  4260 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:37.721673  1604 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:37.722271  4260 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.722523  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:37.726161  4280 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:37.726678  4280 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:37.727077  4280 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:37.730396  4211 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:37.738839  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:37.744776  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 308439us
W20260709 12:58:37.759945  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.713924  4438 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:37.784044  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:37.733939  4366 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.789656  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:37.789525  4366 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:37.790442  1601 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:37.781243  4441 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:37.791810  4366 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:37.792349  4424 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:58:37.794049  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:37.795112  1608 raft_consensus.cc:2410] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:58:37.801642  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.811427  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.816299  1683 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:58:37.821269  4261 consensus_meta.cc:287] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 12:58:37.842728  4441 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:37.844424  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 229149us
I20260709 12:58:37.843897  4441 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.844345  4294 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:37.857769  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:37.901908  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.830681  4261 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:37.841696  4364 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:37.834002  4234 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:38.063758  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 317530us
W20260709 12:58:37.992280  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 496373us
W20260709 12:58:38.064749  4427 consensus_meta.cc:287] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.005s
I20260709 12:58:38.057647  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:38.083505  1527 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:37.861817  4419 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:58:37.992157  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:37.857460  4372 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:38.066753  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 157829us
I20260709 12:58:38.084883  4372 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:38.085152  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:38.085937  1682 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:37.963934  4192 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.086733  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1983) took 1365 ms. Trace:
I20260709 12:58:38.086831  4192 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.087193  1605 rpcz_store.cc:276] 0709 12:58:36.721000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.733301 (+ 12301us) service_pool.cc:224] Handling call
0709 12:58:38.086549 (+1353248us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b54004065d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:38.086657 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158864640}
I20260709 12:58:38.083115  4427 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.091435  4261 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:38.029389  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.935930  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.094092  4372 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:38.047565  1601 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:38.096675  4372 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:38.097478  4192 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:38.097393  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:38.084107  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:38.098219  1602 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:38.098552  1676 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:38.099519  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 689) took 1075 ms. Trace:
I20260709 12:58:38.099821  1676 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:38.099896  2475 rpcz_store.cc:276] 0709 12:58:37.023778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.023956 (+   178us) service_pool.cc:224] Handling call
0709 12:58:38.099333 (+1075377us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b540067a7d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:38.099439 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335686400}
I20260709 12:58:37.963662  4385 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.091648  4427 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:38.100979  4385 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.104040  2476 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:38.106341  4385 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:38.107340  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:38.107975  1605 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:38.108078  4434 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.605s	user 0.001s	sys 0.001s
I20260709 12:58:38.110217  1602 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
W20260709 12:58:37.903067  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 53969.7us
I20260709 12:58:38.111984  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:38.114370  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.114653  1498 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:38.115085  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.116796  1602 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:38.119055  1417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 193768us
I20260709 12:58:38.123721  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.123925  4364 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:38.124557  4364 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:38.124852  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:38.125931  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.126296  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:38.126809  1606 raft_consensus.cc:2393] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:38.126616  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:38.127437  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.127705  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:38.127854  3973 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:38.128365  1606 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:38.125960  4387 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 12:58:38.129027  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 46271.5us
I20260709 12:58:38.129243  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.130447  4387 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:38.128582  3973 raft_consensus.cc:697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:38.134845  4344 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.134970  3973 consensus_queue.cc:237] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:38.135479  4344 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.137485  2344 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:38.137979  4344 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:38.138497  4331 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:38.139384  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:38.123303  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:38.140555  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:38.125507  4364 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:38.176841  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:38.140888  1602 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:38.140764  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:38.128319  1607 raft_consensus.cc:2410] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:38.141162  4427 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:38.142670  2344 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:38.143302  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:38.143466  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:38.109974  4365 consensus_meta.cc:287] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
I20260709 12:58:38.191579  4365 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:38.192977  2423 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:38.195925  1525 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:38.200366  1606 raft_consensus.cc:2410] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:58:38.200758  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.202001  4452 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:38.202543  4452 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:38.202982  4452 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:38.205034  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:38.111868  4438 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.144604  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:38.152253  4430 consensus_meta.cc:287] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.004s
I20260709 12:58:38.146198  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:38.147922  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:38.161870  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:38.215425  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:38.216010  2474 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:38.216233  1679 raft_consensus.cc:2376] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6. Re-sending same reply.
I20260709 12:58:38.216526  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.217065  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:38.217324  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.144587  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:38.218389  1534 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:38.218918  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.177470  1676 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:38.184237  2461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:38.186122  2475 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:38.152765  2451 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:38.229640  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:38.190418  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 47835.9us
I20260709 12:58:38.210312  1605 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:38.214699  1682 raft_consensus.cc:2410] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:38.217132  1602 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:38.217798  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:38.149417  1498 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:38.220409  2461 raft_consensus.cc:606] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:38.215483  1533 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:38.227042  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 86558.9us
I20260709 12:58:38.221387  1500 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:38.279400  2461 raft_consensus.cc:614] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:38.279779  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 58579.5us
I20260709 12:58:38.280898  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.281989  1525 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
W20260709 12:58:38.287595  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 138238us
I20260709 12:58:38.292876  1525 pending_rounds.cc:85] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 6
I20260709 12:58:38.302379  1525 pending_rounds.cc:107] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:58:38.302692  1525 raft_consensus.cc:2889] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:38.294826  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.291326  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.144256  4280 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:38.331367  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:38.331516  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:38.332123  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:38.295555  1608 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
W20260709 12:58:38.333372  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.340055  1682 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:38.346818  1497 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.761s (SENT)
I20260709 12:58:38.346580  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:38.347537  1497 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:38.390872  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 44475.3us
I20260709 12:58:38.392006  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:38.392328  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.349766  1606 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:38.396176  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:38.294153  4387 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:38.396890  1530 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:38.399232  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:38.399277  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:38.296267  4365 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:38.295164  4229 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:38.290041  4454 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:38.402567  1679 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 4: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:38.402424  1682 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:58:38.426820  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.232086  4430 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:38.435307  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 104970us
I20260709 12:58:38.442240  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:38.395823  4294 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.430645  4454 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.349504  4261 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
W20260709 12:58:38.451180  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 116720us
I20260709 12:58:38.451556  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:38.401504  4446 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:38.452322  1603 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:38.489216  2461 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:38.453658  4454 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:38.475607   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:38.438153  4383 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:38.495814  2421 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:38.497300  1500 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:38.510210  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.485383  4430 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:38.495079  1572 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.005s	sys 0.016s
I20260709 12:58:38.487520  2474 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:38.521610  1572 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.016s
I20260709 12:58:38.495436  4382 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:38.522019  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 548173us
I20260709 12:58:38.451088  4294 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:38.533337  1572 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.703s (SENT)
I20260709 12:58:38.533980  1572 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:38.534528  2423 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:38.534744  4383 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:38.543269  4455 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:38.516258  4261 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:38.545851  4261 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:38.559265  4294 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:38.535567  4383 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.504391  4446 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:38.512243  4234 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:58:38.571189  4281 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:38.580454  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 53791.2us
I20260709 12:58:38.492121  1534 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:38.594369  1676 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:38.547187  4261 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.532807  4382 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.596562  2475 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
W20260709 12:58:38.574767  1674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.018s	sys 0.018s
W20260709 12:58:38.602080  1674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.019s	sys 0.019s
W20260709 12:58:38.607738  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 78144.9us
W20260709 12:58:38.608662  1572 leader_election.cc:336] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.705s (SENT)
I20260709 12:58:38.607023  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:38.635169  1572 leader_election.cc:336] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.749s (SENT)
I20260709 12:58:38.635885  1572 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:38.599757  4280 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:38.643272  4440 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 1.009s	user 0.002s	sys 0.000s
W20260709 12:58:38.646461  4456 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:58:38.608675  4344 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.695129  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 344228us
I20260709 12:58:38.697889  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.698666  1534 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:38.652204  3973 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.662878  4281 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:38.709174  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 74054.6us
I20260709 12:58:38.712131  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.712985  1533 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
W20260709 12:58:38.722220  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.725210  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 126022us
I20260709 12:58:38.697708  4234 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:38.722414  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 225003us
I20260709 12:58:38.704006  4344 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:38.734704  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.736176  1531 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:38.738312  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.737200  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.739202  1531 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:38.704478  4387 raft_consensus.cc:697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:38.740123  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.743726  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.747381  1531 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:38.749831  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.751154  1528 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:58:38.741647  1572 leader_election.cc:336] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.876s (SENT)
I20260709 12:58:38.753625  1572 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:38.739686  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.756816  2342 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:38.767925  1525 raft_consensus.cc:1240] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:38.769068  1530 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
W20260709 12:58:38.770532  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.770125  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60652
I20260709 12:58:38.770895  1534 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:38.771417  1600 raft_consensus.cc:606] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:58:38.780911  1649 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:38.682786  4446 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.708863  3973 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.796934  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:38.797861  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 56268us
I20260709 12:58:38.804291  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:38.773286  4234 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:38.782033  4280 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:38.819783  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:38.814855  1572 leader_election.cc:336] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.914s (SENT)
I20260709 12:58:38.824052  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:38.824893  1529 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:38.826311  4452 consensus_meta.cc:287] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.623s	user 0.013s	sys 0.000s
W20260709 12:58:38.826962  4464 log.cc:927] Time spent T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:58:38.826815  4452 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.828274  2455 raft_consensus.cc:2393] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 3: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:38.805925  4261 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:38.829073  4261 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:38.830370  4466 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:58:38.831476  4261 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:38.832494  3973 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:38.833110  4344 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:38.834177  1529 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:38.829407  4479 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.838996  2342 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:38.842137  4192 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:38.834615  4477 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:38.842759  4477 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.842916  4192 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.843214  4477 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:38.843519  4192 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.812959  4383 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:38.835144  4427 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:38.841665  4479 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.849400  4479 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:38.849995  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 628) took 1366 ms. Trace:
I20260709 12:58:38.850445  1674 rpcz_store.cc:276] 0709 12:58:37.483618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.483777 (+   159us) service_pool.cc:224] Handling call
0709 12:58:37.497029 (+ 13252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:37.499252 (+  2223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:37.499280 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:37.519046 (+ 19766us) log.cc:844] Serialized 26 byte log entry
0709 12:58:38.611708 (+1092662us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:38.611794 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:38.611904 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:38.849731 (+237827us) raft_consensus.cc:1685] finished
0709 12:58:38.849754 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:38.849908 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":957215,"threads_started":1,"wal-append.queue_time_us":1186566}
I20260709 12:58:38.854048  4387 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.857787  4382 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:38.861829  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.862447  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.862807  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.864981  3834 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:38.878569  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.882201  4469 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:38.887542  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:38.887780  4469 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:38.887596  4192 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:38.896270  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:38.897258  1530 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:38.897258  4454 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:38.933506  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 171035us
I20260709 12:58:38.949137  4383 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.958431  4452 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:38.966972  1497 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.591s (SENT)
I20260709 12:58:38.967538  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:38.969715  4363 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:38.975638  2476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 646) took 1493 ms (client timeout 1781 ms). Trace:
W20260709 12:58:38.976122  2476 rpcz_store.cc:269] 0709 12:58:37.482516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.482694 (+   178us) service_pool.cc:224] Handling call
0709 12:58:38.975434 (+1492740us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54005f46d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:38.975576 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405516544}
I20260709 12:58:38.977916  1533 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:38.979107  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:38.982827  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 561) took 2111 ms (client timeout 1781 ms). Trace:
W20260709 12:58:38.983390  1532 rpcz_store.cc:269] 0709 12:58:36.867892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.881583 (+ 13691us) service_pool.cc:224] Handling call
0709 12:58:38.978537 (+2096954us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54002d96d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:38.978715 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958013184}
I20260709 12:58:38.990792  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1814) took 1203 ms. Trace:
I20260709 12:58:38.978957  4192 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:38.999400  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:38.998137  1683 rpcz_store.cc:276] 0709 12:58:37.786997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.787140 (+   143us) service_pool.cc:224] Handling call
0709 12:58:37.816024 (+ 28884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:37.816892 (+   868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:38.990577 (+1173685us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b54001c61d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:38.990719 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45380864}
I20260709 12:58:38.999590  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.002264  2474 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:38.999425  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:38.998170  1497 leader_election.cc:336] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.620s (SENT)
I20260709 12:58:39.003197  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.003116  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:38.986025  4229 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:39.007098  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.006131  4294 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.008337  4294 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:39.009300  4450 log.cc:927] Time spent T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.525s	user 0.002s	sys 0.000s
I20260709 12:58:39.009451  3973 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:39.003890  2476 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:39.010591  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 583) took 1575 ms. Trace:
I20260709 12:58:39.011168  1526 rpcz_store.cc:276] 0709 12:58:37.435344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.453087 (+ 17743us) service_pool.cc:224] Handling call
0709 12:58:37.462634 (+  9547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:37.462917 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:37.462957 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:37.486951 (+ 23994us) log.cc:844] Serialized 26 byte log entry
0709 12:58:38.066808 (+579857us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:38.066864 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:38.066956 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.008766 (+941810us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:39.010298 (+  1532us) raft_consensus.cc:1685] finished
0709 12:58:39.010318 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.010513 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86907136,"thread_start_us":492866,"threads_started":1,"wal-append.queue_time_us":933888}
I20260709 12:58:38.981349  3834 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:58:38.976963  4383 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.004673  4479 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:39.022202  4479 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.024137  4479 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:39.026849  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.027289  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.027889  2475 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:39.028358  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:39.030397  1649 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.031704  1649 leader_election.cc:400] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:39.031965  1649 leader_election.cc:403] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:58:39.035709  2476 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:39.004899  4192 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.037613  2461 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:39.038604  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.039228  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.039789  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.040506  1575 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:39.041545  4280 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:39.042069  4480 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:39.042524  4480 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.042657  1649 leader_election.cc:400] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:39.042901  4480 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.043385  4192 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:39.044270  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.046972  4483 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:39.047529  4479 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.048213  4479 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.048623  4479 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.052348  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:39.010540  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.006875  4229 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.069716  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.020602  4488 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:39.006597  4477 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.070950  1526 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:39.067121  4229 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.067796  4483 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:39.080219  4271 raft_consensus.cc:3055] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:39.080713  4271 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:39.081681  4271 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.072152  4488 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.078971  4454 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:39.091854  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.096051  4271 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:39.096246  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:39.097236  1526 raft_consensus.cc:2368] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:58:39.101143  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.103569  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.089502  4488 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:39.104691  1526 raft_consensus.cc:2368] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
W20260709 12:58:39.091854  4441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.009s	sys 0.008s
I20260709 12:58:39.108210  4469 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:39.101867  4491 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:58:39.116999  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.115099  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:39.118367  1526 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:39.118525  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.119146  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.119565  4432 raft_consensus.cc:993] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:58:39.119660  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.120003  2423 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:39.120208  4432 raft_consensus.cc:1081] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Signalling peer 1e45ac8b66854c2f905bf2c4114cb489 to start an election
I20260709 12:58:39.096768  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 642) took 1819 ms. Trace:
I20260709 12:58:39.121079  2451 rpcz_store.cc:276] 0709 12:58:37.277501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.278908 (+  1407us) service_pool.cc:224] Handling call
0709 12:58:38.112219 (+833311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:38.229853 (+117634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.096549 (+866696us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b540067a7d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:39.096700 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898203392}
W20260709 12:58:39.115064  4494 log.cc:927] Time spent T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:58:39.115201  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.123339  2455 raft_consensus.cc:2410] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:39.124568  4280 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:39.125275  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.125635  3973 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:39.127457  4478 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:39.128026  4478 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:39.128927  4478 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.115432  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:39.130951  1529 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:39.138495  1572 leader_election.cc:336] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.296s (SENT)
I20260709 12:58:39.116045  4383 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:39.116675  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.119127  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.122184  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:39.104723  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.147814  1529 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:39.148960  1530 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:39.150601  4477 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:39.151278  2435 raft_consensus.cc:2368] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:58:39.153506  1526 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:39.157261  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:39.158209  1649 connection.cc:256] RPC call timeout handler was delayed by -1.2793703479999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2782s for a response
W20260709 12:58:39.114243  4441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.009s	sys 0.009s
I20260709 12:58:39.165719  4470 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:39.166445  4470 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.178422  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:39.182914  1497 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.169317  4470 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:39.183125  1572 leader_election.cc:336] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.217s (SENT)
W20260709 12:58:39.187252  1572 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.236s (SENT)
I20260709 12:58:39.187968  4432 raft_consensus.cc:2764] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:58:39.155125  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:39.198205  1417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 45308.1us
I20260709 12:58:39.201624  4479 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.202154  4229 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.175004  4383 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:39.214983  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.214282  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:39.218866  4479 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:39.228050  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.230281  1603 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:39.233394  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:39.234428  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.238622  1575 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:39.221475  4457 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.742s	user 0.002s	sys 0.002s
W20260709 12:58:39.252626  1647 connection.cc:256] RPC call timeout handler was delayed by -1.3965973360000135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 12:58:39.253079  1647 connection.cc:256] RPC call timeout handler was delayed by -1.3938973360000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
I20260709 12:58:39.217461  4432 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:58:39.249004  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.249778  3776 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.257638  3776 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:39.257717  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 74891.2us
I20260709 12:58:39.240474  4281 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:39.258558  4281 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:39.258981  4281 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.258074  3776 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.260555  1500 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.232141  4364 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:39.261791  1500 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.262449  4364 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.262892  4364 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.263221  4364 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.263459  4192 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.263950  4192 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:39.267709  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.268620  4192 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:39.270459  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.271956  4383 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:39.271041  4472 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.272322  4383 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.272568  4472 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.272729  4383 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:39.272830  1647 connection.cc:256] RPC call timeout handler was delayed by -1.2381973360000416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
I20260709 12:58:39.273044  4472 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:39.273305  1647 connection.cc:256] RPC call timeout handler was delayed by -1.1967973360000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
I20260709 12:58:39.274039  4471 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.274561  4471 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.280330  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:39.282608  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.283036  1649 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:39.283200  4471 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:39.283337  2435 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:39.283969  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.285169  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:39.286470  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:39.287066  2474 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:39.284025   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:39.290694  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.291443  1604 raft_consensus.cc:2410] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:39.294545  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:39.287767  4479 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:39.299851  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 654) took 1141 ms. Trace:
I20260709 12:58:39.299942  4479 consensus_queue.cc:1059] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:39.300318  2428 rpcz_store.cc:276] 0709 12:58:38.158476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.160168 (+  1692us) service_pool.cc:224] Handling call
0709 12:58:38.160607 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.128172 (+967565us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:58:39.128510 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.210378 (+ 81868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:39.210433 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:58:39.210504 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.299617 (+ 89113us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400584654. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:39.299663 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.299796 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":634,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":53,"raft.queue_time_us":81,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":2224582912,"thread_start_us":79096,"threads_started":1}
I20260709 12:58:39.280376  4477 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:39.306674  4488 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.307678  4294 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:39.308878  4488 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:39.311053  4432 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:39.311321  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.314494  2451 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:39.295807  4471 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:39.287647  4469 raft_consensus.cc:2764] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:39.319054  3973 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:39.286044  4441 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:58:39.319648  3973 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.320060  3973 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:39.320771  1572 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:39.296633  4280 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:39.326238  4478 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:39.305437  4477 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.330559  1604 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:39.330967  4271 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:39.331432  1600 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:39.331748  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.331252  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.339304  1603 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
W20260709 12:58:39.341811  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 49357.2us
I20260709 12:58:39.343266  1649 leader_election.cc:400] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:39.313027  1429 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 3, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 3 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:39.344329  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:39.292055  4470 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:39.329344  4477 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:39.351678  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:39.309481  4488 raft_consensus.cc:3055] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:58:39.358006  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 65427.6us
W20260709 12:58:39.357378  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 118850us
W20260709 12:58:39.358168  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63736.2us
I20260709 12:58:39.359660  4469 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.364289  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.364629  4469 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.365056  4469 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.365221  1680 raft_consensus.cc:2410] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:39.366250  1608 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:58:39.366640  1608 pending_rounds.cc:85] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 3
I20260709 12:58:39.366852  1608 pending_rounds.cc:107] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:58:39.367055  1608 raft_consensus.cc:2889] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:39.370196  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.370558  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.371115  1680 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.372186  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.374975  1603 raft_consensus.cc:2410] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:58:39.368870  1498 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:39.376118  2474 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:39.378343  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.378974  1603 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:39.379613  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.380028  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:39.332821  4480 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.382130  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.382310  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.362095  4470 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.381907  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.383427  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.383884  1649 leader_election.cc:400] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:58:39.384965  4344 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:39.384647  1429 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 6, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:39.381898  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.386116  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.386737  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:39.402823  1600 raft_consensus.cc:2410] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:39.403595  1607 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:39.387974  1682 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:39.388268  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.365363  4488 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:39.392494  1677 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:39.379213  4477 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.409243  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.359892  4471 consensus_queue.cc:1059] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:58:39.396073  1649 leader_election.cc:403] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:39.361184  4280 raft_consensus.cc:697] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:39.350229  4294 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:58:39.393622  1674 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:39.382673  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.410022  1601 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 2.
I20260709 12:58:39.391186  4473 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:39.412266  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.412873  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.413161  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.427973  1609 raft_consensus.cc:2410] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:58:39.416090  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.416232  1677 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:39.402057  4470 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:39.422134  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.422366  1429 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:39.428570  1607 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:39.431126  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.429258  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.432073  1677 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:39.433570  1680 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:39.435758  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.437952  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.410367  4446 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:39.438264  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.443943  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.409778  4454 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:39.438757  1682 raft_consensus.cc:2393] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:39.447768  1681 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:39.448060  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.440874  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.437455  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.441761  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.409725  4477 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.449126  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:39.454074  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 72932.7us
I20260709 12:58:39.461540  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:39.469509  1679 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:39.467486  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.474350  1600 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:39.404011  3776 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.473441  1680 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:39.477157  1609 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:39.477787  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.468196  4477 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.486069  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.486758  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.414580  4432 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:58:39.438047  4479 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:58:39.443456  4473 raft_consensus.cc:697] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:39.447284  4454 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:39.523775  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.477941  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:39.487720  4229 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:39.443037  4446 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.456480  4472 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.539359  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.540504  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:39.539211  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 170396us
W20260709 12:58:39.543051  1480 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 12:58:39.735265  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.524152  4488 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:39.754487  1480 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5297d7a3ab0a4faeaf7d74c4c5296b15 already in progress
I20260709 12:58:39.736027  1675 raft_consensus.cc:2410] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:39.529903  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:39.756760  4480 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:39.590272  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:39.655315  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 193864us
I20260709 12:58:39.514858  4280 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.759845  3973 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.761365  1572 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:39.744251  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.762938  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:39.745019  4505 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.314s	user 0.013s	sys 0.001s
I20260709 12:58:39.736225  4508 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:39.768672  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:39.746622  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.747257  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:39.771097  1531 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.747510  1678 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:39.733660  1500 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:39.748575  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:39.772346  1526 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:39.748813  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:39.749329  4383 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:39.777153  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 43659.4us
I20260709 12:58:39.732821  1674 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:39.749879  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:39.778849  1527 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.751219  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:39.754930  1647 leader_election.cc:336] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.524s (SENT)
I20260709 12:58:39.758445  4364 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.538870  4446 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:39.754915  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5297d7a3ab0a4faeaf7d74c4c5296b15 already in progress
I20260709 12:58:39.775080  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.779007  1534 raft_consensus.cc:1240] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:39.779743  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.786437  1602 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:39.783499  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.787739  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.788491  1680 raft_consensus.cc:2410] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:58:39.788806  1525 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:39.794472  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:39.795435  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:39.768261  4459 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.288s	user 0.006s	sys 0.003s
I20260709 12:58:39.799398  1675 raft_consensus.cc:2410] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:39.803731  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.804085  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.805348  1605 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:39.807699  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:39.808849  1682 raft_consensus.cc:2410] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:39.765239  4455 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:39.804432  1674 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:39.815616  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:39.768150  4508 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.782415  4519 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.821617  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.824352  1649 leader_election.cc:400] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:58:39.827260  4519 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:39.828147  4513 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:39.828486  4261 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:39.829821  3973 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:39.830627  4472 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:39.831525  1675 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:58:39.831712  4509 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:58:39.833021  1675 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:58:39.784016  4469 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:39.834944  1683 raft_consensus.cc:2393] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:39.835593  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 96462.2us
I20260709 12:58:39.835994  1679 raft_consensus.cc:2368] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6.
I20260709 12:58:39.825387  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:39.841713  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:39.818462  2435 raft_consensus.cc:2410] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:39.844928  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.859972  1676 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:39.844435  1527 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:39.866644  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.875289  1607 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:39.816560  4455 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:39.868635  1649 leader_election.cc:400] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 3. Current term is 4.
I20260709 12:58:39.871500  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:39.826656  4508 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:39.879693  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:39.892136  1534 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:39.892192  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.893306  1607 raft_consensus.cc:2410] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:58:39.894518  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 69239.1us
W20260709 12:58:39.898357  2342 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.567s (SENT)
I20260709 12:58:39.835557  4519 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:39.842837  4294 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:58:39.902408  2342 leader_election.cc:336] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.613s (SENT)
I20260709 12:58:39.902208  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.905452  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.907191  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.871763  4229 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:39.798691  4454 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:39.915228  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 161235us
I20260709 12:58:39.888391  4455 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.911834  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:39.961956  1607 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:39.954164  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 51773.2us
I20260709 12:58:39.894105  4330 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:39.894340  4514 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:39.972154  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 177189us
W20260709 12:58:39.972715  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 65662.7us
I20260709 12:58:39.974018  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:39.975245  1497 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:39.975864  1647 leader_election.cc:336] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.652s (SENT)
I20260709 12:58:39.976562  1647 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.952075  4507 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:39.973093  4521 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:39.993206  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:39.994071  1605 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
W20260709 12:58:39.994041  1647 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.966s (SENT)
I20260709 12:58:39.995679  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.952726  4294 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:39.998749  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 122837us
I20260709 12:58:39.978101  4344 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:39.991151  4470 consensus_meta.cc:287] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.007s
I20260709 12:58:40.005661  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:40.007328  1603 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:39.977991  4441 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:39.993045  4382 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:39.992389  4479 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.010236  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:40.010617  1647 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.803s (SENT)
W20260709 12:58:40.007306  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 246013us
I20260709 12:58:40.011821  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:40.013429  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:40.000092  2423 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:58:39.998178  3776 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.021051  1572 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:40.025339  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:40.029100  1603 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
W20260709 12:58:40.010327  4281 consensus_meta.cc:287] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.751s	user 0.015s	sys 0.004s
I20260709 12:58:40.033375  1607 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:40.033735  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:40.034893  1572 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:40.035172  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 142988us
I20260709 12:58:40.036038  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:40.037492  1649 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:39.907372  4473 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.006685  4507 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:39.977166  4516 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:58:40.019178  4382 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:40.058164  1572 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:40.089294  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:40.051138  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:40.090508  1607 raft_consensus.cc:2410] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:58:40.046242  1647 leader_election.cc:336] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.936s (SENT)
I20260709 12:58:40.091485  1647 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:40.100764  1603 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:40.038625  4510 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.056283  4383 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:40.114898  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 144604us
W20260709 12:58:40.104941  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 72307.4us
W20260709 12:58:40.117048  1647 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.485s (SENT)
I20260709 12:58:40.106065  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:40.056059  4469 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.097172  4382 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:40.096359  4280 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:40.132321  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 127204us
I20260709 12:58:40.019059  4470 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:40.138726  1497 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.576s (SENT)
I20260709 12:58:40.046422  4281 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:40.134850  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 76752.8us
I20260709 12:58:40.140618  1497 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:40.144132  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:40.138171  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 132475us
I20260709 12:58:40.104770  4229 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:40.114456  4519 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.162706  1575 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:40.137845  3776 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:40.138729  4507 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:40.180555  1606 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:40.183876  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 146480us
I20260709 12:58:40.179420  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:40.180510  1677 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:40.200564  1531 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
W20260709 12:58:40.209545  2342 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.752s (SENT)
I20260709 12:58:40.165827  4526 raft_consensus.cc:2764] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:40.102605  4294 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.214941  2342 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:40.185046  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:40.304400  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 163481us
I20260709 12:58:40.213433  4519 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.211082  3776 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:40.305765  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:40.302179  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 122844us
I20260709 12:58:40.314543  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:40.312675  4533 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:40.355297  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 49587.3us
I20260709 12:58:40.314129  4529 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:40.341441  4530 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:58:40.342319  4470 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.343284  4281 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.315078  3776 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.311882  4524 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:58:40.337090  4522 log.cc:927] Time spent T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:58:40.353209  4510 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:40.354296  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:40.349627  4525 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:58:40.351198  4488 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:40.386611  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 270878us
I20260709 12:58:40.400262  4455 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.405138  3776 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.411520  4540 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.367051  4529 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:40.428509  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 218986us
W20260709 12:58:40.437031  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 82795.6us
W20260709 12:58:40.434079  4446 consensus_meta.cc:287] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.618s	user 0.005s	sys 0.007s
I20260709 12:58:40.431074  4554 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.454710  1575 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:40.444732  4540 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:40.461478  3776 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.461221  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:40.468133  4540 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.471688  4540 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.476645  4553 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:58:40.488346  4540 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.491658  4540 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:40.493429  4148 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:40.494112  4148 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.501096  4261 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:40.501864  4261 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.508049  4148 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.512691  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45362 (request call id 638) took 1140 ms. Trace:
I20260709 12:58:40.513192  1678 rpcz_store.cc:276] 0709 12:58:39.372304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.372411 (+   107us) service_pool.cc:224] Handling call
0709 12:58:40.512426 (+1140015us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400342954. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:40.512599 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739034880}
I20260709 12:58:40.521955  4454 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:40.540855  2451 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:40.550985  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:40.555734  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:40.557096  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:40.557928  1609 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:40.569553  1429 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 5, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:40.571754  1429 catalog_manager.cc:5697] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:40.574954  4513 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:40.575409  4513 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:40.576197  4513 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:40.579633  4508 consensus_meta.cc:287] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.003s
I20260709 12:58:40.450139  4526 consensus_queue.cc:1059] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 12:58:40.621871  4472 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.622331  4469 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.577373  4513 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:40.622462  4472 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:40.623303  4507 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:40.624266  4507 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:40.624953  4472 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:40.625656  4383 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:40.626060  4554 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:40.626590  4554 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:40.626386  4383 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:40.626912  1603 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:58:40.627336  1603 pending_rounds.cc:85] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 3
W20260709 12:58:40.627990  2342 leader_election.cc:336] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.974s (SENT)
I20260709 12:58:40.628419  2342 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:40.586171  4344 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:40.588577  1429 catalog_manager.cc:5697] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.589669  4364 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:40.594682  4477 consensus_meta.cc:287] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.112s	user 0.013s	sys 0.000s
I20260709 12:58:40.595275  4529 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:40.638764  1605 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:58:40.596040  4455 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:40.598774  4280 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.598960  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1887) took 1225 ms. Trace:
I20260709 12:58:40.657147  1606 rpcz_store.cc:276] 0709 12:58:39.373458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.373720 (+   262us) service_pool.cc:224] Handling call
0709 12:58:39.374133 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:40.181344 (+807211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.598684 (+417340us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540020e9d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:40.598888 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853971200}
I20260709 12:58:40.658418  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1832) took 1238 ms. Trace:
I20260709 12:58:40.627521  4554 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:40.600004  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 652) took 1149 ms. Trace:
I20260709 12:58:40.535423   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:40.614694  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:40.662407  1609 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
W20260709 12:58:40.616725  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 155627us
I20260709 12:58:40.627558  1603 pending_rounds.cc:107] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:58:40.668382  1603 raft_consensus.cc:2889] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:40.637503  1429 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.505167  4261 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.646072  4383 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:40.672091  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 487137us
I20260709 12:58:40.672902  1649 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:40.638778  4514 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:58:40.455422  4446 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:40.649796  1647 leader_election.cc:336] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.155s (SENT)
I20260709 12:58:40.674204  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:40.650434  4550 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.256s
I20260709 12:58:40.635016  4382 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.634757  4508 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:40.682118  4382 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.682847  1600 raft_consensus.cc:2368] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:40.684644  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:40.684917  4483 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:40.685459  4536 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.622619  4526 raft_consensus.cc:3055] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:40.647586  4477 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.688432  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:40.658839  1681 rpcz_store.cc:276] 0709 12:58:39.420420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.448752 (+ 28332us) service_pool.cc:224] Handling call
0709 12:58:39.478439 (+ 29687us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:40.004734 (+526295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:40.004767 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:40.011451 (+  6684us) log.cc:844] Serialized 52 byte log entry
0709 12:58:40.435699 (+424248us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:40.452864 (+ 17165us) log.cc:844] Serialized 14 byte log entry
0709 12:58:40.580653 (+127789us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b180034b280. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab522 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:58:40.653614 (+ 72961us) log.cc:844] Serialized 14 byte log entry
0709 12:58:40.653816 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.653905 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:40.658201 (+  4296us) raft_consensus.cc:1685] finished
0709 12:58:40.658222 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.658365 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200283,"prepare.queue_time_us":20256,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":461541,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":14673,"spinlock_wait_cycles":17426432,"thread_start_us":584666,"threads_started":2,"wal-append.queue_time_us":411800}
I20260709 12:58:40.654491  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 653) took 1177 ms. Trace:
I20260709 12:58:40.655563  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 650) took 1232 ms. Trace:
I20260709 12:58:40.675570  4470 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:40.658344  3834 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.688512  4526 raft_consensus.cc:740] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:40.700165  4526 consensus_queue.cc:260] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.701969  4469 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:40.702441  4469 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.702775  4469 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:40.682150  4508 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:40.694489  1680 rpcz_store.cc:276] 0709 12:58:39.422950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.803753 (+380803us) service_pool.cc:224] Handling call
0709 12:58:39.804021 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.804203 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:39.911815 (+107612us) log.cc:844] Serialized 14 byte log entry
0709 12:58:40.618242 (+706427us) log.cc:844] Serialized 14 byte log entry
0709 12:58:40.655166 (+ 36924us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:40.655229 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:40.655287 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.655367 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.655499 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":490553,"prepare.queue_time_us":302052,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":12958,"raft.queue_time_us":512183,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":254873,"threads_started":2,"wal-append.queue_time_us":342950}
I20260709 12:58:40.705893  1429 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 5, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:40.708490  4477 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.662089  1674 rpcz_store.cc:276] 0709 12:58:39.450826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.815890 (+365064us) service_pool.cc:224] Handling call
0709 12:58:39.828062 (+ 12172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.828284 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:39.996771 (+168487us) log.cc:844] Serialized 14 byte log entry
0709 12:58:40.478540 (+481769us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b1800431f80. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce825c0a 00007f25d7f65219 00007f25ce8ada40 00007f25ce8a84e4 00007f25ce8a8455 00007f25d1990060 00007f25d19a2716 00007f25d19b3287 00007f25d19b3208
0709 12:58:40.599528 (+120988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:40.599600 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:40.599680 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.599776 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.599916 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12503,"prepare.queue_time_us":303293,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":494262,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":14068480,"thread_start_us":252676,"threads_started":2,"wal-append.queue_time_us":226132}
I20260709 12:58:40.684659  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 1903) took 1208 ms. Trace:
I20260709 12:58:40.717545  1600 rpcz_store.cc:276] 0709 12:58:39.476423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.476937 (+   514us) service_pool.cc:224] Handling call
0709 12:58:40.684492 (+1207555us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54001d0454. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:40.684606 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126936960}
I20260709 12:58:40.717438  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:40.726490  4470 consensus_queue.cc:1059] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:58:40.726964  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 317) took 13511 ms (client timeout 15000 ms). Trace:
I20260709 12:58:40.727777  4470 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:40.728502  4483 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:40.728695  4470 raft_consensus.cc:3055] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:40.729203  4470 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:40.730911  4470 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:40.727386  1432 rpcz_store.cc:269] 0709 12:58:27.215837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.218431 (+  2594us) service_pool.cc:224] Handling call
0709 12:58:27.246495 (+ 28064us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5400002490. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce8740b2 00007f25d77eda89 00007f25d7785da6 00007f25d7757088 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc
0709 12:58:40.726744 (+13480249us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:34.292997 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:34.413198 (+120201us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:34.413277 (+    79us) write_op.cc:435] Acquired schema lock
0709 12:58:34.413303 (+    26us) tablet.cc:662] Decoding operations
0709 12:58:34.415144 (+  1841us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:34.415250 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:34.415286 (+    36us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:58:34.416937 (+  1651us) tablet.cc:701] Row locks acquired
0709 12:58:34.416964 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:58:34.417142 (+   178us) write_op.cc:270] Start()
0709 12:58:34.511355 (+ 94213us) write_op.cc:276] Timestamp: P: 1783601914417083 usec, L: 0
0709 12:58:34.540642 (+ 29287us) op_driver.cc:348] REPLICATION: starting
0709 12:58:35.009475 (+468833us) log.cc:844] Serialized 7219 byte log entry
0709 12:58:36.100594 (+1091119us) op_driver.cc:464] REPLICATION: finished
0709 12:58:36.546109 (+445515us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25ce88e0ac 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d53ceef0
0709 12:58:36.688685 (+142576us) write_op.cc:301] APPLY: starting
0709 12:58:36.688855 (+   170us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:36.689521 (+   666us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:36.689582 (+    61us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:36.722280 (+ 32698us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:36.722944 (+   664us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:58:36.722997 (+    53us) write_op.cc:312] APPLY: finished
0709 12:58:36.723624 (+   627us) log.cc:844] Serialized 125 byte log entry
0709 12:58:36.725366 (+  1742us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:36.725920 (+   554us) write_op.cc:454] Released schema lock
0709 12:58:36.726033 (+   113us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:36.735777 (+  9744us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:36.735813 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1224839,"reported_tablets":35,"spinlock_wait_cycles":3547008,"child_traces":[["op",{"apply.queue_time_us":587753,"apply.run_cpu_time_us":6967,"apply.run_wall_time_us":37946,"num_ops":18,"prepare.queue_time_us":1152841,"prepare.run_cpu_time_us":112571,"prepare.run_wall_time_us":1130938,"raft.queue_time_us":23842,"raft.run_cpu_time_us":47679,"raft.run_wall_time_us":636156,"replication_time_us":1518502,"spinlock_wait_cycles":307991808,"thread_start_us":1197954,"threads_started":4,"wal-append.queue_time_us":530978,"wal-append.run_cpu_time_us":21209,"wal-append.run_wall_time_us":2179426}]]}
I20260709 12:58:40.722052  4526 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:40.732511  4470 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:40.726555  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 76821.3us
I20260709 12:58:40.739040  1649 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:40.740070  4483 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:40.740753  4536 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:40.741447  4536 raft_consensus.cc:697] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:40.741953  1675 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:58:40.742314  1675 pending_rounds.cc:85] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 3
I20260709 12:58:40.742625  1675 pending_rounds.cc:107] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:58:40.740751  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:40.742870  1677 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:40.742337  4536 consensus_queue.cc:237] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:40.743849  1678 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:58:40.742895  1675 raft_consensus.cc:2889] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:40.744894  1674 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:40.746404  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:40.749239  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 74306.7us
I20260709 12:58:40.745914  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:40.764220  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 408151us
I20260709 12:58:40.764871  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:40.769721  2455 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:40.693583  1679 rpcz_store.cc:276] 0709 12:58:39.476735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.841679 (+364944us) service_pool.cc:224] Handling call
0709 12:58:39.880466 (+ 38787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.880736 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:40.056278 (+175542us) log.cc:844] Serialized 14 byte log entry
0709 12:58:40.516521 (+460243us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b18004393c0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25d15404bc 00007f25ce88e48b 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d153823a
0709 12:58:40.654159 (+137638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:40.654213 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:40.654259 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.654329 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.654436 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176496,"prepare.queue_time_us":289869,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":8152,"raft.queue_time_us":155216,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":8147712,"thread_start_us":236962,"threads_started":2,"wal-append.queue_time_us":349645}
W20260709 12:58:40.763705  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.779382  1675 raft_consensus.cc:2393] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:40.779919  1678 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:40.780825  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:40.787513  2339 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:40.802147  1677 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:40.817342  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:40.817216  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:40.822722  1527 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:40.848150  3776 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:40.854992  3776 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:40.850853  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:40.853005  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:40.853207  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:40.858556  1679 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:40.858613  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:40.859890  1675 raft_consensus.cc:1240] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:40.822091  1531 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:40.862286  1676 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:40.854029  1678 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:40.740813  4483 raft_consensus.cc:697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:40.862874  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 51637.3us
I20260709 12:58:40.864482  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:40.868650  1680 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:40.867866  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:40.877419  1680 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:40.894505  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:40.884064  1532 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:40.884747  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 62020.1us
I20260709 12:58:40.886356  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:40.819471  4543 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:40.867792  1683 raft_consensus.cc:2376] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5. Re-sending same reply.
I20260709 12:58:40.888432  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:40.887300  4540 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.890733  4524 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:40.825212  4455 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:58:40.902143  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:40.905751  2428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
 from {username='slave'} at 127.0.0.1:36924
I20260709 12:58:40.906623  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:41.152697  1676 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:40.864704  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:40.895408  1680 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:40.861531  4192 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:40.975895  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:40.786044  3834 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 12:58:40.823189  4519 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.819640  4529 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.818480  4550 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:58:41.012946  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.014400  2455 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:41.172950  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:40.909345  4558 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:58:40.759397  4508 consensus_queue.cc:1059] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 12:58:41.015496  1674 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:41.020849  1681 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:40.819736  4488 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:41.075559  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.019s	sys 0.030s
I20260709 12:58:41.077621  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:41.184168  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.019s	sys 0.030s
W20260709 12:58:41.079804  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.084926  3776 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:40.816530  4330 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.218s
W20260709 12:58:41.080185  2344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.054s	sys 0.064s
I20260709 12:58:41.011754  4331 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:41.012315  4557 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:41.156415  4546 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.013s	sys 0.070s
I20260709 12:58:41.199270  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.094260  2451 raft_consensus.cc:1240] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:41.111793  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:41.117980  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:41.200724  2474 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:41.126293  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:41.201495  2476 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.096519  4471 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.206332  1676 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:41.142935  1679 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:41.141945  1682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.003s
I20260709 12:58:41.144726  1534 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:41.207309  1682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.007s	sys 0.003s
I20260709 12:58:41.154855  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:41.144827  1602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.000s	sys 0.010s
I20260709 12:58:41.158627  1678 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:41.208096  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1935) took 1737 ms. Trace:
I20260709 12:58:41.117362  4469 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.173498  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.152453  4148 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:41.162783  4535 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.010s
I20260709 12:58:41.156316  4545 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:58:41.185411  2344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.054s	sys 0.064s
W20260709 12:58:41.254555  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 821992us
I20260709 12:58:41.189968  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.160234  2428 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:41.155992  4446 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.159722  4552 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:41.137326  4507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.026s	sys 0.036s
W20260709 12:58:41.208237  1602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.000s	sys 0.010s
I20260709 12:58:41.174242  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:41.137681  4483 consensus_queue.cc:237] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.150758  4540 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.209640  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.271457  1674 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:41.149056  4294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.007s	sys 0.003s
I20260709 12:58:41.238327  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:41.277153  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.208503  1682 rpcz_store.cc:276] 0709 12:58:39.470861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.841255 (+370394us) service_pool.cc:224] Handling call
0709 12:58:39.877851 (+ 36596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.878129 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:40.058820 (+180691us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.207784 (+1148964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.207832 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:41.207876 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.207940 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.208044 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":460125,"prepare.queue_time_us":277115,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":482864,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":62,"thread_start_us":838329,"threads_started":3,"wal-append.queue_time_us":350786}
W20260709 12:58:41.240216  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 108683us
I20260709 12:58:41.278102  1681 raft_consensus.cc:2410] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:41.157188  4562 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:41.208639  4557 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.242125  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:41.242667  2423 raft_consensus.cc:2393] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:41.242938  4471 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:41.245707  4506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.004s	sys 0.009s
I20260709 12:58:41.247351  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:41.252884  2476 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:41.260571  4455 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:41.257903  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 69862us
I20260709 12:58:41.259625  2474 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:41.262591  2455 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:41.269196  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 85429us
I20260709 12:58:41.310236  1572 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:41.271991  3776 consensus_queue.cc:1059] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.311822  3776 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:41.312175  3776 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.312459  3776 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:41.248209  4535 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.010s
I20260709 12:58:41.163360  4192 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.294870  4565 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 12:58:41.277052  4294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.007s	sys 0.003s
I20260709 12:58:41.291705  1678 raft_consensus.cc:2393] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 2: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:41.181524  4513 consensus_queue.cc:1059] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:58:41.324196  2461 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:58:41.269112  4507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.026s	sys 0.036s
I20260709 12:58:41.177654  4529 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.171660  4519 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.241528  4480 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:41.311029  4280 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.292066  4523 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.268829  2428 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:41.297073  4562 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.205580  4344 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:58:41.288329  1534 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
W20260709 12:58:41.207067  4546 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.013s	sys 0.070s
I20260709 12:58:41.305462  1675 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:41.307024  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:41.400904  2475 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:41.295416  4454 consensus_meta.cc:287] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.000s
I20260709 12:58:41.159519  4524 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.313786  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:41.313892  4444 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:41.315225  4471 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.269054  4563 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:58:41.318069  4508 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:41.320561  4550 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.320852  4540 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.277740  4552 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.401899  2435 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.422470  4192 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:41.423169  4552 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:41.259933  4526 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 12:58:41.324407  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.425269  4529 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.382629  4280 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.210011  4331 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.429082  2475 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:41.321471  4455 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:41.304864  4470 consensus_meta.cc:287] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.571s	user 0.014s	sys 0.000s
W20260709 12:58:41.304031  4506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.004s	sys 0.010s
I20260709 12:58:41.325333  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.338402  2455 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:41.207607  4488 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.323645  4532 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.394446  4562 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.395829  4446 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.397486  4519 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.270987  4148 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.364545  3834 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:41.373186  4513 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:41.407351  2421 raft_consensus.cc:2393] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:41.410401  4383 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.407032  3776 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.414004  4550 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.430110  4331 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:41.482823  2421 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:41.429150  4280 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.446022  2461 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:41.434854  1679 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:41.384936  4523 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.478011  2475 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:41.419133  4469 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:41.464600  4551 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.405952  4444 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.465921  4513 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:41.463471  4446 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.462178  4532 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.504868  3776 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.522275  2421 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:41.469172  3834 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.478957  4383 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:41.571982  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 260811us
I20260709 12:58:41.572309  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.573159  1609 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
W20260709 12:58:41.576399  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 630454us
I20260709 12:58:41.578125  3776 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:41.579823  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:41.586201  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:41.588658  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.580854  1500 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:41.576818  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 266227us
I20260709 12:58:41.594246  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.596678  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:41.601476  1647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.710s (SENT) [suppressed 80 similar messages]
W20260709 12:58:41.604336  1647 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.584s (SENT)
I20260709 12:58:41.570212  4280 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.610633  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.610404  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.611528  1681 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:41.576865  4470 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:41.580340  4519 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.612254  1500 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:41.607623  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:41.615576  1678 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:41.613435  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.597738  4529 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:41.593668  4526 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:41.633849  1677 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:41.624495  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:41.626099  1607 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:41.635304  1572 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:41.505793  4551 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.649776  1607 raft_consensus.cc:3055] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:41.650226  1607 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:41.652318  1606 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:41.615005  4550 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.620926  4529 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:41.591143  4513 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.620358  4586 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:41.616917  4280 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.620504  4519 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.621413  4470 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.702263  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.703321  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.705385  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:41.713671  1605 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:41.687062  1607 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.707779  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.677102  4546 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:41.700909  4513 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:41.702584  4586 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:41.728930  1606 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:41.736866  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:41.737267  1607 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:41.737612  1608 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.708437  4455 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:41.739183  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:41.740397  4580 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:41.741670  4590 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:41.742198  4590 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.742560  4590 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.746160  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:41.748216  4578 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:58:41.749876  3834 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.739178  4529 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.751706  4529 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.710870  4554 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:41.754192  4554 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:41.754364  1608 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:41.754674  4554 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.758155  4543 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:41.758600  4543 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:41.759672  4519 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.759434  4543 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.760530  1603 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 2.
I20260709 12:58:41.761583  4280 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.762496  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:41.723305  4444 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.764540  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.766604  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:41.737852  2435 raft_consensus.cc:2410] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:58:41.794873  4551 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:41.795665  4148 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.796726  4470 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.797096  4557 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.802104  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.802394  4586 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.803432  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.804605  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.766674  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:41.770895  1605 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:41.770202  1601 raft_consensus.cc:2376] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3. Re-sending same reply.
I20260709 12:58:41.784446  2476 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:41.785135  4532 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:41.785840  4581 log.cc:927] Time spent T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:58:41.788966  4446 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.767970  4523 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.808547  1607 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:58:41.821619  1607 pending_rounds.cc:85] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 5
I20260709 12:58:41.821884  1607 pending_rounds.cc:107] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:58:41.822116  1607 raft_consensus.cc:2889] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:41.810967  1678 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
W20260709 12:58:41.814550  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 202363us
I20260709 12:58:41.819584  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.823588  1605 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:41.820266  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.825700  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:41.826730  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.830096  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:41.826930  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.830689  1531 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:41.832088  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:41.834342  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.828151  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.828502  1534 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:41.846222  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:41.846935  1525 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.846222  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:41.848421  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:41.815281  4455 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:41.845255  1531 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:41.851337  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:41.850234  1497 leader_election.cc:400] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6.
I20260709 12:58:41.852288  1497 leader_election.cc:403] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:58:41.850571  4261 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:41.854631  4524 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.855562  4455 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:41.890242  2428 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.890491  4455 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.891268  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.891921  2423 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:41.892920  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.837779  4446 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.895138  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 660) took 1059 ms. Trace:
I20260709 12:58:41.858912  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.876034  1525 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:41.882094  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.882280  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.883807  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.884196  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.884430  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:41.850854  4432 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:58:41.857208  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.857652  4280 raft_consensus.cc:3055] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:41.895581  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.903661  2461 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:41.904794  1606 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:41.894125  4585 raft_consensus.cc:2764] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:58:41.857738  4444 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:41.910344  1601 raft_consensus.cc:2368] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:41.912891  1600 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:41.913946  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:41.914551  1606 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.916240  2451 raft_consensus.cc:1240] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 6. Ops: []
I20260709 12:58:41.918524  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.920022  2423 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:41.894789  4261 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:41.894945  4557 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:58:41.922446  4261 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:41.925944  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 75891.9us
I20260709 12:58:41.927238  4383 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.927477  4294 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6.
I20260709 12:58:41.927850  4383 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.928720  4294 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:41.884896  4546 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:41.929955  4546 consensus_queue.cc:1059] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:41.931924  4472 raft_consensus.cc:3055] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:41.932265  1606 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:41.932458  4444 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.934444  4589 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.932296  4472 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:41.935403  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:41.936074  4472 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.937088  4472 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.937153  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.937775  1676 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:41.938529  4536 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:41.938640  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.938894  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.939299  1676 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:41.939117  4536 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.939513  1678 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:41.941083  4536 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.936491  4477 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.897876  1683 rpcz_store.cc:276] 0709 12:58:40.835497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.154695 (+319198us) service_pool.cc:224] Handling call
0709 12:58:41.155007 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.155362 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:41.166261 (+ 10899us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.398849 (+232588us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b18003b1e80. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:58:41.501180 (+102331us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.521484 (+ 20304us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.526024 (+  4540us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:41.526698 (+   674us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.561483 (+ 34785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.561619 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.894901 (+333282us) raft_consensus.cc:1685] finished
0709 12:58:41.894925 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.895067 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1323,"prepare.queue_time_us":16569,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":5198,"raft.queue_time_us":38236,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":10581,"spinlock_wait_cycles":25150592,"thread_start_us":247045,"threads_started":1,"wal-append.queue_time_us":398776}
I20260709 12:58:41.942291  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:41.947897  1680 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:41.945604  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:41.953115  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:41.893332  2428 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:41.953819  1605 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
W20260709 12:58:41.956964  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:41.957465  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:41.957911  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:41.958227  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.957278  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:41.959203  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.960255  1497 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:41.965487  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:41.968225  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:41.941741  4280 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:41.943219  4480 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:41.952674  4523 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:42.001657  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.968906  1575 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:41.941530  4536 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:42.008903  3776 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:58:41.981405  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.998394  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 681) took 1107 ms. Trace:
I20260709 12:58:42.010046  2474 rpcz_store.cc:276] 0709 12:58:40.891382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.312058 (+420676us) service_pool.cc:224] Handling call
0709 12:58:41.312300 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.322692 (+ 10392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.322722 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.322764 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.322801 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.998070 (+675269us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540056b8d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:41.998132 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.998319 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23459072}
I20260709 12:58:42.011904  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:41.966691  4148 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:41.961859  4469 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:42.016738  2475 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:41.944520  4554 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:41.967121  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36924 (request call id 635) took 1153 ms. Trace:
I20260709 12:58:41.964905  4383 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:42.020424  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:42.028951  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 60817.9us
I20260709 12:58:41.942833  4477 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:41.974196  4526 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:41.985682  4480 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.120837  4480 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:42.122224  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 709) took 1357 ms. Trace:
I20260709 12:58:42.122664  2435 rpcz_store.cc:276] 0709 12:58:40.764364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.779359 (+ 14995us) service_pool.cc:224] Handling call
0709 12:58:42.121985 (+1342626us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540067a7d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:42.122161 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554377984}
I20260709 12:58:42.124145  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:41.903493  4446 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.125414  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.126889  1526 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:42.127920  4543 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:42.127995  4446 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:42.128636  2455 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:42.128012  4563 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:42.024551  4523 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.129884  4563 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.130657  4590 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.132130  4523 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.964833  4508 consensus_queue.cc:1059] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:58:42.085314  4554 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:42.133515  1608 raft_consensus.cc:2368] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:58:42.094904  4280 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:42.134981  4280 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:42.032001  4469 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.139365  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:41.967900  4519 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:58:42.031817  2428 rpcz_store.cc:276] 0709 12:58:40.813388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.816664 (+  3276us) service_pool.cc:224] Handling call
0709 12:58:41.962100 (+1145436us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":209}
I20260709 12:58:42.104648  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 637) took 1214 ms. Trace:
I20260709 12:58:42.104880  4470 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:42.051608  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.101277  4472 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:58:42.110462  4526 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:42.006338  4483 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 12:58:42.114936  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:42.216192  1525 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:42.115444  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.116117  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:42.217195  1532 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:42.217298  1530 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:42.218762  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.219636  1529 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
I20260709 12:58:42.118547  1602 raft_consensus.cc:2410] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:58:42.120395  4594 log.cc:927] Time spent T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:58:42.132194  4563 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:41.971472  4584 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 12:58:42.141445  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 108389us
W20260709 12:58:42.149085  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 401842us
I20260709 12:58:42.234653  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:42.235802  2342 leader_election.cc:336] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.672s (SENT)
I20260709 12:58:42.236078  1497 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:42.235991  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:42.005092  4607 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:42.187418  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 687) took 1294 ms. Trace:
I20260709 12:58:42.033478  4603 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:42.033618  4589 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:42.025604  4536 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.215137  4469 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:42.096596  4488 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:42.152884  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.237474  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.237821  2455 rpcz_store.cc:276] 0709 12:58:40.892838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.444734 (+551896us) service_pool.cc:224] Handling call
0709 12:58:42.128455 (+683721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.129080 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.187175 (+ 58095us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b540067a7d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:42.187337 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569933056}
I20260709 12:58:42.274547  1534 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:42.239919  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:42.244185  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:42.244613  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 224296us
I20260709 12:58:42.195315  4588 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:42.188107  4605 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:42.299968  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:42.301183  1608 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:42.254447  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.258028  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:42.212679  4383 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:42.100471  4148 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:42.271054  1530 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:42.277155  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:42.280589  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:42.319243  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.246583  4563 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:42.296372  2342 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:42.310920  1531 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:58:42.240598  4472 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:42.282171  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:42.320708  1601 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:42.321928  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:42.322649  1601 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:42.323643  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:42.328493  1498 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:42.332435  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:42.333335  1530 raft_consensus.cc:2393] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:42.336560  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.337419  1526 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:42.346572  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.335106  2342 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:42.297758  4521 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:42.356040  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.302109  4565 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:42.361362  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 84283.1us
I20260709 12:58:42.364677  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:42.366693  1575 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:42.166437  2451 rpcz_store.cc:276] 0709 12:58:40.952341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.323463 (+371122us) service_pool.cc:224] Handling call
0709 12:58:41.402048 (+ 78585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.916783 (+514735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.104302 (+187519us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54007571d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:42.104575 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178213120}
W20260709 12:58:42.369275  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.375228  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:42.375993  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 439825us
I20260709 12:58:42.367823  1498 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:42.382067  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:42.391043  2476 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:42.412748  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:42.407178  1572 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:42.432302  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 57157.4us
W20260709 12:58:42.375437  4454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.016s	sys 0.045s
I20260709 12:58:42.345911  4590 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:42.328989  2435 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:42.332540  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:42.364074  4546 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:42.370051  4607 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:42.435923  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:42.357980  4551 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:42.262257  4603 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:42.307984  4604 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:58:42.378049  4605 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:42.407271  1527 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:42.390265  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:42.380139  4524 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:42.384457  4596 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:42.405848  4563 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:42.328570  4383 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:42.441190  4454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.017s	sys 0.045s
I20260709 12:58:42.436059  4508 consensus_queue.cc:1059] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:58:42.501942  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.408340  4488 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:58:42.308431  4588 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.482263  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.482913  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.507721  1675 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:42.481887  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.521936  1676 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:42.523101  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.435112  4523 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.445437  4513 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:42.467672  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:42.509286  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.386044  4584 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:58:42.385978  4535 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:58:42.526149  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.449653  4540 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:42.525803  1683 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:42.446030  4483 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:42.454100  4606 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:42.454191  4551 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.526051  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:42.497790  4477 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:42.472487  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.592163  4483 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:42.598739  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2037) took 1714 ms. Trace:
I20260709 12:58:42.508800  4616 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:42.507050  4563 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.616477  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:42.618069  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.582892  1681 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:42.497974  4590 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:58:42.598620  4294 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:42.607869  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 158663us
I20260709 12:58:42.613476  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:42.614755  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:42.614866  4536 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:42.530061  4508 consensus_queue.cc:1243] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 3cabc5110903443ba3beb5cbb14afa91 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:42.609731  1604 rpcz_store.cc:276] 0709 12:58:40.971774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.016020 (+ 44246us) service_pool.cc:224] Handling call
0709 12:58:41.016368 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.016673 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:41.363576 (+346903us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.956519 (+592943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.972278 (+ 15759us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.972681 (+   403us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:42.327957 (+355276us) log.cc:844] Serialized 14 byte log entry
0709 12:58:42.361175 (+ 33218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.361266 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.522937 (+161671us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4800250158. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d68c1aa1 00007f25d68b8b37 00007f25d68b89ca 00007f25d69b026f 00007f25d69aff37 00007f25d69c455c 00007f25d69c4508 00007f25d69c4488 00007f25d69c4443 00007f25d69c36ec 00007f25d58eda96
0709 12:58:42.597460 (+ 74523us) raft_consensus.cc:1685] finished
0709 12:58:42.597491 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.598678 (+  1187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48285,"prepare.queue_time_us":347232,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":74,"raft.queue_time_us":97745,"raft.run_cpu_time_us":1485,"raft.run_wall_time_us":161670,"spinlock_wait_cycles":25913216,"thread_start_us":1155017,"threads_started":4,"wal-append.queue_time_us":341199}
I20260709 12:58:42.523428  4524 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:42.619868  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:42.646662  1681 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:42.626211  1677 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 2.
W20260709 12:58:42.637318  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.004s	sys 0.015s
I20260709 12:58:42.508288  4596 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.542659  4546 raft_consensus.cc:697] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:42.676003  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 62640.5us
I20260709 12:58:42.684734  1681 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:42.548079  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:42.597549  4551 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:42.526978  4148 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:42.686264  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 323575us
W20260709 12:58:42.656670  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.005s	sys 0.015s
W20260709 12:58:42.710620  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 753336us
I20260709 12:58:42.698626  1683 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:42.712042  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 269850us
I20260709 12:58:42.712649  1497 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:42.608347  4540 raft_consensus.cc:697] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:42.713827  4540 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.711887  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.632294  4563 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:42.704123  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 72102.6us
W20260709 12:58:42.697726  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 262956us
I20260709 12:58:42.607574  4606 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:42.726807  4606 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:42.712939  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.728554  1572 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:42.640518  4444 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.641884  4294 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:42.695276  4280 consensus_meta.cc:287] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.002s
I20260709 12:58:42.698918  4488 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:42.733716  4590 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:42.675395  4596 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:42.735268  4546 consensus_queue.cc:237] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:42.735531  1572 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:42.737403  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.738868  1497 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.759034  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:42.586220  4523 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.673507  4616 raft_consensus.cc:697] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:42.737926  4594 log.cc:927] Time spent T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:58:42.763638  1647 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:42.782493  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47113.6us
I20260709 12:58:42.783448  1647 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.783711  1572 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:42.740372  4536 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:42.752966  4508 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:42.762044  4543 consensus_meta.cc:287] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.005s
I20260709 12:58:42.788563  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.762396  4590 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:42.736171  4483 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.735692  4584 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:58:42.791457  1675 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:42.908767  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:42.906967  4624 log.cc:927] Time spent T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
W20260709 12:58:42.911063  4614 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:58:42.912192  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 690) took 1140 ms. Trace:
I20260709 12:58:42.913179  4584 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:42.907507  4508 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:42.913926  4617 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:58:42.914108  4508 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.914171  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:42.914577  4508 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:42.914829  1608 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:42.915266  4523 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:42.916420  4619 log.cc:927] Time spent T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 12:58:42.920141  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 693) took 1146 ms. Trace:
I20260709 12:58:42.920039  4616 consensus_queue.cc:237] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:42.922700  4625 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:58:42.788288  4633 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:42.920584  2461 rpcz_store.cc:276] 0709 12:58:41.773234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.904363 (+131129us) service_pool.cc:224] Handling call
0709 12:58:41.904693 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.911857 (+  7164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.911890 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.912377 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.101908 (+189531us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b18003e48e0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d15380d1 00007f25d1953a0f
0709 12:58:42.386551 (+284643us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:42.386597 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.386672 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.919847 (+533175us) raft_consensus.cc:1685] finished
0709 12:58:42.919865 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.920081 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":704,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":74405632,"thread_start_us":284438,"threads_started":1,"wal-append.queue_time_us":690473}
I20260709 12:58:42.768214  4605 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:42.748710  4444 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:42.900967  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:42.938323  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 154681us
I20260709 12:58:42.788439  4280 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.903318  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:42.797796  4488 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:42.906215  4611 log.cc:927] Time spent T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 12:58:42.799911  4532 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:42.896901  4469 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:42.903230  1604 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:42.912560  2421 rpcz_store.cc:276] 0709 12:58:41.772170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.772489 (+   319us) service_pool.cc:224] Handling call
0709 12:58:41.785146 (+ 12657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.813997 (+ 28851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.814032 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.817990 (+  3958us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.195322 (+377332us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:42.195367 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.195439 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.911975 (+716536us) raft_consensus.cc:1685] finished
0709 12:58:42.911996 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.912134 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28397,"raft.queue_time_us":30168,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3349,"thread_start_us":305238,"threads_started":1,"wal-append.queue_time_us":711435}
I20260709 12:58:42.776479  4618 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:58:42.874447  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 85978.5us
W20260709 12:58:42.929768  2344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.016s	sys 0.024s
W20260709 12:58:42.980084  2344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.016s	sys 0.025s
I20260709 12:58:42.981122  1647 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:42.982620  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.704361  4607 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:42.798070  4622 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:42.935912  1608 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
W20260709 12:58:42.901782  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 460) took 1333 ms (client timeout 1752 ms). Trace:
W20260709 12:58:42.947506  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 188543us
I20260709 12:58:42.901175  4536 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:42.970666  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:42.930032  4584 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:42.971371  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:42.987708  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:42.989149  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:42.969195  4480 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.000s
I20260709 12:58:42.939261  4558 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:42.939780  4603 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:42.959578  4523 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:42.852756  4524 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.959854  4488 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:42.984119  1602 rpcz_store.cc:269] 0709 12:58:41.568734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.568924 (+   190us) service_pool.cc:224] Handling call
0709 12:58:42.899365 (+1330441us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54001c4b54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:42.901715 (+  2350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1203357568}
I20260709 12:58:42.977133  4532 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.991295  2344 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:43.000386  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.003631  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.982666  4383 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:42.991413  4588 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.012145  2344 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:42.968283  4280 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:42.907313  4294 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:43.059638  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:43.062878  2421 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:43.027160  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:43.020018  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.035161  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:43.002988  4469 raft_consensus.cc:2764] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:58:43.038678  1647 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:43.070740  1526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.000s	sys 0.017s
W20260709 12:58:43.071384  1526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.000s	sys 0.017s
I20260709 12:58:43.011857  4488 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:43.072619  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 60526.9us
I20260709 12:58:42.939596  4633 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:42.967924  4590 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.009019  4583 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:43.014173  4532 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:42.996272  4536 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.034123  4513 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.101413  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.019497  4543 raft_consensus.cc:2764] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:42.996769  4637 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:58:43.074751  2344 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:43.126842  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:42.999836  4480 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.128684  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.095808  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:43.097790  4294 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:43.015200  4523 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.158718  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:43.085470  4148 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:43.157992  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:43.099109  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:43.160518  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 85986.8us
W20260709 12:58:43.161485  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 122889us
I20260709 12:58:43.185009  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.186115  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:43.186282  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 197106us
I20260709 12:58:43.157227  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.101894  4588 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:58:43.193291  2421 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:43.193096  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:43.195596  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.202451  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.202720  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.225114  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.225967  1647 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:43.226064  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.161478  4583 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:43.228193  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:43.236927  1647 leader_election.cc:400] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:43.237407  1647 leader_election.cc:403] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:43.193125  4526 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:43.185986  4550 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:43.129107  4513 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:43.235910  4558 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.236166  4607 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:43.108624  4584 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:43.247604  4647 log.cc:927] Time spent T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:58:43.184356  4644 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:43.197999  4618 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:43.280535  4618 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:43.254376  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 58841.1us
W20260709 12:58:43.260563  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.261108  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.261971  4469 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:43.100515  4605 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.229727  4648 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:43.304322  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.277921  4666 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:43.281702  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.252138  4526 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:43.305459  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 81208.8us
I20260709 12:58:43.305074  1526 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 3.
I20260709 12:58:43.311568  2344 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:43.233659  4622 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:58:43.313400  2344 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:43.311946  4526 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:43.316347  4651 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:58:43.317770  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.317786  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.292970  4444 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.339392  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.341465  1526 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:43.266378  4558 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:43.304803  4648 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:43.350073   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:43.270156  4607 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:43.346637  4596 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.003s
I20260709 12:58:43.369436  4607 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.369825  4640 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:43.370042  4663 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:43.370988  4652 log.cc:927] Time spent T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 12:58:43.422741  4508 consensus_meta.cc:287] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.003s
I20260709 12:58:43.373765  4664 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
W20260709 12:58:43.377509  4655 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:58:43.426054  4470 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:43.426482  4470 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:43.427721  4470 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:43.429207  4470 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:43.378465  4643 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:43.382072  4629 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 12:58:43.389865  4280 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.392967  1526 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:43.338228  4469 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:43.353642  4666 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:43.413983  4523 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.415719  4558 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.418042  4667 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.462929  4536 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.423223  4508 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:43.392588  4472 consensus_meta.cc:287] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.058s	user 0.012s	sys 0.000s
I20260709 12:58:43.366214  4648 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:43.468195  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 154892us
I20260709 12:58:43.491305  2344 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:43.466801  4633 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.496222  4540 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:43.506668  4526 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.486835  4472 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:43.470396  4480 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.469172  4664 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:43.508651  4513 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.511250  4508 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.511598  4618 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:43.500576  4663 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:58:43.467199  4523 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:43.468187  4543 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:43.523823  1530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.009s	sys 0.009s
W20260709 12:58:43.574944  1530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.009s	sys 0.009s
I20260709 12:58:43.412317  4596 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:43.524196  1682 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.005s	sys 0.014s
W20260709 12:58:43.578310  1682 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.005s	sys 0.014s
W20260709 12:58:43.578516  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 239196us
I20260709 12:58:43.462977  4667 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.533702  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 703) took 1255 ms. Trace:
I20260709 12:58:43.584020  1600 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:43.583734  2455 rpcz_store.cc:276] 0709 12:58:42.279002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.279122 (+   120us) service_pool.cc:224] Handling call
0709 12:58:42.279450 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.285184 (+  5734us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:42.285229 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.317044 (+ 31815us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.657287 (+340243us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:42.657355 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.657459 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.533388 (+875929us) raft_consensus.cc:1685] finished
0709 12:58:43.533420 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.533621 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14055,"raft.queue_time_us":5427,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":17498,"thread_start_us":286738,"threads_started":1,"wal-append.queue_time_us":676114}
I20260709 12:58:43.572872  1532 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:43.579344  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.612519  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:43.613500  2455 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:43.573992  4540 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.615813  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.530009  4488 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.576574  4554 raft_consensus.cc:3055] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:43.620042  1602 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:58:43.627730  2339 leader_election.cc:336] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.672s (SENT)
I20260709 12:58:43.628434  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:43.634039  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 54765us
I20260709 12:58:43.610327  4640 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:43.612675  4506 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:43.621991  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 385201us
I20260709 12:58:43.621439  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.588069  4513 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.632489  4663 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:43.641916  1532 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:43.625716  4554 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:43.580363  4543 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.697018  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:43.697438  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:43.685289  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:43.674489  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:43.637502  4616 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:43.717605  1678 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:43.717748  1677 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:43.717895  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.723412  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:43.719158  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:43.724414  1681 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:43.720106  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 46619.3us
I20260709 12:58:43.623620  4532 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.724663  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:43.719120  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:43.719069  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.725903  1677 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:43.726755  1532 raft_consensus.cc:2393] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:43.727411  4532 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.727658  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.728197  1528 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:43.728416  1676 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:58:43.730822  1647 leader_election.cc:400] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
W20260709 12:58:43.731467  1679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.018s	sys 0.064s
I20260709 12:58:43.672530  4605 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:43.733649  1679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.018s	sys 0.064s
I20260709 12:58:43.642683  4506 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:43.625519  4540 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.737646  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1869) took 1254 ms. Trace:
I20260709 12:58:43.749639  1679 rpcz_store.cc:276] 0709 12:58:42.483184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.522936 (+ 39752us) service_pool.cc:224] Handling call
0709 12:58:42.523254 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.706392 (+183138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.706423 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.709394 (+  2971us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.979351 (+269957us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:43.736895 (+757544us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.737312 (+   417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.737392 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.737430 (+    38us) raft_consensus.cc:1685] finished
0709 12:58:43.737442 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.737588 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25184,"prepare.queue_time_us":282686,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":73417,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9276,"thread_start_us":1096375,"threads_started":3,"wal-append.queue_time_us":335784}
I20260709 12:58:43.741288  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:43.743999  1603 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:43.744097  1600 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:43.650890  4663 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:43.753149  1603 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:43.747864  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:43.757982  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:43.760412  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:43.761126  1532 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:43.761652  1679 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:43.729802  4643 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:43.765216  1647 connection.cc:256] RPC call timeout handler was delayed by -1.29601686999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
I20260709 12:58:43.767881  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:43.737452  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:43.777817  1601 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.773891  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:43.767501  1603 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.673063  4513 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:43.781788  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.785950  2451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:43.786829  2451 raft_consensus.cc:606] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.788906  2451 raft_consensus.cc:614] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:43.789242  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:43.789767  1532 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:43.792106  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:43.793134  1601 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:43.760316  4616 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:43.799880  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:43.800806  1606 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:43.801649  1681 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:43.767848  4483 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:43.784499  4563 consensus_meta.cc:287] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.063s	user 0.014s	sys 0.000s
I20260709 12:58:43.770895  4636 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:43.824594  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:43.826220  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1863) took 1711 ms. Trace:
I20260709 12:58:43.648201  4640 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.826803  1531 rpcz_store.cc:276] 0709 12:58:42.114728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.116619 (+  1891us) service_pool.cc:224] Handling call
0709 12:58:42.116952 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.320347 (+203395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.825857 (+1505510us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000c80d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:43.826139 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445166848}
I20260709 12:58:43.837471  1679 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:43.789484  4526 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:43.807528  4661 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 12:58:43.747371  4605 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.854945  1680 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:43.855924  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1863) took 1376 ms. Trace:
I20260709 12:58:43.856359  1680 rpcz_store.cc:276] 0709 12:58:42.479870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.509064 (+ 29194us) service_pool.cc:224] Handling call
0709 12:58:43.854194 (+1345130us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b58000e6a98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:58:43.854485 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.855569 (+  1084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.855847 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2407168}
I20260709 12:58:43.807492  4662 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.789989  4472 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:58:43.870132  4506 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.772794  4554 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:43.881294  4596 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.886181  4683 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:43.878911  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 236183us
I20260709 12:58:43.757105  4524 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:43.887056  4683 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:43.820820  4563 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:43.890817  4657 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:58:43.854053  4526 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:43.898785  1529 raft_consensus.cc:2368] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8.
I20260709 12:58:43.835803  4483 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.888202  4596 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:43.895267  4645 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.907459  4683 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:43.907856  4659 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:58:43.895190  4524 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.908413  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1868) took 1792 ms. Trace:
W20260709 12:58:43.909170  4680 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:58:43.910013  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1872) took 1771 ms. Trace:
W20260709 12:58:43.911850  4679 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:58:43.914817  4674 log.cc:927] Time spent T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260709 12:58:43.908373  4639 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:43.899358  4488 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.916216  1533 rpcz_store.cc:276] 0709 12:58:42.116398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.117143 (+   745us) service_pool.cc:224] Handling call
0709 12:58:42.117431 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.523710 (+406279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.523740 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.523779 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:42.523816 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.908176 (+1384360us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b540010ac54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:43.908222 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.908351 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933909888}
W20260709 12:58:43.923898  4671 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 12:58:43.927817  4623 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 1.189s	user 0.002s	sys 0.001s
I20260709 12:58:43.925753  1527 rpcz_store.cc:276] 0709 12:58:42.138766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.149712 (+ 10946us) service_pool.cc:224] Handling call
0709 12:58:42.295949 (+146237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.465730 (+169781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.909788 (+1444058us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b54003ae654. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:43.909949 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217007360}
I20260709 12:58:43.903813  4667 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:43.935173  4670 log.cc:927] Time spent T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:58:43.939879  1647 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.043s (SENT)
I20260709 12:58:43.893486  4675 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.247s
I20260709 12:58:43.871537  4663 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.880316  4662 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:43.913652  4526 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:43.096158  4565 consensus_queue.cc:1175] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3cabc5110903443ba3beb5cbb14afa91" responder_term: 7 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: [6.4-6.4]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:58:44.098397  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 625) took 1435 ms (client timeout 1516 ms). Trace:
W20260709 12:58:44.034627  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 2047) took 1801 ms (client timeout 1789 ms). Trace:
W20260709 12:58:44.120069  1528 rpcz_store.cc:269] 0709 12:58:42.662918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.946050 (+283132us) service_pool.cc:224] Handling call
0709 12:58:44.098100 (+1152050us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54000c7bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:44.098313 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708795648}
W20260709 12:58:44.199486  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.038411  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 667) took 2103 ms. Trace:
I20260709 12:58:44.215390  4664 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:44.170742  1559 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:38115 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:38115 timed out after 15.000s (SENT)
I20260709 12:58:44.202266  2476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:44.055043  4637 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:44.036435  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 666) took 2101 ms. Trace:
W20260709 12:58:44.099216  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 1929) took 2245 ms (client timeout 2043 ms). Trace:
I20260709 12:58:44.263751  2455 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:44.262488  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:44.207868  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 610) took 1916 ms. Trace:
I20260709 12:58:44.070075  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 614) took 1764 ms. Trace:
W20260709 12:58:44.175812  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 1874) took 1691 ms (client timeout 1559 ms). Trace:
I20260709 12:58:43.923935  4540 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:44.208734  1676 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:44.266513  1603 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:44.261255  1674 rpcz_store.cc:276] 0709 12:58:41.935204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.942413 (+  7209us) service_pool.cc:224] Handling call
0709 12:58:41.942691 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.436490 (+493799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.436536 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:43.424906 (+988370us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b2c000aacf8. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d0291a11 00007f25d02a1372 00007f25d19d3a01 00007f25d199843a 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2
0709 12:58:43.425294 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 12:58:43.635717 (+210423us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:43.635751 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.635816 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.038040 (+402224us) raft_consensus.cc:1685] finished
0709 12:58:44.038064 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.038329 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12867,"raft.queue_time_us":159132,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":50732800,"thread_start_us":688020,"threads_started":2,"wal-append.queue_time_us":342350}
I20260709 12:58:43.918200  4583 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:44.291304  1675 rpcz_store.cc:269] 0709 12:58:42.484667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.521704 (+ 37037us) service_pool.cc:224] Handling call
0709 12:58:44.175586 (+1653882us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540045bfd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:44.175720 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569750784}
I20260709 12:58:44.280165  2476 raft_consensus.cc:606] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:44.303831  2476 raft_consensus.cc:614] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:44.114045  4567 log.cc:927] Time spent T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 1.792s	user 0.005s	sys 0.006s
W20260709 12:58:43.995730  4551 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.253s	user 0.004s	sys 0.008s
W20260709 12:58:44.291155  1607 rpcz_store.cc:269] 0709 12:58:41.853536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.858039 (+  4503us) service_pool.cc:224] Handling call
0709 12:58:44.098926 (+2240887us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001d0454. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:44.099072 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2869733632}
I20260709 12:58:44.293991  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.292874  1525 rpcz_store.cc:276] 0709 12:58:42.305679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.378097 (+ 72418us) service_pool.cc:224] Handling call
0709 12:58:42.439019 (+ 60922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.586657 (+147638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.586685 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.586724 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:42.586758 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.069709 (+1482951us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000c67d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:44.069771 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.069993 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338940160}
I20260709 12:58:44.292137  1682 rpcz_store.cc:276] 0709 12:58:41.934926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.941633 (+  6707us) service_pool.cc:224] Handling call
0709 12:58:41.941917 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.303231 (+361314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.303279 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.316401 (+ 13122us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.782145 (+465744us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:43.578662 (+796517us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.578900 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.035964 (+457064us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54001f7f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:44.036018 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.036068 (+    50us) raft_consensus.cc:1685] finished
0709 12:58:44.036171 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.036360 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71361,"prepare.queue_time_us":478147,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":6067,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":43067,"spinlock_wait_cycles":829867264,"thread_start_us":1056886,"threads_started":2,"wal-append.queue_time_us":1005107}
W20260709 12:58:44.035995  4648 consensus_meta.cc:287] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.003s
I20260709 12:58:44.002475  4605 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:43.957032  4639 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.986817  4608 raft_consensus.cc:3055] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:58:44.259543  1605 rpcz_store.cc:269] 0709 12:58:42.233243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.233385 (+   142us) service_pool.cc:224] Handling call
0709 12:58:44.034193 (+1800808us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b5400256cd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:44.034390 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162881792}
I20260709 12:58:43.988579  4524 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.324373  2451 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:44.303242  1530 rpcz_store.cc:276] 0709 12:58:42.291578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.355227 (+ 63649us) service_pool.cc:224] Handling call
0709 12:58:42.406327 (+ 51100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.526722 (+120395us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:43.005722 (+479000us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.575502 (+569780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.575572 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:43.575640 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.207566 (+631926us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003f70d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:44.207626 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.207796 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":329892,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":2674,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":27884,"spinlock_wait_cycles":276310912,"thread_start_us":987158,"threads_started":2,"wal-append.queue_time_us":627806}
I20260709 12:58:44.003204  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 1909) took 1293 ms. Trace:
W20260709 12:58:44.309774  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.313457  1500 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:44.056341  4523 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.035422  4636 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.291818  4637 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:44.202740  4590 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:43.993527  4513 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.146116  4526 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.238086  4470 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:44.259045  4543 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.990895  4563 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:43.992596  4483 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.185824  4607 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:44.215288  4554 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:44.309103  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:44.328670  1529 rpcz_store.cc:276] 0709 12:58:42.710219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.224834 (+514615us) service_pool.cc:224] Handling call
0709 12:58:44.002487 (+777653us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540010a754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:44.003138 (+   651us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547331840}
W20260709 12:58:44.157999  4615 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 1.516s	user 0.000s	sys 0.004s
I20260709 12:58:44.338688  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:44.391484  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 52875.5us
I20260709 12:58:44.355070  4636 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.392894  4454 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:43.916180  4645 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:44.145102  4662 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.347791  1603 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:44.315429  4469 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:44.370540  4444 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:44.373973  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:43.989737  4640 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.320006  4639 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:44.291517  4664 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:44.375979  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 651) took 1355 ms. Trace:
I20260709 12:58:44.403963  4444 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:44.410837  4609 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:58:44.333945  4616 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:44.411145  4488 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:58:44.316764  4477 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:44.384109  2451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:44.385819  4470 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:44.387363  4663 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:44.400254  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 460382us
I20260709 12:58:44.442509  4622 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:44.348094  4294 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.404366  1675 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:44.337599  4608 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:44.396214  4645 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:44.317781  4551 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.315179  4644 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:44.313449  4583 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.410838  4444 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.409974  2461 rpcz_store.cc:276] 0709 12:58:43.020413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.025272 (+  4859us) service_pool.cc:224] Handling call
0709 12:58:43.025810 (+   538us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:43.215242 (+189432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.215280 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:43.225158 (+  9878us) log.cc:844] Serialized 52 byte log entry
0709 12:58:43.466365 (+241207us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:43.466407 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.466473 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.375737 (+909264us) raft_consensus.cc:1685] finished
0709 12:58:44.375759 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.375921 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5801,"raft.queue_time_us":132272,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":56485,"thread_start_us":378969,"threads_started":2,"wal-append.queue_time_us":395445}
I20260709 12:58:44.317045  4648 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:44.338140  4523 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.406327  4483 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:44.418386  2451 raft_consensus.cc:606] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:44.464452  1675 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:44.464557  2451 raft_consensus.cc:614] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:44.421957  4664 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:44.422612  4477 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.405992  4469 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.442932  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.468556  2455 raft_consensus.cc:2410] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:44.404284  4607 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.448518  4622 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.454754  4551 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:44.455377  2421 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:44.456246  4644 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.482118  1677 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:58:44.482700  1677 pending_rounds.cc:85] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 5
I20260709 12:58:44.482981  1677 pending_rounds.cc:107] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:58:44.483265  1677 raft_consensus.cc:2889] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:44.413959  4616 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:44.415449  4636 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.464721  4609 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:44.475993  4470 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:44.500396  1604 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:44.458115  4294 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:44.494410  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.006s	sys 0.063s
W20260709 12:58:44.505541  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.007s	sys 0.063s
I20260709 12:58:44.419116  4637 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.496433  4645 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.536665  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:44.537402  1677 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:44.537432  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:44.539440  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:44.540575  1680 raft_consensus.cc:2410] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:44.543810  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:44.545174  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:58:44.545885  1604 raft_consensus.cc:606] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:44.546241  1604 raft_consensus.cc:614] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:44.547317  1678 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:44.544173  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:44.548007  1679 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:44.549034  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:44.551154  1572 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:44.554769  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.011s	sys 0.009s
W20260709 12:58:44.555338  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.011s	sys 0.009s
I20260709 12:58:44.556547  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:44.556936  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:44.557523  1675 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:44.559281  1675 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:44.557153  1676 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:58:44.559365  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:44.561021  1675 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:44.477159  4608 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:44.565659  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.526540  4618 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:58:44.552868  4526 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:44.556077  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 731564us
I20260709 12:58:44.555027  4524 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.554984  4513 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:44.555358  4605 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.502102  4609 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.548995  4645 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:44.561941  4584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.005s	sys 0.013s
W20260709 12:58:44.585498  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.023s	sys 0.018s
W20260709 12:58:44.585963  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.023s	sys 0.018s
W20260709 12:58:44.586398  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 781666us
W20260709 12:58:44.594496  1526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.082s	user 0.006s	sys 0.017s
W20260709 12:58:44.595299  1526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.006s	sys 0.017s
I20260709 12:58:44.575461  4526 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:44.591660  4584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.006s	sys 0.014s
W20260709 12:58:44.600106  1602 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.000s	sys 0.022s
I20260709 12:58:44.604259  1677 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:44.580441  4513 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.576251  1575 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:44.612155  1498 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:44.584105  4636 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.584323  4639 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:44.584192  4605 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:44.694135  2344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.017s	sys 0.040s
W20260709 12:58:44.734967  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.794466  2344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.021s	sys 0.051s
W20260709 12:58:44.717021  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.020s	sys 0.041s
W20260709 12:58:44.741076  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.659250  2421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:44.585273  4608 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:44.796237  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.027s	sys 0.046s
W20260709 12:58:44.621613  1602 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.000s	sys 0.023s
W20260709 12:58:44.737118  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.585489  4524 raft_consensus.cc:697] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:44.797240  2421 raft_consensus.cc:606] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:44.830649  2421 raft_consensus.cc:614] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:44.659847  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.017s	sys 0.021s
W20260709 12:58:44.831120  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.019s	sys 0.028s
W20260709 12:58:44.830204  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.822714  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 467248us
W20260709 12:58:44.716136  4558 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.011s	sys 0.031s
W20260709 12:58:44.838871  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 262692us
I20260709 12:58:44.659149  4454 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:44.845105  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 233008us
I20260709 12:58:44.614722  4526 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.621832  4513 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.656328  4616 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:44.651880  4523 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:44.799883  4658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.000s	sys 0.016s
W20260709 12:58:44.867937  4658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.000s	sys 0.016s
I20260709 12:58:44.823381  4551 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:44.772873  4697 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.720498  4644 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.655122  4607 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.673519  4294 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.646252  4583 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:44.734612  4609 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.655256  4477 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:44.838689  4558 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.018s	sys 0.038s
I20260709 12:58:44.652596  4469 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:44.799965  4546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.003s	sys 0.012s
I20260709 12:58:44.754671  4645 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:44.842099  4606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.007s	sys 0.059s
I20260709 12:58:44.759876  4444 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.864885  4688 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.864529  4524 consensus_queue.cc:237] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:44.836331  4636 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:44.645453  4691 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.251s
I20260709 12:58:44.858635  4584 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.871408  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:44.918120  2455 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:44.846256  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.880674  4641 consensus_queue.cc:1059] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:58:44.924232  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:44.859464  4506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.012s	sys 0.013s
I20260709 12:58:44.875484  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:44.874187  1498 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:44.856858  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.928143  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.928678  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.882706  4697 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:44.930907  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56825.5us
I20260709 12:58:44.890023  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.932456  2461 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:44.890920  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.891867  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.892720  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.894521  2475 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:44.938207  2455 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:44.939301  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.896643  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1918) took 1675 ms. Trace:
I20260709 12:58:44.904119  2451 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:44.927727  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 387448us
I20260709 12:58:44.848603  4698 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:44.838608  4543 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:58:44.910140  4607 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:44.913026  4546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.003s	sys 0.012s
W20260709 12:58:44.913298  4606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.007s	sys 0.060s
I20260709 12:58:44.858202  4148 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:44.910166  4583 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:44.860131  4454 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.923130  1529 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:44.923418  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:44.668334  4622 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.924928  1533 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:44.957387  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.879236  4551 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.935262  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:44.922597  4563 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:58:44.926427  4506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.012s	sys 0.013s
I20260709 12:58:44.948114  1530 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:44.939379  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.916532  4688 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.940294  1526 rpcz_store.cc:276] 0709 12:58:43.221054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.464056 (+243002us) service_pool.cc:224] Handling call
0709 12:58:43.464538 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:43.464822 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.464858 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:43.468146 (+  3288us) log.cc:844] Serialized 26 byte log entry
0709 12:58:44.604284 (+1136138us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:44.604328 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.604394 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.896388 (+291994us) raft_consensus.cc:1685] finished
0709 12:58:44.896413 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.896573 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1091417,"threads_started":1,"wal-append.queue_time_us":1351430}
I20260709 12:58:44.940086  2475 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:44.975131  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.976898  1608 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:44.976287  2475 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:44.920173  4584 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:44.953934  1525 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:44.953680  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:44.998006  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:44.998888  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:45.000138  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:45.001338  1534 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:44.956112  1498 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:44.930552  4662 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:44.934896  4645 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:44.966102  2455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:45.007372  2455 raft_consensus.cc:606] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:45.007851  2455 raft_consensus.cc:614] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:44.958245  2451 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:44.979975  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:44.934747  4565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.029s	sys 0.021s
I20260709 12:58:44.985117  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:45.010917  1679 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:44.987224  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:45.012074  1678 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:58:45.013484  2476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.043s
I20260709 12:58:44.929132  4691 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:58:45.002409  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 46418.3us
W20260709 12:58:45.013916  2476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.014s	sys 0.043s
I20260709 12:58:44.963740  4698 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:45.022425  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:45.028632  1605 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:45.024708  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.030694  1601 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
W20260709 12:58:45.031611  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.032907  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.033839  1601 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:44.964761  4563 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:45.041527  4444 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:45.014760  4565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.029s	sys 0.022s
I20260709 12:58:44.957752  4583 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:45.007282  4589 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.017s	sys 0.038s
W20260709 12:58:45.061318  4589 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.017s	sys 0.038s
I20260709 12:58:45.061913  2423 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:45.063174  4700 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:58:45.053910  4637 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:45.064488  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1881) took 1367 ms. Trace:
I20260709 12:58:45.042624  4698 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.064893  1683 rpcz_store.cc:276] 0709 12:58:43.697243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.697358 (+   115us) service_pool.cc:224] Handling call
0709 12:58:43.697683 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:43.698042 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.698074 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:43.751748 (+ 53674us) log.cc:844] Serialized 26 byte log entry
0709 12:58:44.831645 (+1079897us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:44.831703 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.831795 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:45.064284 (+232489us) raft_consensus.cc:1685] finished
0709 12:58:45.064303 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.064428 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32951,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":24346,"thread_start_us":1041695,"threads_started":1,"wal-append.queue_time_us":1137064}
I20260709 12:58:45.000535  4644 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:58:45.067301  4698 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.056411  4648 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.058714  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2058) took 1316 ms. Trace:
I20260709 12:58:45.068845  2428 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:45.012832  4294 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:45.060400  4697 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.068797  1608 rpcz_store.cc:276] 0709 12:58:43.742297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.742440 (+   143us) service_pool.cc:224] Handling call
0709 12:58:43.742945 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:44.978152 (+1235207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.058472 (+ 80320us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54004079d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:45.058655 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836450688}
I20260709 12:58:45.025611  4605 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:44.954520  4607 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.016260  4609 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:45.005575  4641 consensus_queue.cc:1059] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 12:58:45.075506  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 228744us
I20260709 12:58:45.098459  1605 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:45.037914  4148 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:45.103085  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:45.025940  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:45.103812  1531 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:45.104687  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 94629.9us
I20260709 12:58:45.082276  4644 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.099447  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:45.100823  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:45.011193  4662 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.111212  1533 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:45.073479  4294 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.041397  4454 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.109460  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:45.107568  1526 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:45.118651  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:45.072122  4563 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:45.125639  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:45.126222  1530 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:45.094427  4444 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:45.078992  4543 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 12:58:45.122562  4663 consensus_meta.cc:287] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.001s
I20260709 12:58:45.107357  4588 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.103820  4546 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.114115  4618 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:45.117694  4294 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.124495  4454 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.136965  4590 consensus_meta.cc:287] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.764s	user 0.008s	sys 0.005s
I20260709 12:58:45.094429  4609 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.179682  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:45.180392  1532 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:45.181269  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:45.168787  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.181881  1605 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:45.169839  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2056) took 1428 ms. Trace:
I20260709 12:58:45.183480  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:45.184087  1600 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:45.185438  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.188163  1609 raft_consensus.cc:2410] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:45.188957  1605 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:45.156737  4563 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:45.182358  1602 rpcz_store.cc:276] 0709 12:58:43.741491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.744350 (+  2859us) service_pool.cc:224] Handling call
0709 12:58:43.771065 (+ 26715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.771293 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:44.826879 (+1055586us) log.cc:844] Serialized 14 byte log entry
0709 12:58:45.169357 (+342478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:45.169437 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:45.169507 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.169621 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.169772 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1052746,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":5469,"thread_start_us":1379846,"threads_started":2}
I20260709 12:58:45.153685  4618 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:45.123230  4148 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.123807  4644 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.188138  4636 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:45.193501  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 252157us
I20260709 12:58:45.138208  4444 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:45.206512  1498 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:45.209798  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:45.162395  2435 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:58:45.212076  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:45.212775  1683 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:45.191093  4690 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.172864  4663 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:58:45.157603  4588 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.205049  4618 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:45.232977  1527 raft_consensus.cc:2410] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:45.175617  4454 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:45.231724  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:45.226600  1530 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:45.157305  4546 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:45.208636  4699 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.218385  4551 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.216377  4605 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.210217  4622 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:45.242252  4688 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.227809  4690 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.266160  4688 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:45.264007  4588 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.263983  4583 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:45.266819  4688 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.267542  4583 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.218283  4584 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.217777  4692 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.269110  4690 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.265166  4590 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:58:45.225431  4697 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:58:45.218047  4565 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:45.241475  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.257071  4695 raft_consensus.cc:3055] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:45.258885  4148 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.244001  4444 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.255390  4644 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.233014  4543 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.271641  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.270769  4607 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.277803  4605 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.307372  1600 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:45.319068  4551 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:45.329267  4551 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:45.296828  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.331951   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:45.332453  1677 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:45.233726  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:45.334885  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 101238us
I20260709 12:58:45.338027  1603 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:58:45.338502  1603 pending_rounds.cc:85] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 6
I20260709 12:58:45.338754  1603 pending_rounds.cc:107] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:58:45.339005  1603 raft_consensus.cc:2889] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:45.337393  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 488) took 2431 ms (client timeout 2472 ms). Trace:
I20260709 12:58:45.341956   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:45.341779  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:45.340842  1609 rpcz_store.cc:269] 0709 12:58:42.908349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.908477 (+   128us) service_pool.cc:224] Handling call
0709 12:58:45.337194 (+2428717us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b54001d0954. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:45.337337 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5233143168}
W20260709 12:58:45.345537  2342 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.472s (SENT)
I20260709 12:58:45.346022  2342 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:45.275978  4565 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.351476  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:45.269551  4688 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:45.353619  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.269593  4692 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.353668  4551 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:45.281826  4699 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.356170  2421 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:45.279711  4695 raft_consensus.cc:740] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:45.250161  4662 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.362401  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.256945  4454 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.291950  4636 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:45.273489  2435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 722) took 1596 ms (client timeout 1916 ms). Trace:
I20260709 12:58:45.333382  4546 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.292444  4697 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:45.243359  4513 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:45.265055  4609 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.364866  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.365768  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:45.363041  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:45.371131  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.345181  4690 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:45.388531  1647 leader_election.cc:336] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.653s (SENT)
I20260709 12:58:45.436024  1647 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:45.389253  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.366209  2428 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:45.389652  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.359127  4565 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:45.284446  4543 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.399233  2461 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:45.276306  4622 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.269141  4583 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.362355  4590 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.350714  4607 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:58:45.418256  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 490829us
I20260709 12:58:45.394232  4469 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.367884  2435 rpcz_store.cc:269] 0709 12:58:43.677511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.695285 (+ 17774us) service_pool.cc:224] Handling call
0709 12:58:45.273248 (+1577963us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54006ed7d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:45.273398 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3155813248}
I20260709 12:58:45.398401  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:45.476049  1605 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.434593  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.480721  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.482537  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:45.483074  2451 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:45.485067  1497 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:45.434650  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71676.8us
I20260709 12:58:45.483163  1603 raft_consensus.cc:2376] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8. Re-sending same reply.
I20260709 12:58:45.396837  4697 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:45.456631  4558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.027s	sys 0.060s
I20260709 12:58:45.472016  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:45.438720  4662 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:45.435704  4690 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.567304  4690 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.568085  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:45.387583  4636 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.487565  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.490065  4546 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:45.491101  4639 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.494107  4477 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:45.495178  4707 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:58:45.498519  4692 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.504966  1605 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:45.421705  4695 consensus_queue.cc:260] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:45.440070  4699 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:45.511081  4622 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.517004  1428 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:45.522926  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:45.523201  4583 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.524197  4513 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:45.525048  4605 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.526214  1527 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:45.524991  1429 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40874 (request call id 352) took 17949 ms (client timeout 15000 ms). Trace:
I20260709 12:58:45.528033  4469 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:45.529420  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:45.467062  4608 consensus_meta.cc:287] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
W20260709 12:58:45.534628  4558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.028s	sys 0.061s
I20260709 12:58:45.573801  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:45.961040  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.012s
I20260709 12:58:46.044734  1603 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
W20260709 12:58:46.046021  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.021s	sys 0.019s
I20260709 12:58:46.034703  4733 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.714216  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:45.859356  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.044780  1526 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
W20260709 12:58:45.905196  1604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.016s	sys 0.025s
W20260709 12:58:45.861033  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.961211  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.965749  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.019s
W20260709 12:58:46.033686  2461 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.008s	sys 0.012s
I20260709 12:58:45.464108  4715 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:46.051275  2461 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.009s	sys 0.012s
W20260709 12:58:46.050061  1604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.017s	sys 0.028s
I20260709 12:58:46.059428  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:45.851075  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:45.712363  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 495018us
W20260709 12:58:46.060233  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 537349us
I20260709 12:58:46.060384  2455 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:46.060773  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.061515  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.048560  2451 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
W20260709 12:58:46.000167  2476 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.016s	sys 0.011s
W20260709 12:58:46.063645  2476 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.016s	sys 0.012s
W20260709 12:58:46.033913  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 645351us
W20260709 12:58:46.065125  1647 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.710s (SENT)
I20260709 12:58:45.894223  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:46.054353  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.009s	sys 0.020s
I20260709 12:58:46.044016  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.076411  2474 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:46.047338  4733 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:45.753211  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.049507  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.015s	sys 0.014s
W20260709 12:58:46.096374  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.059562  1601 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
W20260709 12:58:45.603930  4526 consensus_meta.cc:287] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.000s
W20260709 12:58:46.035259  4294 consensus_meta.cc:287] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.003s
I20260709 12:58:45.963045  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.077859  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.081096  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:46.035136  4637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.008s	sys 0.013s
W20260709 12:58:45.981094  4716 log.cc:927] Time spent T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:58:45.775615  4618 consensus_meta.cc:287] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
W20260709 12:58:46.020462  4722 log.cc:927] Time spent T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:58:46.062376  1428 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 3 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:46.095844  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.015s	sys 0.015s
I20260709 12:58:46.143097  1428 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:46.063115  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.097396  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:46.146183  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 48897.4us
W20260709 12:58:46.146548  4727 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:58:46.147454  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:46.148923  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:46.098394  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.149701  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.150563  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.150869  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:46.151471  1602 raft_consensus.cc:2368] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8.
I20260709 12:58:46.151640  1607 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:46.152402  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.153440  4608 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:46.154024  4608 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.154484  4608 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:46.154824  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.155400  1601 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:46.156162  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.156868  1601 raft_consensus.cc:2410] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:46.157162  4607 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:46.097419  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.157459  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:46.157846  2451 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:46.158221  1526 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:46.158468  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2069) took 1139 ms. Trace:
I20260709 12:58:46.159339  1532 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:46.077446  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:46.158838  1604 rpcz_store.cc:276] 0709 12:58:45.019066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.019199 (+   133us) service_pool.cc:224] Handling call
0709 12:58:45.019492 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.133737 (+114245us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:58:45.153339 (+ 19602us) log.cc:844] Serialized 14 byte log entry
0709 12:58:46.076686 (+923347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.076742 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:46.076799 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.158255 (+ 81456us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400255dd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:46.158298 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.158416 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16577,"prepare.queue_time_us":23359,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":28192,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8568,"spinlock_wait_cycles":262156032,"thread_start_us":906421,"threads_started":1}
I20260709 12:58:46.160337  1605 raft_consensus.cc:2393] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:46.161144  1604 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:45.901630  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.034756  4697 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:45.699900  4662 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:46.112190  1603 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:46.089027  4622 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:45.483492  4590 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.076759  4543 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.180148  1600 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:46.106878  4526 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.113234  4294 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:46.051393  1429 rpcz_store.cc:269] 0709 12:58:27.576083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.576421 (+   338us) service_pool.cc:224] Handling call
0709 12:58:27.965722 (+389301us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b540012eb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1902090 00007f25d19a0f3a 00007f25d77571cc 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc 00007f25d5d15392 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:45.524866 (+17559144us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:41.299794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:41.300515 (+   721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:41.300572 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:58:41.300594 (+    22us) tablet.cc:662] Decoding operations
0709 12:58:41.398202 (+ 97608us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:41.398288 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:41.398315 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:58:41.399096 (+   781us) tablet.cc:701] Row locks acquired
0709 12:58:41.399144 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:58:41.399320 (+   176us) write_op.cc:270] Start()
0709 12:58:41.399478 (+   158us) write_op.cc:276] Timestamp: P: 1783601921399253 usec, L: 0
0709 12:58:41.399498 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:58:41.445133 (+ 45635us) log.cc:844] Serialized 3296 byte log entry
0709 12:58:42.745462 (+1300329us) op_driver.cc:464] REPLICATION: finished
0709 12:58:42.924608 (+179146us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25ce88e0ac 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d53ceef0
0709 12:58:43.250094 (+325486us) write_op.cc:301] APPLY: starting
0709 12:58:43.257055 (+  6961us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:43.310405 (+ 53350us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:43.312767 (+  2362us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:43.622497 (+309730us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:43.674556 (+ 52059us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:58:43.696346 (+ 21790us) write_op.cc:312] APPLY: finished
0709 12:58:43.764916 (+ 68570us) log.cc:844] Serialized 65 byte log entry
0709 12:58:44.868460 (+1103544us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:44.868694 (+   234us) write_op.cc:454] Released schema lock
0709 12:58:44.868760 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:44.869248 (+   488us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:44.869281 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1048944,"reported_tablets":34,"spinlock_wait_cycles":163484928,"child_traces":[["op",{"apply.queue_time_us":445532,"apply.run_cpu_time_us":22630,"apply.run_wall_time_us":1639070,"num_ops":8,"prepare.queue_time_us":582902,"prepare.run_cpu_time_us":28393,"prepare.run_wall_time_us":370587,"raft.queue_time_us":757758,"raft.run_cpu_time_us":19081,"raft.run_wall_time_us":491837,"replication_time_us":1300342,"spinlock_wait_cycles":22400384,"thread_start_us":2481572,"threads_started":5,"wal-append.queue_time_us":1482175,"wal-append.run_cpu_time_us":72189,"wal-append.run_wall_time_us":2574320}]]}
I20260709 12:58:46.111191  4605 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:58:46.114559  4513 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.088229  4640 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:46.127296  4469 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.113364  4695 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.128109  4636 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:46.133121  4690 consensus_meta.cc:287] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.565s	user 0.003s	sys 0.003s
I20260709 12:58:45.626071  4506 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.486s
I20260709 12:58:46.134752  4733 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:46.116156  4637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.008s	sys 0.013s
I20260709 12:58:46.139230  4618 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.152472  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:46.106165  2339 connection.cc:256] RPC call timeout handler was delayed by -2.1875306349999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 12:58:46.163879  1601 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:58:46.234964  2339 connection.cc:256] RPC call timeout handler was delayed by -1.3877541279999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32430000000000003s for a response
I20260709 12:58:46.162618  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.170871  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:46.173074  1532 raft_consensus.cc:1240] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:58:46.236122  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 65368.8us
I20260709 12:58:46.161512  1605 raft_consensus.cc:1240] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:58:46.237118  1575 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:46.145219  1428 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 2 to 4, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:46.238672  1605 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:58:46.239320  1605 pending_rounds.cc:85] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 6
I20260709 12:58:46.239686  1605 pending_rounds.cc:107] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 12:58:46.179127  4609 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:46.187840  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.196733  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:46.197223  4454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.037s	sys 0.049s
I20260709 12:58:46.201716  1525 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 6. Ops: []
I20260709 12:58:46.205879  1606 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:46.213129  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.235074  1601 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:46.244473  1530 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:46.187500  4641 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:46.250957  4641 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:46.251953  4641 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.254616  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2085) took 1073 ms. Trace:
W20260709 12:58:46.213343  4565 consensus_meta.cc:287] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.000s
I20260709 12:58:46.182971  4622 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.237130  2339 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:46.197031  4640 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.243122  4609 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:46.250342  4454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.037s	sys 0.049s
I20260709 12:58:46.255230  1607 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:46.255391  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.256177  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.255034  1608 rpcz_store.cc:276] 0709 12:58:45.181523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.181694 (+   171us) service_pool.cc:224] Handling call
0709 12:58:45.182001 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:45.182349 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:45.182377 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:45.206618 (+ 24241us) log.cc:844] Serialized 26 byte log entry
0709 12:58:45.550359 (+343741us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:45.550432 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.550531 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.254386 (+703855us) raft_consensus.cc:1685] finished
0709 12:58:46.254406 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.254561 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":449,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5679,"thread_start_us":320730,"threads_started":1,"wal-append.queue_time_us":987458}
I20260709 12:58:46.246019  1428 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 4 to 6, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:46.256503  1605 raft_consensus.cc:2917] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 12:58:46.247702  1575 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:46.227843  4636 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.162767  4662 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.270774  1605 raft_consensus.cc:2889] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:46.245051  4733 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.290844  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.255878  4697 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.198684  4513 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.254871  4637 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:46.257129  4607 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:46.300259  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.300338  4524 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:46.307893  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.308775  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.245352  4690 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.310963  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.263955  4640 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:46.323431  4513 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:46.324465  4637 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.265929  4609 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.328416  2474 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:46.309834  1526 raft_consensus.cc:2410] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:46.335968  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.292182  4605 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:46.339291  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.260141  4565 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.340207  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60652 (request call id 99) took 12112 ms. Trace:
I20260709 12:58:46.343072  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2074) took 1322 ms. Trace:
I20260709 12:58:46.342847  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:46.341821  2344 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.516s (SENT)
I20260709 12:58:46.327641  4698 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.311774  4733 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.351058  2435 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:46.343590  4590 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:46.380295  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 332061us
I20260709 12:58:46.352363  1605 rpcz_store.cc:276] 0709 12:58:34.217700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.582222 (+1364522us) service_pool.cc:224] Handling call
0709 12:58:36.272463 (+690241us) log.cc:844] Serialized 501 byte log entry
0709 12:58:46.329839 (+10057376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36163,"raft.queue_time_us":91185,"raft.run_cpu_time_us":2548,"raft.run_wall_time_us":98198,"thread_start_us":148608,"threads_started":1,"wal-append.queue_time_us":318432,"wal-append.run_cpu_time_us":2750,"wal-append.run_wall_time_us":1110320}
I20260709 12:58:46.353077  1606 rpcz_store.cc:276] 0709 12:58:45.020899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.021007 (+   108us) service_pool.cc:224] Handling call
0709 12:58:45.021235 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.244000 (+1222765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.342831 (+ 98831us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002bd4d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:46.343018 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2723997056}
I20260709 12:58:46.375613  4730 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:46.347651  1532 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:58:46.295773  4636 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:46.388975  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 295498us
I20260709 12:58:46.393751  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1890) took 1219 ms. Trace:
W20260709 12:58:46.377246  4726 log.cc:927] Time spent T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:58:46.342578  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.427584  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:46.398397  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 56622.9us
I20260709 12:58:46.427841  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:46.427785  1500 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:46.428660  1678 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:46.403492  4546 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:46.410089  4477 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.430060  1500 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:46.441143  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.433837  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.446322  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1948) took 1006 ms. Trace:
I20260709 12:58:46.446780  1605 rpcz_store.cc:276] 0709 12:58:45.439627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.237885 (+798258us) service_pool.cc:224] Handling call
0709 12:58:46.238252 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.446078 (+207826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.446268 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:46.448421  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.449378  1679 raft_consensus.cc:2393] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:46.450115  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.453410  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:46.463357  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.386572  4526 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:46.417001  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 271695us
I20260709 12:58:46.425632  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.377128  4717 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:58:46.427023  1681 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:46.417968  4698 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.478791  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.480078  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.493690  1679 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:46.446456  1678 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:46.481812  1674 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:46.450875  1683 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:46.483399  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.375314  4731 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.425242  4294 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:46.429181  4729 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.424363  4469 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:46.452173  4691 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:46.441797  4724 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:46.480639  4477 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.426581  4730 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.500664  4618 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.528471  4731 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:46.557641  4737 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:58:46.557945  4636 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.558496  4636 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:46.558684  4735 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:58:46.559039  4636 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.538640  4747 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:46.559948  4747 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.561255  4636 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.561877  4636 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.562340  4636 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.564314  4636 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.564790  4636 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.528926  4565 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:46.545140  4622 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.562098  4747 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.582154  4698 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:46.583420  4733 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.560135  4731 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:46.615636  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 172d54128ab740c980d9c27aa0ff1761 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:58:46.421905  1525 rpcz_store.cc:276] 0709 12:58:45.174688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.176221 (+  1533us) service_pool.cc:224] Handling call
0709 12:58:45.196952 (+ 20731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.243901 (+1046949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.393515 (+149614us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540028ee54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:46.393692 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285782912}
I20260709 12:58:46.412411  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:46.411110  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 330085us
I20260709 12:58:46.424466  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.415216  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.414927  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.375285  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.627395  1528 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:46.415503  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:46.385237  1609 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:46.496587  1675 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:46.487560  1677 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
W20260709 12:58:46.526051  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 217967us
I20260709 12:58:46.551764  4729 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.578048  4690 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.640321  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 504) took 1250 ms. Trace:
W20260709 12:58:46.663426  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.663985  4637 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:46.665482  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 218309us
I20260709 12:58:46.666617  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.668344  1679 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:46.528030  4608 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.675103  4608 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.548844  4546 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.680128  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 1979) took 1697 ms. Trace:
I20260709 12:58:46.681814  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:46.684158  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:46.684441  4731 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.662595  1603 rpcz_store.cc:276] 0709 12:58:45.389342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.163135 (+773793us) service_pool.cc:224] Handling call
0709 12:58:46.163441 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.163822 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:46.163861 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:46.164401 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:58:46.444683 (+280282us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:46.444723 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.444786 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.639439 (+194653us) raft_consensus.cc:1685] finished
0709 12:58:46.639492 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.640000 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1433,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":15326,"thread_start_us":279963,"threads_started":1,"wal-append.queue_time_us":391064}
I20260709 12:58:46.685443  4731 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.688024  1677 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.661556  4729 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.696264  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1945) took 1303 ms. Trace:
I20260709 12:58:46.696782  1604 rpcz_store.cc:276] 0709 12:58:45.392967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.202878 (+809911us) service_pool.cc:224] Handling call
0709 12:58:46.203204 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.203404 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.203427 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:46.203837 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:58:46.410246 (+206409us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:46.410282 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.410362 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.695753 (+285391us) raft_consensus.cc:1685] finished
0709 12:58:46.695804 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.696026 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":206137,"threads_started":1,"wal-append.queue_time_us":379928}
I20260709 12:58:46.698110  4543 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:46.700610  1682 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:46.700770   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:46.565279  4636 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.696272  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 718) took 1219 ms. Trace:
W20260709 12:58:46.717113  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 89566.6us
I20260709 12:58:46.718758  1498 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:46.720440  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 1949) took 1263 ms. Trace:
I20260709 12:58:46.721031  1602 rpcz_store.cc:276] 0709 12:58:45.457172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.152127 (+694955us) service_pool.cc:224] Handling call
0709 12:58:46.719930 (+567803us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400268ed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:46.720170 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246449024}
W20260709 12:58:46.721050  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 62453.6us
I20260709 12:58:46.730320  4543 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.731010  4543 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.566596  4618 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:46.768141  1677 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:58:46.706732  1500 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:46.784487  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 716) took 1355 ms. Trace:
I20260709 12:58:46.680773  1680 rpcz_store.cc:276] 0709 12:58:44.982100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.982628 (+   528us) service_pool.cc:224] Handling call
0709 12:58:44.983244 (+   616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.983525 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:45.420816 (+437291us) log.cc:844] Serialized 14 byte log entry
0709 12:58:46.529078 (+1108262us) log.cc:844] Serialized 14 byte log entry
0709 12:58:46.679095 (+150017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.679255 (+   160us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:46.679389 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.679554 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.679870 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127675,"prepare.queue_time_us":741337,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":443082,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":20334,"thread_start_us":1515412,"threads_started":4,"wal-append.queue_time_us":732257}
I20260709 12:58:46.785164  2476 rpcz_store.cc:276] 0709 12:58:45.429431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.429652 (+   221us) service_pool.cc:224] Handling call
0709 12:58:45.430014 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.430289 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:46.064043 (+633754us) log.cc:844] Serialized 14 byte log entry
0709 12:58:46.742767 (+678724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.759238 (+ 16471us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:46.783869 (+ 24631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.784013 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.784260 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":350610,"prepare.queue_time_us":677195,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":305339,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":245,"thread_start_us":998459,"threads_started":3,"wal-append.queue_time_us":488061}
I20260709 12:58:46.792068  4636 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.815150  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 491) took 1454 ms. Trace:
I20260709 12:58:46.815662  1609 rpcz_store.cc:276] 0709 12:58:45.360089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.360278 (+   189us) service_pool.cc:224] Handling call
0709 12:58:46.814716 (+1454438us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54000ec254. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:46.814925 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165054208}
I20260709 12:58:46.711944  2421 rpcz_store.cc:276] 0709 12:58:45.476363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.487007 (+ 10644us) service_pool.cc:224] Handling call
0709 12:58:45.487369 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.487625 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:46.043320 (+555695us) log.cc:844] Serialized 14 byte log entry
0709 12:58:46.389853 (+346533us) log.cc:844] Serialized 14 byte log entry
0709 12:58:46.691673 (+301820us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18000618a0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab522 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:58:46.695056 (+  3383us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b18000618a0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce825c0a 00007f25d7f65219 00007f25ce8ada40 00007f25ce8a84e4 00007f25ce8a8455 00007f25d1990060 00007f25d19a2716 00007f25d19b3287 00007f25d19b3208
0709 12:58:46.695366 (+   310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.695454 (+    88us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:46.695549 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.695741 (+   192us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.696007 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":321642,"prepare.queue_time_us":700732,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":13696,"raft.queue_time_us":320704,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":15680,"spinlock_wait_cycles":63154304,"thread_start_us":766690,"threads_started":2,"wal-append.queue_time_us":488800}
I20260709 12:58:46.797499  1600 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:46.824409  4639 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.825048  2342 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.005s (SENT) [suppressed 18 similar messages]
I20260709 12:58:46.825598  4639 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.828734  4639 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:46.801983  4563 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.830636  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 162830us
I20260709 12:58:46.833915  4477 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.830246  4563 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:46.846889  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:46.803399  4730 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.550750  4469 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.855500  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 1943) took 1460 ms. Trace:
I20260709 12:58:46.856040  1600 rpcz_store.cc:276] 0709 12:58:45.392513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.192212 (+799699us) service_pool.cc:224] Handling call
0709 12:58:46.192583 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.797138 (+604555us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b5400033520. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d190fdc0 00007f25d199a1c0 00007f25d199b231 00007f25d1997d8f 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c
0709 12:58:46.837413 (+ 40275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.853276 (+ 15863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85533056}
I20260709 12:58:46.860646  4583 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:46.861683  4641 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:46.862190  4641 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.862602  4641 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:46.864311  4731 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.865013  4454 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:58:46.865154  4691 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:46.882603  1680 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.845871  4294 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:58:46.885991  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.889724  4618 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:46.894222  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.895366  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:46.899575  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 120086us
I20260709 12:58:46.904042  4618 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.905910  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.907719  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:46.921890  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 53129.1us
I20260709 12:58:46.925827  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:46.920917  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 384975us
I20260709 12:58:46.928646  1675 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:46.928908  2421 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:58:46.929627  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:46.929710  4745 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:58:46.931119  4563 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:46.932092  4765 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.932935  4765 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.933652  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:46.935115  4609 consensus_meta.cc:287] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.558s	user 0.006s	sys 0.009s
I20260709 12:58:46.935621  4609 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.936103  4765 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:46.931074  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:46.946861  4766 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:58:46.946916  4699 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:46.950125  4699 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.950533  4699 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.953953  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 719) took 1380 ms. Trace:
I20260709 12:58:46.944214  4715 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:46.955523  4715 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.954416  2428 rpcz_store.cc:276] 0709 12:58:45.573118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.597979 (+ 24861us) service_pool.cc:224] Handling call
0709 12:58:45.715863 (+117884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.847446 (+131583us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:46.248824 (+401378us) log.cc:844] Serialized 14 byte log entry
0709 12:58:46.685504 (+436680us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800412ae0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d153823a 00007f25d19a2a2a
0709 12:58:46.719385 (+ 33881us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b1800412ae0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:58:46.878037 (+158652us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.900979 (+ 22942us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:46.910664 (+  9685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.941218 (+ 30554us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.953766 (+ 12548us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11195,"prepare.queue_time_us":304753,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":65,"raft.queue_time_us":29137,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":29993,"spinlock_wait_cycles":62288512,"thread_start_us":298047,"threads_started":2,"wal-append.queue_time_us":661703}
I20260709 12:58:46.956359  4469 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:46.953298  4697 consensus_meta.cc:287] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.011s
I20260709 12:58:46.968278  1572 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:46.969457  1572 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:46.970135  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.973822  4662 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:46.974350  4662 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:46.974797  4662 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:46.976338  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.976922  4543 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:46.977391  4698 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:46.978660  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.964326  4618 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.955040  4609 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:46.990691  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:46.990914  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:46.991434  1647 leader_election.cc:336] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.504s (SENT)
I20260709 12:58:46.991964  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.993821  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.995434  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.996719  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:46.997767  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:46.998625  4695 consensus_meta.cc:287] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.005s
I20260709 12:58:47.000577  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:47.001533  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:47.002097  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71243us
I20260709 12:58:47.002811  4755 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:47.003871  4715 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:47.005784  4729 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:47.008536  4469 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:47.013213  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.014168  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.015177  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.016003  4730 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:47.018903  4697 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:47.035398  1647 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:47.049216  1683 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.043081  1680 raft_consensus.cc:2410] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:47.048817  2421 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:47.034946  4698 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:47.050916  1532 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:47.044071  4755 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.061301  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.048758  2476 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:47.053985  2428 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:47.058045  2339 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:47.058320  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:47.058986  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.059396  2475 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:47.059692  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.059933  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.060452  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:47.060580  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.060741  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.064560  1530 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:47.066753  1527 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:47.069763  1609 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:47.061297  4755 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.073855  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.074568  1528 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:47.081703  4766 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:47.082319  4766 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:47.082365  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 91137.2us
I20260709 12:58:47.082794  4766 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:47.084435  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:47.084654  4641 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:47.085846  4640 consensus_meta.cc:287] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.007s
I20260709 12:58:47.086328  4759 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:47.086522  4543 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.087262  4759 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:47.087728  4759 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:47.088106  4759 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.052877  4698 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.088514  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:47.097411  2428 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:47.102427  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.105997  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.107364  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.075412  4563 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:58:47.094283  4641 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:47.109412  1532 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:47.108736  1683 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:47.107584  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:47.111099  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:47.115521  1603 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.086355  4640 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.094449  4618 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.104707  4730 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:47.135943  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:47.117849  4768 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 12:58:47.137673  4543 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:47.143396  4543 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:47.138058  2339 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:47.142053  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:47.138890  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:47.146967  4764 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:47.147475  4764 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:47.147886  4764 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:47.148171  4622 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:47.148891  4622 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.149439  4622 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.135569  4477 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:47.155525  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 50875.5us
I20260709 12:58:47.156834  1602 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.143805  4543 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:47.160950  4692 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:58:47.161720  4719 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:47.162388  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.162287  4719 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.163828  4759 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.164433  4719 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:47.167107  1605 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:47.167016  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.168972  1609 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:47.170172  4759 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:47.170923  4622 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:47.177000  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.171408  4715 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:47.174829  4746 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:47.175299  4454 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.176287  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.178031  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.182725  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:47.184652  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 53461.2us
I20260709 12:58:47.177675  4715 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.186947  1532 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:58:47.187188  4777 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:58:47.186949  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.192615  4758 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:58:47.193806  2339 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:47.154219  4477 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:47.194708  4477 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:47.205605  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.206743  1609 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:47.206995  4776 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:58:47.207728  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:47.208479  1609 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.210706  1606 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:47.212669  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.212796  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.213356  1527 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:47.213749  1526 raft_consensus.cc:2393] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:47.226123  4775 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:58:47.227084  4772 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:47.227589  4772 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:47.227808  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.228559  1530 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:47.155031  4662 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.230842  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.232462  4662 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:47.189983  4715 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.248816  1609 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
W20260709 12:58:47.249671  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 61378.7us
I20260709 12:58:47.250404  1603 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:47.249413  1680 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:47.261364  1602 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
W20260709 12:58:47.262082  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.262909  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.267259  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.188328  4746 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.204336  4454 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.258208  4583 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:47.286999  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.299803  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.301474  1608 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:47.303687  4764 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.297233  4477 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.306031  4618 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:47.306670  4477 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:47.308050  4774 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:58:47.307876  4477 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:47.309849  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.310520  1683 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:47.310726  4692 consensus_queue.cc:1059] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:47.311429  4729 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:47.311967  4729 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:47.312981  4454 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.313683  4640 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:47.313270  4729 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.315080  4729 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:47.317595  4662 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:47.319024  4746 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.319824  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.327111  1527 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:58:47.287446  4583 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:47.294034  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 105712us
I20260709 12:58:47.331727  4583 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:47.329813  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 109936us
I20260709 12:58:47.228567  4772 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.337913  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:47.341285  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 72498.8us
I20260709 12:58:47.342907  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.344796  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:47.345381  4785 raft_consensus.cc:3055] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:47.345909  4785 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:47.347293  4785 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.348730  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.348874  4771 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:47.350813  4772 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:47.350734  1683 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:47.351460  1682 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.358213  1498 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:47.289280  4699 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.362605  4764 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:47.287663  4766 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.338809  4618 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:58:47.369725  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.378593  1676 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
W20260709 12:58:47.381376  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.387282  4766 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.387478  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:47.388815  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 48034.9us
I20260709 12:58:47.389663  1575 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:47.389813  4662 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:47.389977  4784 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:58:47.390375  4662 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:47.390873  4662 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:47.392596  4697 raft_consensus.cc:2764] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:47.393401  4697 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:47.393922  4771 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:47.393819  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.394491  4771 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.396804  4771 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:47.398337  4755 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.400380  4755 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.336408  4640 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:58:47.374416  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.392656  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:47.413435  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.414373  1682 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:47.420300  4583 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.380698  4719 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:47.423841  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:47.426818  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 84603.4us
I20260709 12:58:47.405150  4766 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:47.433151  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.435549  1498 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:47.439091  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 46548.2us
I20260709 12:58:47.440415  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:47.441672  4785 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.442950  4690 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:47.452400  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:47.427911  4719 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.445251  4583 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.456784  1498 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:47.436643  2423 raft_consensus.cc:2368] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10.
W20260709 12:58:47.459944  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.460656  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.458685  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 116518us
I20260709 12:58:47.463130  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.463961  1682 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:47.437067  4766 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.471766  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:47.476210  4697 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:47.476908  4697 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:47.478009  4697 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.460119  4719 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.482039  4772 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.483304  4772 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.488188  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 362) took 10918 ms. Trace:
I20260709 12:58:47.490387  1428 rpcz_store.cc:276] 0709 12:58:36.569481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.570064 (+   583us) service_pool.cc:224] Handling call
0709 12:58:37.283572 (+713508us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540012eb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1902090 00007f25d19a0f3a 00007f25d77571cc 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc 00007f25d5d15392 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:47.487949 (+10204377us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:46.831303 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:46.832488 (+  1185us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:46.832576 (+    88us) write_op.cc:435] Acquired schema lock
0709 12:58:46.832620 (+    44us) tablet.cc:662] Decoding operations
0709 12:58:46.849382 (+ 16762us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:46.869809 (+ 20427us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:46.881938 (+ 12129us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:58:46.980657 (+ 98719us) tablet.cc:701] Row locks acquired
0709 12:58:46.980709 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:58:46.980954 (+   245us) write_op.cc:270] Start()
0709 12:58:46.981103 (+   149us) write_op.cc:276] Timestamp: P: 1783601926980864 usec, L: 0
0709 12:58:46.981140 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:58:46.982309 (+  1169us) log.cc:844] Serialized 2070 byte log entry
0709 12:58:47.286481 (+304172us) op_driver.cc:464] REPLICATION: finished
0709 12:58:47.368023 (+ 81542us) write_op.cc:301] APPLY: starting
0709 12:58:47.368139 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:47.368307 (+   168us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:47.374236 (+  5929us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:47.381968 (+  7732us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:47.382306 (+   338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:58:47.382349 (+    43us) write_op.cc:312] APPLY: finished
0709 12:58:47.382667 (+   318us) log.cc:844] Serialized 47 byte log entry
0709 12:58:47.382847 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:47.382946 (+    99us) write_op.cc:454] Released schema lock
0709 12:58:47.383002 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:47.383467 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:47.383495 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":449756,"reported_tablets":27,"spinlock_wait_cycles":377067392,"child_traces":[["op",{"apply.queue_time_us":76257,"apply.run_cpu_time_us":3330,"apply.run_wall_time_us":15449,"num_ops":5,"prepare.queue_time_us":410695,"prepare.run_cpu_time_us":14599,"prepare.run_wall_time_us":239315,"raft.queue_time_us":77896,"raft.run_cpu_time_us":7341,"raft.run_wall_time_us":52373,"replication_time_us":305151,"thread_start_us":495725,"threads_started":4,"wal-append.queue_time_us":130784}]]}
I20260709 12:58:47.502061  4746 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:47.502570  4746 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:47.503543  4746 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.504901  4746 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:47.507076  4790 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:47.507369  2344 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:47.509974  4784 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:47.510771  4724 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:47.511411  4724 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:47.512451  4724 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.513741  4691 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:47.514310  4691 raft_consensus.cc:697] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:47.514984  4772 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.515327  4691 consensus_queue.cc:237] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.516700  1500 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:47.519272  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 77760.5us
I20260709 12:58:47.519583  4772 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:47.520215  4772 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.520599  4772 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.525712  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.525851  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.526523  1683 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:47.527285  1674 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:47.527490  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.528028  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.429240  4641 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:58:47.526459  1676 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.532539  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.533264  1674 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:47.541699  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.465405  4609 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:47.529277  4766 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:47.550695  1498 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:47.468147  4783 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.556862  1575 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:47.570744  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.572014  1527 raft_consensus.cc:2410] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:47.579726  1605 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:47.582653  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.578819  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.586524  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.587343  1603 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:47.588014  1682 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:47.589972  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.589087  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.575973  4454 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:47.578938  4690 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:47.553401  4698 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.602588  1676 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:47.604990  1681 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:47.606030  1600 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:47.587307  4699 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.610142  4715 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.612270  4715 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.575708  4695 consensus_queue.cc:1059] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:58:47.613359  4695 raft_consensus.cc:3055] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:47.603628  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:47.614341  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 66040.5us
I20260709 12:58:47.618265  1675 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:47.613754  4695 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:47.578583  4783 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:47.656327  1647 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.588s (SENT)
I20260709 12:58:47.656983  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:47.622123  4454 raft_consensus.cc:697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:47.666041  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.698459  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.699373  1602 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:47.700670  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.701939  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.702003  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.702745  1606 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:47.702786  1676 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:47.703908  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.704568  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.705030  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.705395  1602 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:47.664022  4618 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:47.707494  1678 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:47.708953  4454 consensus_queue.cc:237] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:47.714167  4715 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:47.714974  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:47.715040  4715 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:47.715978  4543 consensus_meta.cc:287] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.004s
I20260709 12:58:47.716467  4543 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.722846  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:47.723814  2423 raft_consensus.cc:2393] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:47.726804  2461 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:47.730134  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:47.731750  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.732128  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.732925  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.733117  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.733935  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.734263  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.735046  1532 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.735445  4715 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:47.735210  4695 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.736680  4695 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:47.734344  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.727360  4662 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.715929  1606 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:47.742141  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:47.739151  1674 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:47.741994  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:47.755658  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.759497  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.759709  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.760377  1527 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:47.760918  2428 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
W20260709 12:58:47.765549  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 109253us
I20260709 12:58:47.770594  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.770175  1528 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
W20260709 12:58:47.777153  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.779918  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:47.746282  4690 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:47.782473  1606 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:47.782610  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:47.797382  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.798213  1682 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.800246  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.803460  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:47.809477  1679 raft_consensus.cc:1240] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:58:47.811810  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:47.812484  2435 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:47.815083  4794 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:58:47.815961  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.816638  1533 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:47.822819  4543 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:47.823818  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.826352  1683 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:47.787334  4758 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:47.802572  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:47.809219  4797 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:58:47.849325  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.850090  1528 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:58:47.850508  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 48043.5us
I20260709 12:58:47.844401  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:47.843036  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.854712  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:47.854892  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:47.855523  1602 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:47.862715  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.863364  1680 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:47.843986  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:47.895499  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.927428  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:47.863955  2421 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 9: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:47.929348  1532 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:58:47.930323  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:47.934029  1526 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:47.935554  1527 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:58:47.936703  2435 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:47.940912  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:47.941500  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 81101.5us
I20260709 12:58:47.941749  1527 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:47.941236  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:47.942740  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.943066  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:47.954007  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:47.964246  1602 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:47.846513  4758 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:47.954165  4641 consensus_queue.cc:1059] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:58:47.964073  1525 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:47.796432  4690 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:47.935314  4477 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:47.971835  4698 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:47.991691  1601 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:47.982059  4563 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:48.009501  4563 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.013274  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:47.851415  4772 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.002563  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:47.946002  4765 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:47.960847  4618 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:47.851249  4766 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.014540  1649 leader_election.cc:400] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10.
I20260709 12:58:48.026847  1649 leader_election.cc:403] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:48.014202  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.029204  1601 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:47.977710  4758 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:47.969838  4729 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:48.040182  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:48.040916  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:48.009541  1527 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:47.991034  4477 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:48.046675  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 287209us
I20260709 12:58:48.023366  4618 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:48.023743  4765 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:48.046999  1682 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:48.051062  1680 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:58:48.054275  1675 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:58:48.037672  4641 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:48.059219  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.061870  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.072203  1601 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:48.049317  4477 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:48.054994  4618 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.050995  4783 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:48.091867  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.092730  2421 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:48.059191  4641 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:48.133975  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.135984  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:48.135120  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:48.141294  1601 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:48.131170  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 154100us
W20260709 12:58:48.150871  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 202539us
I20260709 12:58:48.164148  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:48.160997  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.125770  4563 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:48.170845  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:48.176011  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:48.172466  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:48.175462  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:48.187371  1531 raft_consensus.cc:2410] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:58:48.196831  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.198575  1534 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:48.221426  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:48.223439  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:48.227464  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 129598us
I20260709 12:58:48.187994  4755 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:48.237742  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:48.233285  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:48.240685  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 76622.8us
I20260709 12:58:48.197726  4729 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:58:48.236832  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 277038us
I20260709 12:58:48.250171  1600 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:48.251014  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71864.1us
I20260709 12:58:48.250622  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:48.233309  2423 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:48.265985  2339 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:48.266044  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.270774  4820 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:48.253355  4698 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:48.271890  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 131050us
I20260709 12:58:48.274361  1497 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:48.265688  4719 consensus_meta.cc:287] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.005s
I20260709 12:58:48.188079  4765 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.252010  4772 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:48.285090  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.287223  1604 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:48.328214  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 77641.6us
I20260709 12:58:48.329599  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:48.330776  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 43929.5us
I20260709 12:58:48.323081  4719 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:48.337677  1607 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:48.338795  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 86255.6us
W20260709 12:58:48.339483  4821 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
W20260709 12:58:48.339670  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 57284.7us
I20260709 12:58:48.341008  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:48.332998  4804 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
W20260709 12:58:48.338932  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64678.2us
I20260709 12:58:48.265153  4690 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:48.277292  4800 log.cc:927] Time spent T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:58:48.341439  2339 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:48.272943  4698 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.370688  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.370957  1606 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
W20260709 12:58:48.271171  4801 log.cc:927] Time spent T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:58:48.341343  4699 consensus_queue.cc:1059] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:58:48.268425  4662 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:48.374100  4819 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:48.374243  4816 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:48.441015  4771 consensus_queue.cc:1059] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:48.441376  4816 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:48.286139  4755 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:48.375556  4799 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:58:48.442750  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.347165  4765 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:48.444049  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.445989  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.447203  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.447705  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:48.378240  4808 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:58:48.449007  4454 raft_consensus.cc:3055] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:48.449401  4454 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:48.450191  4454 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.370002  4772 consensus_queue.cc:1059] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:58:48.381177  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:48.451970  4691 raft_consensus.cc:3055] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:48.452358  4691 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:48.452634  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71556.3us
I20260709 12:58:48.250800  4641 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.453096  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.422940  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:48.423744  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:48.323968  4813 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:48.425756  1607 raft_consensus.cc:2393] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:48.458309  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 128865us
W20260709 12:58:48.428573  4803 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.327s	user 0.001s	sys 0.001s
I20260709 12:58:48.429680  2455 raft_consensus.cc:1240] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:48.421011  4609 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:48.430210  4719 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:48.432075  4818 log.cc:927] Time spent T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:58:48.432461  4802 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:58:48.432541  4477 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:48.436451  4785 consensus_meta.cc:287] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.000s
I20260709 12:58:48.438573  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.438295  4729 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.439778  4724 consensus_queue.cc:1059] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:48.440521  4563 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:48.441906  4816 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:48.448264  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.475821  2428 raft_consensus.cc:2410] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:58:48.476559  1600 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:48.448489  1602 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:48.475898  2435 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:48.453671  4745 consensus_queue.cc:1175] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e45ac8b66854c2f905bf2c4114cb489" responder_term: 7 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:48.453109  4691 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.455094  4772 raft_consensus.cc:2764] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:48.445235  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.421517  1526 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:48.456387  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.458916  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:48.457610  1601 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:48.466274  1604 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:48.400243  4698 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:48.389856  4543 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:48.469820  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.391233  4766 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:48.453523  1497 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:48.472223  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.479439  4789 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:48.505414  4789 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:48.506240  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 52827.6us
I20260709 12:58:48.507118  1497 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:48.508023  4789 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:48.508214  1497 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:48.460330  4813 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:48.509212  4813 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.509243  4814 raft_consensus.cc:2764] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:58:48.510821  4695 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:48.510949  4814 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:48.511636  4814 raft_consensus.cc:697] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:48.512698  4814 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.488726  1427 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 6 to 8, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:48.477468  4804 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:58:48.502071  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.519399  2435 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:48.519397  1606 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:48.525228  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 66429.4us
I20260709 12:58:48.480360  4784 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:48.530241  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.531502  1600 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:48.532048  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:48.535917  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.538074  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 97844us
I20260709 12:58:48.540603  1427 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 5 to 6, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 6 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:48.490007  4563 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.559758  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:48.572719  1600 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:48.575448  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 67308.5us
W20260709 12:58:48.577461  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 115795us
I20260709 12:58:48.580602  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:48.581326  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 49363.9us
I20260709 12:58:48.561858  4691 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:48.584160  4827 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:48.584649  4746 consensus_meta.cc:287] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.079s	user 0.005s	sys 0.011s
I20260709 12:58:48.584988  1497 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:48.582852  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1918) took 1055 ms. Trace:
W20260709 12:58:48.588660  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.590739  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:48.592955  1680 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:48.584668  1427 catalog_manager.cc:5697] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.583741  4820 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10.
I20260709 12:58:48.593156  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:48.585991  1681 rpcz_store.cc:276] 0709 12:58:47.527596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.532537 (+  4941us) service_pool.cc:224] Handling call
0709 12:58:47.604672 (+ 72135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:47.605320 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.578122 (+972802us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b54000fa850. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:48.582773 (+  4651us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165093888}
I20260709 12:58:48.539072  4784 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.701967  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:48.704450  1675 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:48.701884  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 119970us
I20260709 12:58:48.702203  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:48.705526  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:48.702549  1600 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:58:48.709221  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.672995  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 83129.9us
I20260709 12:58:48.712339  4477 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:48.713964  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2119) took 1097 ms. Trace:
I20260709 12:58:48.716903  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:48.713959  1427 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.720692  2339 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:48.733210  4758 consensus_meta.cc:287] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.684s	user 0.007s	sys 0.001s
I20260709 12:58:48.732227  1427 catalog_manager.cc:5697] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 4, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.734673  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:48.583356  4729 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:48.738003  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:48.584690  4827 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:48.758177  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 173280us
I20260709 12:58:48.759346  1682 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:48.759284  1649 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:48.739836  1427 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.578156  4609 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:48.767036  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:48.714602  1608 rpcz_store.cc:276] 0709 12:58:47.604511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.604640 (+   129us) service_pool.cc:224] Handling call
0709 12:58:47.619696 (+ 15056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.623138 (+  3442us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:47.657246 (+ 34108us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.842962 (+185716us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.917998 (+ 75036us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.930025 (+ 12027us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:47.930085 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.930175 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.702006 (+771831us) raft_consensus.cc:1685] finished
0709 12:58:48.702027 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.702156 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35707,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":186,"raft.run_cpu_time_us":4916,"raft.run_wall_time_us":51573,"thread_start_us":83168,"threads_started":1,"wal-append.queue_time_us":355394}
I20260709 12:58:48.768786  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:48.733496  4695 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:58:48.673869  4746 consensus_queue.cc:1059] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:58:48.726615  4825 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:48.736763  4477 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:48.786620  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 206703us
I20260709 12:58:48.791004  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:48.778324  1427 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.752511  4729 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:48.770364  4785 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:48.756485  4827 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:48.803931  1500 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:48.785918  4830 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:48.809926  1427 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 8 to 11, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 11 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:48.791736  4820 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:48.756584  4758 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.766788  4543 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:48.793148  4825 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.805469  4729 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:48.798060  4819 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:48.828002  4609 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.831000  4454 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:48.832079  4618 consensus_meta.cc:287] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.698s	user 0.006s	sys 0.003s
I20260709 12:58:48.820150  4820 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:48.833074  4563 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:48.835330  4758 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:48.835952  4719 raft_consensus.cc:3055] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:48.812355  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:48.841981  1427 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:48.825238  4477 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:48.857952  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 100075us
I20260709 12:58:48.820564  4785 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:48.875397  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 295373us
I20260709 12:58:48.857164  4746 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:48.879349  4834 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:48.879856  4834 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:48.880220  4834 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:48.882325  4785 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.886125  4837 raft_consensus.cc:3055] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:48.886575  4837 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:48.887326  4837 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.888504  4837 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.889719  4836 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:48.890272  4836 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:48.868609  4618 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.891108  4836 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.892830  4618 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:48.868696  4820 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:48.895159  4784 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:48.895730  4758 consensus_queue.cc:1059] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:48.872735  4477 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:48.898790  4477 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:48.902148  4813 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.855350  4825 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:48.909593  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 148148us
I20260709 12:58:48.901278  1427 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 4 to 6, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 6 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:48.930804  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 131252us
W20260709 12:58:48.942456  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 130231us
I20260709 12:58:48.872306  4719 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:48.946043  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:48.946666  1679 raft_consensus.cc:2376] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
I20260709 12:58:48.951946  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:48.944665  1427 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 6, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.889056  4834 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:48.962831  1682 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:48.963145  1427 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 6, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 6 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:48.968290  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.965595  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:48.926651  4699 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:58:48.971717  1500 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Timed out: RequestConsensusVote RPC to 127.0.107.196:46719 timed out after 1.720s (SENT)
I20260709 12:58:48.972340  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:48.947680  4758 consensus_queue.cc:1243] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:48.941938  4746 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:58:48.979318  1427 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.986065  1427 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.987496  1427 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:48.966997  4765 consensus_meta.cc:287] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.523s	user 0.014s	sys 0.000s
I20260709 12:58:48.989989  2475 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:48.994004  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:48.995921  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.960006  4813 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:48.998539  1675 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:49.003046  4811 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 12:58:49.003931  4816 consensus_meta.cc:287] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
W20260709 12:58:49.004617  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7c3ea752cffa4a138dd2984b56316ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3cabc5110903443ba3beb5cbb14afa91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:49.004483  4816 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:49.005239  1416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 50318.5us
I20260709 12:58:49.010485  4813 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:49.013288  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:49.014343  4758 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:49.015175  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.021751  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:48.985131  4847 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:58:49.045629  4827 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:49.051862  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.053164  1679 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:49.050266  4825 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.008942  4698 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:49.072600  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 78660.9us
I20260709 12:58:49.073385  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:49.058538  4831 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:49.075170  1675 raft_consensus.cc:2376] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9. Re-sending same reply.
I20260709 12:58:49.077641  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:49.078635  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:49.080314  1678 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:49.076133  4609 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 12:58:49.089357  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.089274  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:49.090534  1529 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:49.089279  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:49.091130  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:48.984120  4719 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.080235  4837 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.106223  1674 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:58:49.091368  4831 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:49.115255  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:49.114018  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.128700  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:49.130540  1530 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:49.109911  4828 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:58:49.134263  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:49.134356  4816 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.135452  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:49.160763  4834 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.104629  4837 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.161525  4831 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.139317  4854 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:49.142030  4850 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:49.145108  4822 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.714s	user 0.016s	sys 0.007s
I20260709 12:58:49.144902  4477 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.148501  4825 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.150249  4698 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:49.169679  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:49.151806  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:49.171113  1675 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:49.163264  1529 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:49.172662  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.165870  4837 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.175156  4839 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:49.175865  4839 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.177759  4838 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.178859  4618 raft_consensus.cc:3055] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:49.179298  4618 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:49.180214  4618 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.178542  4838 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.167830  4850 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.182507  4820 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.166177  4454 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:49.190109  1678 raft_consensus.cc:1275] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:49.181353  4618 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:49.194253  1534 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:49.196929  1526 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:49.197849  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.198145  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.198930  2476 raft_consensus.cc:2393] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:49.198704  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:49.199309  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.199589  2423 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:49.200047  2451 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:49.200845  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.201267  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.198697  2435 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:58:49.201941  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.202569  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.202917  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.202590  2455 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:49.201821  2421 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:49.204505  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:49.211016  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.214880  4477 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.217459  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.185117  4850 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:49.220705  1675 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
W20260709 12:58:49.221427  2342 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.965s (SENT)
I20260709 12:58:49.221406  2455 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:58:49.218139  4662 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.240779  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:49.243112  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.244354  4854 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:49.244761  4854 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.240185  4838 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:49.245185  4854 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:49.245129  4845 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:49.245829  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.246263  4839 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.238282  4828 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:49.247586  1497 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.247368  4828 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.248261  4820 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:49.248214  4840 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:49.249691  4840 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:49.249718  4828 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:49.253695  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:49.254400  1675 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:49.256383  1527 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:49.255761  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:49.258162  4850 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:49.260349  4850 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:49.260424  1528 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:49.260838  4850 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:49.250684  4840 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:49.271297  2428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 737) took 1508 ms (client timeout 1720 ms). Trace:
I20260709 12:58:49.282357  2344 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:49.280490  1529 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:49.264777  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:49.290376  2428 rpcz_store.cc:269] 0709 12:58:47.763058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.763185 (+   127us) service_pool.cc:224] Handling call
0709 12:58:49.271088 (+1507903us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540051b154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:49.271210 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579921280}
I20260709 12:58:49.291682  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:49.252502  1575 connection.cc:256] RPC call timeout handler was delayed by -1.0519068589999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 12:58:49.267516  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:49.277998  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56612.7us
I20260709 12:58:49.290911  1527 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:49.261482  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:49.302748  1533 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:49.273419  1572 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:49.308734  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:49.313004  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:49.303896  2344 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:49.315507  1647 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.609s (SENT)
I20260709 12:58:49.338227  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.337100  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:49.316906  4783 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:49.304791  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:49.322499  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:49.323588  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:49.343555  1675 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
W20260709 12:58:49.330219  2342 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.005s (SENT)
I20260709 12:58:49.331933  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.253793  4839 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:49.259248  4837 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:58:49.334601  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.335229  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:49.378968  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 66049.3us
I20260709 12:58:49.379587  1680 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 3.
I20260709 12:58:49.256422  4477 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:49.335629  2461 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:58:49.379966  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:49.333814  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:49.302758  4755 raft_consensus.cc:3055] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:49.342180  1525 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:49.382807  2342 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.253618  4662 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.378844  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:49.336356  1677 raft_consensus.cc:3055] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:49.274004  4850 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.340214  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:49.324688  4838 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:49.348278  1675 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:49.273702  4698 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:58:49.389169  1678 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:49.325137  4831 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:49.388530  4828 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:49.347708  1681 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:49.394470  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:49.394892  1679 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:49.394558  1677 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:49.397706  2474 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:49.314441  4790 consensus_queue.cc:1059] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 12:58:49.398741  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 99653.9us
I20260709 12:58:49.344749  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.344873  4820 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:49.345530  4764 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:49.405130  1527 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:49.342043  4783 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.444239  4783 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:49.444192  4854 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.399089  4859 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:49.445829  4859 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:49.446163  4826 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.977s	user 0.004s	sys 0.013s
I20260709 12:58:49.331003  4845 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:49.441169  4831 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:49.431370  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.448179  4831 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.325001  4609 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:58:49.451719  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 745) took 1361 ms. Trace:
I20260709 12:58:49.452032  4850 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:49.452149  2475 rpcz_store.cc:276] 0709 12:58:48.090186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.092124 (+  1938us) service_pool.cc:224] Handling call
0709 12:58:49.451549 (+1359425us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54005f2b54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:49.451662 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952435968}
I20260709 12:58:49.392642  4840 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:49.389500  4755 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:49.335915  4729 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.345342  4785 consensus_queue.cc:1059] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 12:58:49.438476  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 107248us
I20260709 12:58:49.393826  4789 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:49.441972  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 111812us
I20260709 12:58:49.403371  4819 consensus_queue.cc:1059] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:58:49.443270  4820 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:49.399395  4477 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:49.443585  4764 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:49.446230  4859 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:49.453774  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 149044us
I20260709 12:58:49.484710  1572 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:49.345770  4825 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.486544  4825 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.487243  4662 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:49.488926  4477 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.492142  4609 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:49.492619  4609 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:49.493033  4609 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:49.493151  4828 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:49.463469  2451 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:49.439654  4838 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:49.463693  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.464879  4856 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:58:49.470762  4854 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:49.474327  4861 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:58:49.475308  4790 raft_consensus.cc:3055] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:49.392424  4839 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:49.480846  2342 leader_election.cc:336] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.587s (SENT)
I20260709 12:58:49.454263  4698 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:49.483764  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:49.404372  4816 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:49.493809  4825 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.496934  1683 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:49.483578  4764 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:49.485819  4819 consensus_queue.cc:1243] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:49.501099  4838 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.495903  4820 raft_consensus.cc:697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:49.502424  4783 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.570626  4820 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.571069  2476 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:58:49.572482  4783 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:49.512308  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 117932us
W20260709 12:58:49.517220  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 165746us
I20260709 12:58:49.577428  1681 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:49.577955  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:49.578763  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.578836  1675 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
W20260709 12:58:49.552755  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.580636  1678 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:49.522701  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:49.582079  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 101278us
I20260709 12:58:49.582608  4810 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:49.582899  2342 leader_election.cc:336] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.048s (SENT)
W20260709 12:58:49.535341  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.552711  4816 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:49.510236  4785 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:49.600144  2342 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.559741  4839 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:49.566645  4866 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:58:49.587001  1678 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:49.587916  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:49.603760  1675 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:49.604974  4827 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:49.530330  4828 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.597375  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:49.606891  2474 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:49.607501  4828 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.609207  4816 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.611315  4609 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.594233  4698 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:49.612460  4755 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.614459  2476 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:49.522984  4790 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:49.616812  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:49.619696  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.621121  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.627624  1572 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:49.628110  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.594205  4789 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.617873  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:49.613401  4609 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:49.661274  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.629284  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 145608us
I20260709 12:58:49.625960  4699 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:49.626283  4662 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:49.662529  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:49.618417  4829 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:49.663950  4764 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.626124  4755 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:49.602662  4825 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:58:49.628759  4784 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:49.672351  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:49.679059  1678 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:49.667644  4772 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:49.676537  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:49.623189  4810 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:49.680528  1682 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:49.681603  1676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.012s
W20260709 12:58:49.686259  1676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.009s	sys 0.012s
I20260709 12:58:49.614079  4785 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.665977  4662 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.665830  4543 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:49.660876  4828 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:58:49.682075  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 290209us
I20260709 12:58:49.677433  4831 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:49.687669  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:49.613744  4698 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.685673  4772 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.622859  4869 consensus_queue.cc:1059] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:58:49.685482  4871 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:49.702445  1679 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:49.665423  4789 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.706199  4662 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:49.677168  4639 consensus_queue.cc:1059] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:58:49.701146  4699 consensus_queue.cc:1059] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:58:49.718586  4831 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:49.748025  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 60494.2us
I20260709 12:58:49.725620  4772 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:49.752683  4869 raft_consensus.cc:3055] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:49.753998  4869 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:49.754696  4789 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:49.755000  4869 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.756480  4869 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:49.752660  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 102289us
I20260709 12:58:49.728421  4871 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:49.729990  4729 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:49.764596  1682 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:49.677481  4790 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.750447  4609 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:49.758599  4831 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:49.798856  1575 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:49.807549  4877 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:58:49.783509  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2001) took 2006 ms. Trace:
I20260709 12:58:49.759500  4844 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:49.822254  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 163663us
I20260709 12:58:49.769713  4871 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:49.803552  4825 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:49.825868  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 53139.2us
I20260709 12:58:49.826494  1676 rpcz_store.cc:276] 0709 12:58:47.777323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.777455 (+   132us) service_pool.cc:224] Handling call
0709 12:58:47.795666 (+ 18211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:47.808149 (+ 12483us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:48.049425 (+241276us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.110005 (+1060580us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800400ea0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8a8455 00007f25d1990060 00007f25d19a2716 00007f25d19b3287 00007f25d19b3208
0709 12:58:49.686713 (+576708us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.761408 (+ 74695us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.765392 (+  3984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.765449 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:49.765511 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.765621 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.783422 (+ 17801us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3557,"prepare.queue_time_us":837890,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":152,"raft.queue_time_us":143077,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":9964,"spinlock_wait_cycles":72256768,"thread_start_us":975088,"threads_started":5,"wal-append.queue_time_us":404720,"wal-append.run_cpu_time_us":1048,"wal-append.run_wall_time_us":1007668}
I20260709 12:58:49.835420  4609 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:49.858600  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.868481  4789 raft_consensus.cc:3055] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:49.869086  4789 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:49.874435  4873 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:58:49.899367  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.834499  4825 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:49.831296  4824 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:49.828715  4844 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:49.834280  4828 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:58:49.909030  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:49.918162  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:49.920812  4789 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.903314  4772 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:49.926088  2451 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:49.933372  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:49.945741  4785 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:49.921152  4662 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:49.962566  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 203706us
I20260709 12:58:49.963724  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:49.909468  4790 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:49.966101  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:49.917129  4871 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:49.969409  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.924331  4824 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:49.999418  1572 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:49.995543  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.973058  4758 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:50.002038  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 99268.9us
I20260709 12:58:49.946810  4859 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.007730  4828 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:50.013077  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.014389  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.014631  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.015715  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.020602  1534 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:50.016209  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:49.977958  4829 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.017174  4869 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:50.016825  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.021905  1533 raft_consensus.cc:2368] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:58:49.982347  4892 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:50.022698  1528 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:50.030108  1532 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:50.000051  4609 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:50.045363  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.037823  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:50.005961  4758 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.051949  1681 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:50.052965  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.005524  4885 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:50.056842  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:50.057992  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:50.060632  1682 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:50.061056  1534 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
W20260709 12:58:50.064594  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:50.069496  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 50106.3us
I20260709 12:58:50.024276  4869 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:50.082336  1674 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:50.054641  4758 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.061928  4813 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.088481  1680 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:50.088740  4859 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:50.089792  4825 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:50.031674  4828 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:50.098057  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:50.076877  4827 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:50.097079  4869 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:50.048400  4829 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.022461  4824 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.072448  4785 consensus_queue.cc:1059] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:58:50.142004  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.072634  4765 consensus_queue.cc:1059] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:58:50.120247  4851 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.149055  1604 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:50.151820  4890 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:58:50.148398  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.072485  4885 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.050120  4892 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.162446  1607 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:49.980808  4844 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.119724  4813 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.179884  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.191298  1602 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:50.187601  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.192420  1604 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:50.154592  4640 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.206236  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.207338  1607 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:50.182761  4824 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:50.164744  4772 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:50.214247  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.214951  1604 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:50.150038  4831 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.185658  4662 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.152076  4897 consensus_queue.cc:1059] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 12:58:50.228842  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 99023.5us
I20260709 12:58:50.230150  1606 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:50.220326  4904 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.235347  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.158259  4851 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.239650  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:50.221769  4871 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.240538  4609 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:58:50.254550  4829 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:50.254912  4885 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.241698  4904 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.258879  4904 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.264328  4892 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.267669  1498 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:50.269865  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7c3ea752cffa4a138dd2984b56316ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3cabc5110903443ba3beb5cbb14afa91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:58:50.284926  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.284899  2451 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:58:50.292479  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 53164.9us
I20260709 12:58:50.293613  1575 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:50.241441  4698 raft_consensus.cc:3055] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:50.298672  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:50.302150  4908 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:50.286304  4691 consensus_queue.cc:1059] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:58:50.222009  4828 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.295377  4609 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:50.299790  4772 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:50.297441  4698 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:50.392949  2342 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.951s (SENT)
I20260709 12:58:50.404273  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:50.404598  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.287971  4758 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:50.406150  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 138551us
I20260709 12:58:50.303799  4897 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:50.407022  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:50.301818  4816 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:58:50.415717  1498 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:50.407877  4866 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:58:50.304752  4871 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:58:50.405433  4827 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.420414  4691 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:50.427820  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:50.405668  4819 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.414692  4785 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:50.414793  4765 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.430884  4691 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.437988  4691 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:50.435310  4758 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:50.403475  4908 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:58:50.422845  4772 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:50.436654  4894 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.599s	user 0.003s	sys 0.011s
I20260709 12:58:50.435302  4831 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:50.447871  1575 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:50.437120  4765 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.457202  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:50.424839  4904 consensus_queue.cc:1059] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:58:50.458033  2475 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.448088  4897 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:50.444737  4772 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.446553  4785 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.433127  4827 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.443791  4819 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.478839  1575 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:50.487715  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 66203.4us
I20260709 12:58:50.488492  4827 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:50.489843  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.478487  4772 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:50.494256  4839 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:50.494755  4839 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:50.495620  4839 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.496858  4839 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:50.487226  4871 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:50.488754  4869 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.502940  4869 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:50.499538  4765 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.467054  4906 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:50.486397  4851 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:50.509763  4851 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:50.510300  4851 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.482286  4785 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.512559  4851 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.515127  1677 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.516476  1677 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:50.516675  4789 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:50.518100  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.523203  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:50.523900  2423 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:50.506973  4691 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.526463  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:50.527776  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.528548  1609 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:50.529981  4820 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:50.530452  4820 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.530798  4820 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.531082  4691 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:50.533221  4876 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.750s	user 0.004s	sys 0.001s
I20260709 12:58:50.540041  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:50.541416  1600 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:50.537930  4844 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.525457  4832 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:50.569350  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:50.581738  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:50.583655  1603 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:50.583817  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.585081  1607 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:50.586103  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.586982  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.587196  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.587580  1608 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:50.570508  4785 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.571175  4819 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:50.588431  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.588649  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.589327  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.590179  1527 raft_consensus.cc:2393] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:50.589360  1602 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:50.537915  4827 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:50.594302  1609 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:50.592770  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:50.590945  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.595395  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.592926  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.485829  4904 raft_consensus.cc:3055] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:50.596880  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.596792  1609 raft_consensus.cc:2410] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:50.589553  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.589854  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.599751  2474 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:50.599864  1528 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:50.600924  1677 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:58:50.601372  1677 pending_rounds.cc:85] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 3
I20260709 12:58:50.601991  2476 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:50.602422  1608 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:50.602327  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:50.602926  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:50.603425  2423 raft_consensus.cc:2393] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:58:50.603387  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.578513  4832 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:50.598114  4869 raft_consensus.cc:2764] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:58:50.604763  4832 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.605320  2455 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:58:50.655279  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.655766  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.656427  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.656288  4820 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.656754  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.657534  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.657903  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.658118  1527 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:50.658542  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.659327  1534 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:50.659847  4813 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:50.579464  4824 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:50.608199  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:50.601645  1677 pending_rounds.cc:107] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:58:50.666564  1677 raft_consensus.cc:2889] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:50.667356  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1927) took 1361 ms. Trace:
I20260709 12:58:50.665030  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:50.665324  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.668560  2423 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.670203  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.670754  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:50.671795  4477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.009s	sys 0.042s
W20260709 12:58:50.672179  4477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.009s	sys 0.042s
I20260709 12:58:50.674590  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.674886  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.675137  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:50.676365  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.667579  1677 rpcz_store.cc:276] 0709 12:58:49.305689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.305928 (+   239us) service_pool.cc:224] Handling call
0709 12:58:49.333578 (+ 27650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.514786 (+1181208us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b54003e15a0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d191606f 00007f25d198ef60 00007f25d19907de 00007f25d199ab49 00007f25d199b416 00007f25d1997d8f 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62
0709 12:58:50.667086 (+152300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.667303 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212166016}
I20260709 12:58:50.681980  1526 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:50.687294  1607 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:50.687734  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.689438  2342 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:50.690544  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:50.691171  2455 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:50.643678  4828 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:50.691623  2342 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:50.598790  4904 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:50.691847  1603 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:50.692075  1525 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:58:50.694043  1534 pending_rounds.cc:85] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 3
I20260709 12:58:50.702306  1534 pending_rounds.cc:107] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:58:50.702729  1534 raft_consensus.cc:2889] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:50.664194  4618 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:50.710852  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:50.707038  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:50.668100  4871 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.686360  4824 raft_consensus.cc:697] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:50.686012  4832 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:50.730340  4921 log.cc:927] Time spent T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:58:50.731123  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:50.731801  4912 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.719622  2342 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:50.684199  4897 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:50.735126  2475 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:50.734328  4908 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:58:50.735692  4699 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:50.736304  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:50.697268  4765 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:50.690961  4879 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:50.736238  4831 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:58:50.756719  4765 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:50.740157  4609 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:58:50.758013  4764 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:50.758855  4609 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:50.759069  4764 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:50.754849  4699 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:50.755503  4879 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.688832  4785 consensus_queue.cc:1059] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:58:50.591292  4698 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.746731  4662 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:50.821187  4842 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:50.821794  4662 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:50.821929  4842 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:50.822352  4662 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.823101  4842 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.721735  4783 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:50.838438  1527 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:50.743624  4897 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.721056  4755 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:50.750626  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:50.874150  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 123675us
I20260709 12:58:50.759449  4609 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:50.438503   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:50.782379  4772 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.885203  1532 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:58:50.799093  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.601576  4827 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.734328  4618 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.722494  4828 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:50.813331  4813 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:50.815178  4879 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:50.815464  4641 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.802587  4764 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:50.737988  4871 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.694128  4892 consensus_queue.cc:1059] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:58:50.825915  4698 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:50.830125  4640 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.006s
I20260709 12:58:50.832159  4904 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.809249  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:50.778929  4820 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:50.913667  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 104521us
W20260709 12:58:50.829356  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.845432  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.868481  2423 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:50.869763  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.880620  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:50.918321  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 163680us
W20260709 12:58:50.883208  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.918807  1525 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:58:50.892508  1647 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.439s	user 0.012s	sys 0.021s
I20260709 12:58:50.892629  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:50.849737  4783 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:50.921936  2455 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.881978  4819 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.887151  4758 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:50.907454  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:50.927974  1532 raft_consensus.cc:2376] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7. Re-sending same reply.
I20260709 12:58:50.909639  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.811038  4824 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.892211  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 708) took 2293 ms. Trace:
I20260709 12:58:50.880825  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.920630  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:50.927444  1647 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.474s	user 0.013s	sys 0.021s
W20260709 12:58:50.949808  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 1.51279e+06us
W20260709 12:58:50.950474  1647 leader_election.cc:336] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.649s (SENT)
I20260709 12:58:50.944810  2455 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:50.928993  1531 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:50.948885  1533 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:50.912873  4892 consensus_queue.cc:1243] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:58:50.953138  1533 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:50.951452  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.949286  1683 rpcz_store.cc:276] 0709 12:58:48.591643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.591761 (+   118us) service_pool.cc:224] Handling call
0709 12:58:48.592043 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.530527 (+938484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.884794 (+1354267us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54001f7f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:50.884962 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080486656}
I20260709 12:58:50.954492  1647 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:50.957588  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:50.954727  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:50.918267  4813 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:50.913112  4640 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:50.924220  4783 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:50.962179  1601 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:50.968264  1531 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:50.969980  1683 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:50.957402  4831 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:50.947078  4819 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:50.984601  1681 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:50.903157  4609 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.960628  4904 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:50.959860  4814 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.959630  4758 raft_consensus.cc:697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:50.968371  4813 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:51.005062  4609 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:51.011327  4923 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:58:51.012785  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 62350.2us
W20260709 12:58:51.013422  1647 leader_election.cc:336] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.708s (SENT)
W20260709 12:58:51.014268  1647 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.756s (SENT)
I20260709 12:58:51.074096  1606 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
W20260709 12:58:51.075891  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.086140  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 171059us
I20260709 12:58:51.090405  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:50.996454  4872 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:51.098616  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:51.098829  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:51.101243  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.101977  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.102411  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:51.110383  1679 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.110504  1674 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:51.103312  1675 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:58:51.105089  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 66420.6us
I20260709 12:58:50.998711  4831 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:50.974635  4662 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.131937  1679 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:51.135802  1647 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.961s (SENT)
I20260709 12:58:51.136513  1647 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:50.985168  4828 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.019058  4814 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:50.993878  4764 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.162104  4937 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:51.162689  4764 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:51.165706  4920 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 12:58:51.167510  4844 consensus_meta.cc:287] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 12:58:51.168450  4662 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.154515  4871 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:51.155505  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.156384  4618 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.160068  4699 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:51.185745  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:51.170605  1525 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:51.190721  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:51.218451  2423 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:51.186486  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:51.195103  2461 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:58:51.144627  4934 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.224865  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:51.226229  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.174471  4925 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:58:51.229333  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 139048us
W20260709 12:58:51.170276  4839 consensus_meta.cc:287] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.002s
I20260709 12:58:51.150389  4872 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:51.162689  4719 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:51.178218  4772 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:51.231199  2451 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:58:51.180635  4927 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:58:51.169526  4827 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.180884  4897 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.177210  4926 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:51.241514  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 105736us
I20260709 12:58:51.260771  2476 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:58:51.262315  1647 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.135s (SENT)
I20260709 12:58:51.262872  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.230026  4934 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.212572  4932 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:51.230615  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:51.256860  1500 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:51.274881  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.280988  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:51.281632  1609 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:51.291296  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 60755.7us
I20260709 12:58:51.292333  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:51.177901  4758 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.178385  4831 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.299541  1609 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:58:51.301154  1605 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:51.153906  4813 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.285945  4827 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:51.269852  4872 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:51.285241  4618 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:51.289619  4944 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:51.344901  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 58456.8us
I20260709 12:58:51.290473  4772 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:51.302027  4837 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:58:51.408491  4955 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.409190  4955 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:51.420270  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 128051us
I20260709 12:58:51.273068  4926 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:51.433960  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 99635.3us
I20260709 12:58:51.362136  4897 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.343713  4940 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.343436  4771 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:51.362515  4699 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.362264  4944 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.468812  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.334116  4942 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.415884  4955 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.284473  4932 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:51.452720  4927 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:58:51.420329  4618 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.476372  4944 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:51.476893  4933 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:58:51.341751  4945 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 12:58:51.475905  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.485225  4943 consensus_queue.cc:1059] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:51.486667  1647 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:51.471915  4641 consensus_meta.cc:287] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.002s
W20260709 12:58:51.496172  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.474391  4912 consensus_meta.cc:287] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.000s
I20260709 12:58:51.466843  4819 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:51.417846  4827 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.522244  1530 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:58:51.502444  4914 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:51.483320  4942 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:51.504330  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 119627us
W20260709 12:58:51.530398  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 44803.3us
I20260709 12:58:51.531569  1647 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:51.532966  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 57133.8us
I20260709 12:58:51.487267  4699 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.477524  4940 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.475605  4897 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.521373  4912 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:51.524590  4746 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.553575  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:51.527963  4819 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:51.562680  2475 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
W20260709 12:58:51.516187  4698 consensus_meta.cc:287] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.001s
W20260709 12:58:51.552713  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 144193us
I20260709 12:58:51.545661  4948 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:51.527839  4942 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.548768  4771 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:51.567024  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.575796  1608 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:58:51.576102  1647 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.547777  4816 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:51.579545  1607 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:58:51.579916  1607 pending_rounds.cc:85] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 7
I20260709 12:58:51.580144  1607 pending_rounds.cc:107] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:58:51.580447  1607 raft_consensus.cc:2889] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:51.582011  1647 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.585539  1647 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.588392  1498 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:51.573523  4765 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.590723  4765 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.591256  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.592816  4765 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:51.592917  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.593757  4820 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:51.593786  4945 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:51.594530  4820 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:51.594671  4945 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:51.594825  4618 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.608719  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.609418  1683 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:51.571513  4746 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:51.610459  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 62783.7us
I20260709 12:58:51.614986  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:51.618253  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.601883  4692 raft_consensus.cc:3055] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:51.619683  4641 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:51.584221  4935 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.581779  4477 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:51.611685  1497 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.616137  1602 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:51.625456  1683 raft_consensus.cc:2410] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:51.639703  1681 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:51.642885  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.643512  1676 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
W20260709 12:58:51.653410  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 60567.6us
I20260709 12:58:51.656271  1647 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.657661  1647 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:51.627154  4837 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.660567  2461 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:51.661581  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:51.581375  4771 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:51.662652  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 51031.1us
I20260709 12:58:51.629484  4904 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:51.629206  4692 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:51.600394  4908 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:58:51.668483  4641 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:51.674108  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.616878  4698 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:58:51.691804  1681 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:51.627635  4914 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:58:51.663812  4964 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:51.669235  4819 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:51.670377  4940 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.713173  1683 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:51.691617  4816 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:51.634882  4956 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:58:51.691248  4960 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.722998  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.729394  1676 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:51.645841  4935 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.725031  1681 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:51.698983  4933 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.676335  4837 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.730602  4926 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:51.690963  4904 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:51.724541  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:51.721921  4765 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.724572  4951 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:51.737353  1677 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:51.747398  1683 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:51.730439  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.728230  4827 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.727500  4832 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:51.724359  4819 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:51.763461  1681 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:51.756353  1677 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:51.732424  4908 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:51.733368  4816 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:51.748147  4937 raft_consensus.cc:3055] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:51.738931  4872 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:51.775208  1683 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:51.776744  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:51.739523  4932 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:51.752226  4699 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:51.784966  1676 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:58:51.786899  4961 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:58:51.780544  4951 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:51.788004  4837 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.730744  4641 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:51.795940  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.761010  4832 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:51.789361  4946 log.cc:927] Time spent T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.192s	user 0.001s	sys 0.001s
I20260709 12:58:51.791050  4966 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:58:51.783419  4937 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:51.742460  4933 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.732210  4960 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.826366  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:51.757999  4944 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.822639  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.759889  4765 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.824890  4699 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.844718  1677 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
W20260709 12:58:51.845397  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 80583.1us
I20260709 12:58:51.851428  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.852466  1676 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:51.750202  4692 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.847657  4932 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:51.782096  4908 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.861027  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:51.863370  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:51.866046  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:51.867063  1609 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:51.848383  4784 raft_consensus.cc:3055] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:51.872349  4784 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:51.874270  4784 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.876335  4784 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:51.858901  4937 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:51.878482  4965 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:51.878854  4937 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:51.880031  4908 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:51.880455  4962 log.cc:927] Time spent T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:58:51.859807  4932 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.881498  4932 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:51.882737  4944 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.859555  4699 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.887904  4699 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:51.888193  4970 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.888911  4970 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:51.890425  4764 consensus_meta.cc:287] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.003s
I20260709 12:58:51.891601  4692 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:51.891948  4904 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:51.893076  4719 consensus_meta.cc:287] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.001s
I20260709 12:58:51.881028  4828 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.893711  4933 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:51.893949  4828 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:51.894567  4914 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.895088  4914 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.897089  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.896910  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:51.897985  1676 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 5: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:51.898178  1677 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:51.857080  4819 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.864199  4816 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:51.993016  1649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.902s (SENT) [suppressed 39 similar messages]
I20260709 12:58:51.952895  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2128) took 1824 ms. Trace:
I20260709 12:58:51.940150  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:51.979024  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 302904us
W20260709 12:58:52.023742  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.038081  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.029191  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.038802  1677 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:52.026521  1600 rpcz_store.cc:276] 0709 12:58:50.128580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.128766 (+   186us) service_pool.cc:224] Handling call
0709 12:58:50.146049 (+ 17283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.541879 (+395830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.952629 (+1410750us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540033fed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:51.952832 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908811008}
I20260709 12:58:52.039906  1609 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:51.890760  4765 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:51.925132  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.051530  1529 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:51.867831  4971 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:51.910507  4609 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.905s	user 0.008s	sys 0.004s
W20260709 12:58:51.977358  4783 consensus_meta.cc:287] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.001s	user 0.012s	sys 0.000s
I20260709 12:58:51.909719  4828 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:51.968107  4662 raft_consensus.cc:3055] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:51.923332  4912 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.065390  4972 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:58:52.066095  4912 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.066602  4972 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:52.067039  4972 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:52.068236  4912 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.058038  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:51.881520  4935 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.069825  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.070390  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.070662  1526 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:52.071542  4699 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:52.064699  4924 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 1.070s	user 0.008s	sys 0.011s
I20260709 12:58:52.072315  4851 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:52.074052  4851 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:52.074818  4851 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.076982  1498 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:52.077227  4691 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:52.077939  4765 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:58:52.061128  4477 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.079545  1682 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:52.080193  1682 pending_rounds.cc:85] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 4
I20260709 12:58:52.080435  1682 pending_rounds.cc:107] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:52.080685  1682 raft_consensus.cc:2889] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:52.080487  4477 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.082249  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.060245  4784 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:58:51.925429  4771 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.056205  4827 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.062683  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:52.063493  4783 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:51.933971  4960 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:52.065443  4662 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:52.067930  4972 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.094162  4972 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:52.072110  4699 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:52.095055  4842 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:52.077963  4691 consensus_queue.cc:1243] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:52.079942  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:52.060060  4971 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.080644  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.099613  1683 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 4.
I20260709 12:58:51.869491  4897 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.079769  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:52.060436  1647 connection.cc:256] RPC call timeout handler was delayed by -1.6514992579999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 12:58:52.083969  2339 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:51.933430  4970 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.080595  4914 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.086642  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.089174  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.102212  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:52.105207  1603 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:52.092263  4827 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.070818  4956 raft_consensus.cc:3055] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:51.863551  4832 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.021770  4942 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.028867  4692 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:58:52.106982  1498 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:52.107385  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.108222  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.110442  1683 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:52.095121  4783 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.112151  4784 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:52.112623  4784 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.113127  4784 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.112654  4699 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.114111  4477 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.092311  4967 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:52.117983  4967 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:52.118443  4967 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:52.118948  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 1987) took 1444 ms (client timeout 1730 ms). Trace:
I20260709 12:58:52.119407  4832 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:52.119356  1608 rpcz_store.cc:269] 0709 12:58:50.674172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.674321 (+   149us) service_pool.cc:224] Handling call
0709 12:58:52.118745 (+1444424us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54003408d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:52.118872 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167354752}
I20260709 12:58:52.120242  4618 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:52.123132  4942 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.126657  4746 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.128527  4950 raft_consensus.cc:3055] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:52.129015  4950 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:52.132033  4827 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:52.132452  4949 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.725s	user 0.001s	sys 0.000s
I20260709 12:58:52.108752  4956 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:52.133546  4956 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.135255  4956 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:52.135350  4953 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.727s	user 0.004s	sys 0.000s
I20260709 12:58:52.058985  4932 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.138378  4692 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:52.139348  4692 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:52.140954  4932 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.140475  4692 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.142036  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1930) took 1165 ms. Trace:
I20260709 12:58:52.142094  4950 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.145074  4950 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:52.144440  1531 rpcz_store.cc:276] 0709 12:58:50.977753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.980961 (+  3208us) service_pool.cc:224] Handling call
0709 12:58:50.999937 (+ 18976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:51.227320 (+227383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.227354 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:51.236224 (+  8870us) log.cc:844] Serialized 26 byte log entry
0709 12:58:51.451291 (+215067us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:51.451352 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.451454 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:52.133842 (+682388us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:52.141692 (+  7850us) raft_consensus.cc:1685] finished
0709 12:58:52.141719 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:52.141946 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124,"raft.queue_time_us":142695,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7384,"spinlock_wait_cycles":28304768,"thread_start_us":353907,"threads_started":2,"wal-append.queue_time_us":121948}
I20260709 12:58:52.147385  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 527) took 1564 ms. Trace:
I20260709 12:58:52.147866  1606 rpcz_store.cc:276] 0709 12:58:50.583425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.583549 (+   124us) service_pool.cc:224] Handling call
0709 12:58:52.147197 (+1563648us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54001568d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:52.147324 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938051968}
I20260709 12:58:52.150990  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.151588  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:52.150259  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 66351.1us
I20260709 12:58:52.154616  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:52.154883  2339 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:52.156687  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:52.155684  4477 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:52.159720  4960 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:52.160202  4960 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.160624  4960 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:52.104991  4691 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.161315  4691 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.159031  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:52.106953  4935 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:52.167322  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:52.169965  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 63062.1us
I20260709 12:58:52.163928  4691 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.149982  4692 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.180138  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:52.182583  1675 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:52.183084  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.183931  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:51.887923  4951 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.184590  1683 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:52.164470  4783 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:52.222381  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.158311  4872 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:52.220115  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:52.225879  1605 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.219453  4699 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:52.230904  4699 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.233758  4828 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.234930  4828 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.238184  4971 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.241195  4828 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.243692  4828 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.245615  4828 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.158349  4827 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 12:58:52.251928  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:52.252396  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.256708  4906 raft_consensus.cc:3055] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:52.258504  4906 raft_consensus.cc:740] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:52.259356  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.259617  4906 consensus_queue.cc:260] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.260624  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.260819  4906 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.261973  4765 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:52.257278  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 680) took 1376 ms. Trace:
I20260709 12:58:52.262645  4765 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.262735  1525 rpcz_store.cc:276] 0709 12:58:50.880646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.928373 (+ 47727us) service_pool.cc:224] Handling call
0709 12:58:52.256899 (+1328526us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400198a54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:52.257049 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488340864}
I20260709 12:58:52.264807  4765 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.261910  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.173821  4772 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:52.265619  4772 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.266024  4772 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.267145  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.261848  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.176501  4764 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:52.288805  4828 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:52.291177  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:52.294009  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.295828  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.296216  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:52.297417  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.304798  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:52.308712  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.309832  1529 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:52.310365  1527 raft_consensus.cc:2410] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:58:52.295074  1683 raft_consensus.cc:2410] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:52.308665  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.312348  1533 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:52.315173  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.315935  1608 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:52.315793  2476 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:52.316692  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:52.318044  1609 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:52.319439  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.228463  4783 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.321152  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.325405  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.326284  2455 raft_consensus.cc:2410] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:58:52.329348  1527 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:52.172214  4662 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.320140  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.175501  4932 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:58:52.320972  2344 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:52.334702  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.334983  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.293757  4764 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.337658  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.347172  1606 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:52.338270  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.348408  1604 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:52.339920  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.341265  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:52.350950  2455 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:52.333218  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:52.343987  1683 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:52.351516  1600 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:52.346109  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:52.294209  4872 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:52.345682  1526 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:52.352411  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.352628  1679 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:52.353307  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.331303  4783 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:52.351879  4662 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:52.354068  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.359674  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.353935  1683 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:52.360888  1531 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:52.318907  4926 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:58:52.363929  2423 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:52.350134  4764 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:52.364869  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.374811  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.375900  1679 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:52.377990  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.378293  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:52.378731  1604 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:52.355597  4967 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.386715  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.389484  1600 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:52.350452  4699 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:52.390305  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.394907  2475 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:52.391153  1608 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:52.363360  4972 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:52.394096  1679 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:58:52.397127  4977 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:58:52.401420  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:52.415787  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41270 (request call id 228) took 12822 ms (client timeout 15000 ms). Trace:
I20260709 12:58:52.376751  4765 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:52.418138  1427 rpcz_store.cc:269] 0709 12:58:39.736511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.756408 (+ 19897us) service_pool.cc:224] Handling call
0709 12:58:52.415720 (+12659312us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:49.155846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:49.156657 (+   811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:49.156703 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:58:49.156731 (+    28us) tablet.cc:662] Decoding operations
0709 12:58:49.159535 (+  2804us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:49.159607 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:49.159643 (+    36us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:58:49.161021 (+  1378us) tablet.cc:701] Row locks acquired
0709 12:58:49.161061 (+    40us) write_op.cc:260] PREPARE: finished
0709 12:58:49.161246 (+   185us) write_op.cc:270] Start()
0709 12:58:49.161373 (+   127us) write_op.cc:276] Timestamp: P: 1783601929161179 usec, L: 0
0709 12:58:49.161400 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:58:49.162376 (+   976us) log.cc:844] Serialized 6025 byte log entry
0709 12:58:49.565137 (+402761us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:49.963429 (+398292us) op_driver.cc:464] REPLICATION: finished
0709 12:58:50.238632 (+275203us) write_op.cc:301] APPLY: starting
0709 12:58:50.245650 (+  7018us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:50.245986 (+   336us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:50.246011 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:50.248769 (+  2758us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:50.249138 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:58:50.249289 (+   151us) write_op.cc:312] APPLY: finished
0709 12:58:50.298098 (+ 48809us) log.cc:844] Serialized 107 byte log entry
0709 12:58:50.304430 (+  6332us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:50.310038 (+  5608us) write_op.cc:454] Released schema lock
0709 12:58:50.405831 (+ 95793us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:50.426014 (+ 20183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:50.430442 (+  4428us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3153,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":256379,"apply.run_cpu_time_us":5601,"apply.run_wall_time_us":187347,"num_ops":15,"prepare.queue_time_us":66448,"prepare.run_cpu_time_us":30262,"prepare.run_wall_time_us":223078,"raft.queue_time_us":211591,"raft.run_cpu_time_us":31696,"raft.run_wall_time_us":251760,"replication_time_us":749085,"spinlock_wait_cycles":21231360,"thread_start_us":506097,"threads_started":4,"wal-append.queue_time_us":284217,"wal-append.run_cpu_time_us":71617,"wal-append.run_wall_time_us":1988749}]]}
I20260709 12:58:52.422741  4772 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.377034  4943 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.423691  4957 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:52.424604  4784 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.427755  4814 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:52.429386  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.435205  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.436146  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1962) took 2425 ms. Trace:
I20260709 12:58:52.436256  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.437124  1525 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:52.437831  4934 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.391561  4967 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.455878  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.457620  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.450877  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.466050  1679 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:52.467190  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.467935  1532 raft_consensus.cc:2393] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:52.468716  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 66371.3us
I20260709 12:58:52.495760  1609 raft_consensus.cc:2368] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:58:52.497283  1608 raft_consensus.cc:2376] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6. Re-sending same reply.
I20260709 12:58:52.465298  1530 rpcz_store.cc:276] 0709 12:58:50.011058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.015401 (+  4343us) service_pool.cc:224] Handling call
0709 12:58:50.015687 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.522632 (+1506945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:52.435866 (+913234us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540028f0d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:52.436046 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3450370304}
W20260709 12:58:52.498930  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 59036.8us
I20260709 12:58:52.501358  1601 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:52.469439  1674 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:52.501713  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:52.502538  1675 raft_consensus.cc:2376] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4. Re-sending same reply.
I20260709 12:58:52.503264  1605 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:52.354936  4872 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.507385  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.418474  4765 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.467705  4871 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.512008  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:52.522866  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:52.527619  1607 raft_consensus.cc:2376] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10. Re-sending same reply.
I20260709 12:58:52.533778  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:52.543730  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.540964  1601 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:52.565733  1605 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:52.456662  4943 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.522694  4897 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:52.570509  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.491163  4957 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.533012  4912 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:52.574155  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 253259us
I20260709 12:58:52.509017  4947 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:58:52.532579  4967 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:52.562448  4828 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:52.586311  2344 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:52.593775  4912 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.598824  4851 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:52.599725  4765 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.600085  4912 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.593891  4692 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.594098  4926 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.601557  4926 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.601985  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.602573  1683 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
W20260709 12:58:52.603097  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.600971  4692 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.603675  4926 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.604192  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:52.605126  4699 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:52.605506  4699 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:52.605916  4699 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:52.606004  4692 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.607574  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.610229  4816 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:52.610853  4816 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.612888  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.613773  1683 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:58:52.613878  4765 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:52.614544  2344 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:52.615259  4765 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:52.615347  4842 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.615757  4765 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:52.616008  4842 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.616771  2344 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:52.616639  4765 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.624575  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.628309  1498 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:52.633219  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:52.633929  1609 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:52.642040  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.642692  2461 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:52.587832  4897 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.646838  1605 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:52.648530  4897 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.535408  4871 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.654044  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:52.655120  4871 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.594774  4828 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.669950  4828 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:52.586004  4814 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.673132  4814 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.675258  4957 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.677446  4758 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:52.678058  4758 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.680148  4758 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:52.685127  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:52.685885  1526 raft_consensus.cc:2376] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6. Re-sending same reply.
I20260709 12:58:52.689275  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.690001  4932 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:52.690143  1530 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:52.691076  4772 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.690368  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:52.691766  1526 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:52.692173  4784 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:52.693107  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 67706.9us
I20260709 12:58:52.693821  4981 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:52.694042  2344 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:52.695492  4981 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:52.700132  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.700874  1600 raft_consensus.cc:2376] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6. Re-sending same reply.
I20260709 12:58:52.701916  1606 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:52.701916  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.702884  1525 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:52.705777  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:52.706163  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:52.706730  1527 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.708216  1529 raft_consensus.cc:1240] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:52.716073  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.717885  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.718616  1531 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:52.725849  1526 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:52.726774  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.727581  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:52.727662  1530 raft_consensus.cc:2368] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6.
I20260709 12:58:52.730926  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.704644  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:52.732632  2475 raft_consensus.cc:2410] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:58:52.733843  1526 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:52.738029  2344 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:52.739524  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7c3ea752cffa4a138dd2984b56316ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3cabc5110903443ba3beb5cbb14afa91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:52.740868  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:52.737031  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 198013us
W20260709 12:58:52.728319  4960 consensus_meta.cc:287] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.000s
I20260709 12:58:52.757431  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.622725  4824 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.661007  4764 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.760937  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:52.771517  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.695397  4816 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.762585  1529 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:58:52.645821  4692 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:52.786414  1572 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:52.747467  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:52.796417  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.797310  1680 raft_consensus.cc:2410] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:52.790356  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:52.801587  2476 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:52.800133  1572 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:52.789191  4947 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:58:52.744242  4981 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:52.808717  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.835976  2451 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:52.623624  4967 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:52.611454  4783 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.751256  4932 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:52.754906  4897 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:52.791215  4926 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:52.841912  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.753902  4972 consensus_queue.cc:1059] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:58:52.845335  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.858551  1680 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:52.847765  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:52.849351  4989 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:52.791538  4960 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.860685  1674 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:52.850169  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.861786  2475 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:52.753669  4699 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.853360  1675 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:52.855615  2451 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
W20260709 12:58:52.856338  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 115546us
I20260709 12:58:52.863554  2455 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:52.835783  4981 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:52.841347  4912 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:52.874426  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.880263  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:52.887912  1532 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:52.882383  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:52.881255  4690 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:52.857822  4639 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:52.798384  4824 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.867331  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.806861  1527 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:52.895663  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.915079  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:52.915683  1680 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:52.903985  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.916273  1675 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:58:52.916388  4950 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:52.919333  1680 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:52.921342  4842 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.861908  4871 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:52.924326  4871 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.925522  4960 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:52.926537  4983 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:58:52.927683  4871 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.928449  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.930339  4764 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.930886  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:52.931059  4932 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.932090  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.932674  2474 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:52.933456  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:52.933987  2474 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.934062  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.935104  1500 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:52.935324  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.935987  2435 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:52.936463  4951 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:52.936889  4951 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.937233  4951 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:52.854640  4897 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:52.937326  2421 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:58:52.934347  1677 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:52.937786  2421 pending_rounds.cc:85] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 4
I20260709 12:58:52.938033  2421 pending_rounds.cc:107] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:58:52.938339  2421 raft_consensus.cc:2889] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:52.941761  4912 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:52.942945  4783 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.943179  4912 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:52.943691  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.945636  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.945827  4824 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:52.946642  4967 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.946936  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.891281  4690 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.947963  4814 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:52.948354  4690 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.948247  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:52.949790  4662 consensus_meta.cc:287] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 12:58:52.949543  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.951665  1677 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:52.952236  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:52.952338  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.953020  1677 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:52.953801  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.954684  1677 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:52.934202  2428 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:52.958210  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.956933  2474 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:52.962392  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:52.961244  2344 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:52.907961  1674 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:58:52.854969  4926 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:53.040057  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 78893.9us
I20260709 12:58:52.968192  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:53.041328  1606 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.968864  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:53.016423  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 46941.7us
I20260709 12:58:53.021024  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:53.023964  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.025202  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:52.974812  1603 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:53.052109  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:53.052748  1605 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:53.037250  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:52.892688  4981 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.054322  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:53.060850  1500 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:53.061329  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:53.062022  1681 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:53.052610  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 100439us
I20260709 12:58:53.062920  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:53.063617  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:53.054584  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:53.028023  1677 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:53.057605  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:53.066352  1604 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:53.062103  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:53.067348  1676 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.923290  4699 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:53.079856  1675 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:52.937793  4897 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:53.051388  1682 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:53.082952  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:53.057785  4844 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:53.086630  4844 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:53.087106  4844 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:53.087487  4844 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.068471  4955 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:53.050781  4926 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:53.061758  4972 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:53.115146  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:53.101142  1532 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:53.084245  1674 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:58:53.109247  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:53.109500  1606 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:53.110881  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:53.104542  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:53.009140  4967 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:58:53.119746  1675 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:53.130690  1602 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.008s	sys 0.035s
W20260709 12:58:53.131850  1602 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.008s	sys 0.035s
W20260709 12:58:53.113812  4906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.020s
I20260709 12:58:53.107542  4955 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:53.115784  4609 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.019s	sys 0.019s
W20260709 12:58:53.130405  4765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.039s
I20260709 12:58:53.130470  4956 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:53.159559  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.167449  1675 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
W20260709 12:58:53.158248  2343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.011s	sys 0.020s
I20260709 12:58:53.169872  1676 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
W20260709 12:58:53.174744  2343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.012s	sys 0.020s
W20260709 12:58:53.152951  4906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.010s	sys 0.021s
W20260709 12:58:53.173484  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.160971  4765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.004s	sys 0.039s
I20260709 12:58:53.130867  4972 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:53.117786  4758 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:58:53.176609  4956 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.159971  4955 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:53.160655  4609 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.019s	sys 0.019s
W20260709 12:58:53.202520  4851 consensus_meta.cc:287] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 12:58:53.203172  4827 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:53.216239  1533 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:53.216777  2474 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:53.199111  4813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.015s	sys 0.019s
I20260709 12:58:53.219218  2475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:53.209239  4956 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:53.239483  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:53.239086  4813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.015s	sys 0.019s
W20260709 12:58:53.260723  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 460609us
I20260709 12:58:53.264943  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:53.267644  1674 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:53.221012  4699 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.221352  4692 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:53.274821  1572 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:53.241266  4828 consensus_meta.cc:287] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.004s
I20260709 12:58:53.223702  4827 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:53.293071  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:53.294016  2461 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:53.299103  4943 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:53.262379  4872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.020s	sys 0.021s
I20260709 12:58:53.291527  1572 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:53.307008  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:53.308084  2476 raft_consensus.cc:2368] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:53.317699  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:53.328437  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:53.308722  4872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.021s	sys 0.021s
I20260709 12:58:53.306525  4692 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:53.287942  4892 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:58:53.288573  4972 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.354059  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:53.362023  4827 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.363240  2476 raft_consensus.cc:2393] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:53.368335  2476 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:53.380347  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1939) took 1071 ms. Trace:
W20260709 12:58:53.383090  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 673) took 2550 ms (client timeout 1670 ms). Trace:
W20260709 12:58:53.383708  1528 rpcz_store.cc:269] 0709 12:58:50.832272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.838163 (+  5891us) service_pool.cc:224] Handling call
0709 12:58:53.382730 (+2544567us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b540004d154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:53.382936 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5278228864}
W20260709 12:58:53.386270  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 94836us
I20260709 12:58:53.387295  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:53.388288  4892 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:53.389865  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:53.325719  4994 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.290818  4699 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.301271  4828 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:53.443648  1678 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:53.434607  1681 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:58:53.417047  2476 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:58:53.447134  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 57379.3us
W20260709 12:58:53.441710  1525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.020s
W20260709 12:58:53.450393  1525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.004s	sys 0.020s
W20260709 12:58:53.370707  4996 log.cc:927] Time spent T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 12:58:53.463085  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.009s	sys 0.013s
W20260709 12:58:53.464100  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.009s	sys 0.013s
I20260709 12:58:53.371258  4816 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.381003  1533 rpcz_store.cc:276] 0709 12:58:52.308574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.312960 (+  4386us) service_pool.cc:224] Handling call
0709 12:58:52.313230 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.217883 (+904653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.379978 (+162095us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54000c80d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:53.380257 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075805056}
I20260709 12:58:53.465256  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:53.468638  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 416918us
I20260709 12:58:53.448278  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:53.451951  4892 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:53.487032  1608 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.005s	sys 0.042s
W20260709 12:58:53.488970  1608 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.005s	sys 0.042s
I20260709 12:58:53.502578  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 1993) took 1188 ms. Trace:
I20260709 12:58:53.503067  1603 rpcz_store.cc:276] 0709 12:58:52.313782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.316479 (+  2697us) service_pool.cc:224] Handling call
0709 12:58:53.502383 (+1185904us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b5400155ed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:53.502510 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457268480}
I20260709 12:58:53.463033  4764 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.392387  4951 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.510944  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:53.463092  4824 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.373342  4692 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.500098  4892 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:53.453919  4994 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.496738  4816 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:53.513168  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64994.3us
I20260709 12:58:53.553697  1572 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:58:53.514510  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.549661  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.019s	sys 0.037s
W20260709 12:58:53.556138  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.550848  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 490044us
W20260709 12:58:53.556310  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.019s	sys 0.037s
I20260709 12:58:53.522765  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2006) took 1087 ms. Trace:
W20260709 12:58:53.563509  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 802554us
W20260709 12:58:53.557209  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.563660  1602 rpcz_store.cc:276] 0709 12:58:52.435623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.437667 (+  2044us) service_pool.cc:224] Handling call
0709 12:58:52.437966 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:52.438202 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:53.133757 (+695555us) log.cc:844] Serialized 14 byte log entry
0709 12:58:53.522291 (+388534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:53.522369 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:53.522440 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.522549 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.522696 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":768326,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":1065376,"threads_started":2}
I20260709 12:58:53.512962  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:53.514639  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 432621us
W20260709 12:58:53.515255  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 452380us
I20260709 12:58:53.571996  1500 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:53.579319  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:53.542038  4832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.009s	sys 0.032s
I20260709 12:58:53.532058  4912 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.526801  4892 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:53.515580  4662 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:53.526860  5000 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:53.582059  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:53.516675  5002 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:53.601658  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.023s
I20260709 12:58:53.602280  1500 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:53.589198  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 474086us
I20260709 12:58:53.622308  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:53.591332  4832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.010s	sys 0.033s
W20260709 12:58:53.620961  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.024s
I20260709 12:58:53.622290  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:53.625605  1500 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:53.582733  4950 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:53.633597  1649 leader_election.cc:400] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6.
I20260709 12:58:53.517776  4824 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.514760  4764 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.587618  4814 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:53.645880  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.636297  4872 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:53.639917  5010 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:53.640625  4997 log.cc:927] Time spent T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:58:53.636209  4950 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:53.640803  4690 consensus_meta.cc:287] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.005s
I20260709 12:58:53.633956  1649 leader_election.cc:403] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:53.582679  4639 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:58:53.631830  4972 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:53.675310  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:53.641382  4998 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 12:58:53.678992  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 45576us
I20260709 12:58:53.670804  5010 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.676951  4943 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:53.669003  4872 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:53.616788  4912 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.696812  2423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 778) took 1058 ms. Trace:
W20260709 12:58:53.688501  4844 consensus_meta.cc:287] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
W20260709 12:58:53.696408  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 283580us
W20260709 12:58:53.740626  1647 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.632s (SENT)
I20260709 12:58:53.705479  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:53.743247  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:53.745153  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 183439us
I20260709 12:58:53.746608  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:53.679066  4950 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:53.712779  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 344296us
I20260709 12:58:53.627722  5002 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.668356  4828 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:53.680125  4784 raft_consensus.cc:3055] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:53.672744  5008 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:53.711982  4926 consensus_meta.cc:287] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.003s
I20260709 12:58:53.734066  2423 rpcz_store.cc:276] 0709 12:58:52.639045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.639461 (+   416us) service_pool.cc:224] Handling call
0709 12:58:52.639809 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:52.697855 (+ 58046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:52.697908 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:52.698715 (+   807us) log.cc:844] Serialized 52 byte log entry
0709 12:58:53.175249 (+476534us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:53.175302 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.175378 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.694625 (+519247us) raft_consensus.cc:1685] finished
0709 12:58:53.694649 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.696750 (+  2101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57431,"raft.queue_time_us":59098,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":141,"thread_start_us":476083,"threads_started":1,"wal-append.queue_time_us":769910}
I20260709 12:58:53.741225  1647 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:53.707376  4943 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:53.692425  4824 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:53.685007  5021 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:53.707893  5010 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:53.764334  4995 log.cc:927] Time spent T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:58:53.690338  4934 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:58:53.812055  2455 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:53.684487  4690 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:53.766290  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 201173us
I20260709 12:58:53.683825  4758 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 5. Current term is 6.
I20260709 12:58:53.734992  4872 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.728853  5013 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:53.789458  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 276556us
I20260709 12:58:53.816011  4699 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:53.817826  4824 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:53.819568  5011 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.797576  4784 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:58:53.820604  5007 log.cc:927] Time spent T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:58:53.764644  4814 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:53.853780  4955 consensus_meta.cc:287] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.000s
I20260709 12:58:53.763962  5002 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:53.864610  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:53.763908  4827 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:53.762853  5012 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:58:53.869773  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 123261us
I20260709 12:58:53.863000  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:53.864283  2423 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:53.828981  5008 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:53.866107  1498 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:53.918249  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 52218.8us
I20260709 12:58:53.867965  1602 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:53.741854  4906 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:58:53.812273  4943 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:53.866181  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2044) took 1685 ms. Trace:
W20260709 12:58:53.883217  4981 consensus_meta.cc:287] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.000s
I20260709 12:58:53.761897  4844 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:53.914717  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 50214us
I20260709 12:58:53.884910  4758 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:53.915822  4827 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:53.830277  4851 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:53.917335  2455 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:53.953171  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:53.960281  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:53.961180  1528 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:53.965384  1529 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:53.921232  4609 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:53.936969  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 196344us
I20260709 12:58:53.875721  4816 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:53.811677  4926 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:53.937917  1678 rpcz_store.cc:276] 0709 12:58:52.180807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.181143 (+   336us) service_pool.cc:224] Handling call
0709 12:58:52.181436 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.450550 (+1269114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.865923 (+415373us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540015e354. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:53.866126 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2901987200}
I20260709 12:58:53.909124  4967 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.854200  5021 raft_consensus.cc:697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:53.944895  4932 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:53.884310  4828 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:58:53.988874  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:53.947971  4827 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.937667  5012 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:53.999826  1679 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:53.986001  1530 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:54.000324  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.001441  1678 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:53.917244  4814 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.030930  2475 raft_consensus.cc:606] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:53.917114  4955 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:53.984342  4990 log.cc:927] Time spent T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 1.119s	user 0.004s	sys 0.005s
I20260709 12:58:54.031459  2475 raft_consensus.cc:614] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:53.909035  5011 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.038163  2474 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:53.983053  4972 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:53.990461  4930 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.999287  4932 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.950484  4981 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:54.069526  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 143328us
I20260709 12:58:53.996413  4816 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:53.972025  4851 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:54.073769  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 156334us
W20260709 12:58:54.164086  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 58041.5us
I20260709 12:58:54.164799  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1988) took 1281 ms. Trace:
W20260709 12:58:54.078430  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 252508us
W20260709 12:58:54.192224  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 88531.4us
W20260709 12:58:54.200841  1647 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.730s (SENT)
W20260709 12:58:54.201726  1647 leader_election.cc:336] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.830s (SENT)
I20260709 12:58:54.215479  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:54.068459  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 782) took 1353 ms. Trace:
W20260709 12:58:54.120822  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 55562.7us
I20260709 12:58:53.996626  4967 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.060719  4842 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:54.014461  5031 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.202s
W20260709 12:58:54.203802  5019 log.cc:927] Time spent T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.504s	user 0.002s	sys 0.000s
W20260709 12:58:54.231204  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.230651  1647 leader_election.cc:336] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.932s (SENT)
I20260709 12:58:54.067245  4932 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:54.052747  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1961) took 1131 ms. Trace:
I20260709 12:58:53.995908  4784 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.198469  1527 rpcz_store.cc:276] 0709 12:58:52.882903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.081557 (+198654us) service_pool.cc:224] Handling call
0709 12:58:53.082073 (+   516us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:53.112705 (+ 30632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.112743 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:53.113355 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 12:58:53.500205 (+386850us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:53.500247 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.068782 (+568535us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b54001c1bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:54.068843 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.068906 (+    63us) raft_consensus.cc:1685] finished
0709 12:58:54.068921 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.164739 (+ 95818us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4279,"raft.queue_time_us":45315,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":5607,"spinlock_wait_cycles":59625344,"thread_start_us":348299,"threads_started":1,"wal-append.queue_time_us":487134}
I20260709 12:58:54.297298  2451 raft_consensus.cc:2393] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:54.289295  4912 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.307020  5011 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:54.307355  5038 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:58:54.066978  4930 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.308972  4967 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.309544  4930 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.311020  4851 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.289674  5012 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.314186  4784 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:54.277982  5025 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.508s	user 0.001s	sys 0.000s
I20260709 12:58:54.264864  5032 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:54.331699  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2008) took 1895 ms. Trace:
I20260709 12:58:54.218895  2461 rpcz_store.cc:276] 0709 12:58:52.715017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.715152 (+   135us) service_pool.cc:224] Handling call
0709 12:58:52.745216 (+ 30064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.294532 (+549316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.068157 (+773625us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b5400530f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:54.068385 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261540096}
W20260709 12:58:54.244498  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 44292.5us
I20260709 12:58:54.240789  5046 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:54.278126  4609 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:54.161803  4764 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.163197  5009 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:54.223802  5007 log.cc:927] Time spent T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:58:54.192613  4758 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:54.283526  1680 rpcz_store.cc:276] 0709 12:58:52.920894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.922624 (+  1730us) service_pool.cc:224] Handling call
0709 12:58:52.923112 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:52.924282 (+  1170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:52.924324 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:52.925593 (+  1269us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.441453 (+515860us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:53.797721 (+356268us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.052256 (+254535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.052374 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.052448 (+    74us) raft_consensus.cc:1685] finished
0709 12:58:54.052469 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.052658 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":440102,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":364141,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":41286,"thread_start_us":1053347,"threads_started":3,"wal-append.queue_time_us":661907}
W20260709 12:58:54.316946  4897 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.201s	user 0.010s	sys 0.001s
W20260709 12:58:54.266304  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 307113us
I20260709 12:58:54.341455  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.421211  1603 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:58:54.343443  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.341852  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.422299  1497 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:54.422624  1606 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:54.342406  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.423401  1533 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:54.422676  1609 raft_consensus.cc:2410] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:54.214530  4816 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.357165  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.436964  1600 raft_consensus.cc:2410] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:54.357357  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:54.275358  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 44703.4us
I20260709 12:58:54.223138  5041 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
W20260709 12:58:54.333369  4956 consensus_meta.cc:287] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.105s	user 0.013s	sys 0.000s
I20260709 12:58:54.365293  5033 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:54.383442  4692 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:54.386004  5040 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.383s	user 0.000s	sys 0.000s
I20260709 12:58:54.386814  4960 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.387081  4814 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.411031  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:54.418736  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:54.357358  5006 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.473s	user 0.000s	sys 0.001s
I20260709 12:58:54.423651  1605 raft_consensus.cc:2393] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:54.338585  1608 rpcz_store.cc:276] 0709 12:58:52.436239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.506950 (+ 70711us) service_pool.cc:224] Handling call
0709 12:58:52.509335 (+  2385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:52.509695 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:52.509730 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:52.510174 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:58:52.825394 (+315220us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:53.496620 (+671226us) log.cc:844] Serialized 14 byte log entry
0709 12:58:53.513782 (+ 17162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.513895 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.737890 (+223995us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:54.316581 (+578691us) raft_consensus.cc:1685] finished
0709 12:58:54.331403 (+ 14822us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.331614 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16411,"prepare.queue_time_us":457639,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":19654,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":19980,"spinlock_wait_cycles":2624256,"thread_start_us":907869,"threads_started":2,"wal-append.queue_time_us":319305}
I20260709 12:58:54.439636  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:54.439985  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:54.335278  4930 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:54.336297  5032 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:54.437498  1601 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:58:54.452064  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:54.452101  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.458097  1647 leader_election.cc:336] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.033s (SENT)
I20260709 12:58:54.289687  5039 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 12:58:54.354936  5014 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:54.476851  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 54643.8us
I20260709 12:58:54.069355  5008 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.419685  4926 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.497493  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:54.515944  1600 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:54.500154  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:54.488937  1528 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:54.494313  1680 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
W20260709 12:58:54.501608  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 286217us
I20260709 12:58:54.518752  1649 leader_election.cc:400] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:54.488665  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:54.519210  1649 leader_election.cc:403] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:54.519520  1527 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:54.497656  1531 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:58:54.520305  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:54.499002  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:54.488181  5062 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.544064  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.547094  1601 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:54.507061  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:54.507779  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 49741us
I20260709 12:58:54.331712  5051 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 12:58:54.509620  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:54.447578  5046 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:54.268857  5021 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.510880  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:54.511158  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:54.487167  5036 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.471s	user 0.001s	sys 0.000s
I20260709 12:58:54.512109  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:54.514392  1497 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:54.470945  4690 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.521274  1528 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:58:54.586687  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:54.332166  4972 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.522809  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.593523  1608 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:58:54.490553  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.001s	sys 0.013s
W20260709 12:58:54.594144  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.001s	sys 0.013s
I20260709 12:58:54.521664  5064 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.462769  5056 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:58:54.551167  1647 leader_election.cc:336] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.152s (SENT)
I20260709 12:58:54.445778  4897 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.436007  5009 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.492116  5033 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:54.552531  2476 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:54.575325  1531 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:54.576408  2421 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:54.581213  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 53210.3us
I20260709 12:58:54.471061  4956 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.584080  2435 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:58:54.586273  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71962.4us
I20260709 12:58:54.510872  5047 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:54.568123  5062 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.595919  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:54.591156  5040 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:58:54.551878  4824 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:54.602775  1600 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:54.491605  4692 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:58:54.553469  4955 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.663256  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:54.663846  1600 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:54.648593  4892 consensus_meta.cc:287] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.022s	user 0.011s	sys 0.000s
W20260709 12:58:54.609304  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.611825  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:54.590996  5032 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.651067  2421 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:54.653677  5017 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.435s	user 0.001s	sys 0.001s
I20260709 12:58:54.508756  4930 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.656450  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:54.616847  5050 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.642905  4816 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.618189  1534 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:54.658716  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 138458us
I20260709 12:58:54.660316  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:54.662649  1602 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:54.665772  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.617316  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.633674  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:54.584906  4758 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.597939  4814 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:54.673885  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 62193.6us
I20260709 12:58:54.656230  5056 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.646050  4981 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.721132  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:54.678025  4851 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:54.679909  4930 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:54.657109  4639 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.680542  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:54.681298  4827 consensus_meta.cc:287] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.001s
I20260709 12:58:54.526995  5059 consensus_queue.cc:1059] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 12:58:54.681718  4824 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:54.593750  4764 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:54.637125  5064 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.517817  5014 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.594091  4844 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.670594  5047 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:54.522320  4609 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.686745  1600 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:54.701624  2423 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:58:54.714931  2421 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:54.498889  4960 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:54.740953  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.770742  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 115158us
I20260709 12:58:54.687386  5044 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:54.774231  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 223054us
I20260709 12:58:54.776741  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47496 (request call id 13) took 1483 ms. Trace:
W20260709 12:58:54.852859  1647 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.155s (SENT)
I20260709 12:58:54.852569  2475 rpcz_store.cc:276] 0709 12:58:53.213455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.213622 (+   167us) service_pool.cc:224] Handling call
0709 12:58:54.693678 (+1480056us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54002931d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1992853 00007f25d696060a 00007f25cfee67d4 00007f25cfee6762 00007f25cfee6691 00007f25cfee660c 00007f25cfee58c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:54.693838 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1860297600}
I20260709 12:58:54.660967  4967 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:54.778833  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 57788.7us
I20260709 12:58:54.581497  5046 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.673872  4892 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.779572  4955 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.827677  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:54.864413  1601 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:54.729269  4814 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.667747  5048 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:54.772047  5032 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:54.848438  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:58:54.827418  5002 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.893s	user 0.012s	sys 0.000s
I20260709 12:58:54.826418  5035 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:58:54.853632  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:54.794073  5041 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:54.856907  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:54.827840  4813 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.012s
I20260709 12:58:54.858263  1575 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:54.809316  1608 raft_consensus.cc:2410] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:54.827086  4824 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:54.833297  4930 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7.
I20260709 12:58:54.835395  5039 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:54.908852  5039 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.911075  5039 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.874953  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:54.912367  1497 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:54.915493  5037 log.cc:927] Time spent T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 12:58:54.917156  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1989) took 2033 ms. Trace:
I20260709 12:58:54.918669  5062 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:54.917622  1526 rpcz_store.cc:276] 0709 12:58:52.883323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.077980 (+194657us) service_pool.cc:224] Handling call
0709 12:58:53.078348 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.630606 (+552258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.630647 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:53.631474 (+   827us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.849932 (+218458us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:54.018464 (+168532us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.060213 (+ 41749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.060308 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.916939 (+856631us) raft_consensus.cc:1685] finished
0709 12:58:54.916958 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.917087 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30315,"prepare.queue_time_us":676560,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":340243,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":16752,"thread_start_us":863159,"threads_started":3,"wal-append.queue_time_us":649594}
I20260709 12:58:54.918920  5009 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.847321  5033 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.921883  5046 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:54.923574  5064 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.928434  4960 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.863509  5044 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.857409  4816 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:54.901782  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 43619.7us
I20260709 12:58:54.902786  1607 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:54.823263  4639 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.897161  5041 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.878254  5002 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.898360  4844 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:54.904752  5008 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:54.935377  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:54.939981  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:54.729926  5050 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.829494  4827 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.842757  4764 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.944355  1608 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:54.873620  4814 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:54.935092  4813 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.006s	sys 0.013s
I20260709 12:58:54.937582  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.951607  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:54.878885  4897 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.952454  5039 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.952564  5043 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:54.953133  5068 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:54.957118  1600 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:54.771525  5056 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.932492  4824 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:54.936324  5041 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:54.866569  4967 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.970546  1674 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:54.949386  5035 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:54.982280  5015 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:54.983122  4892 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:54.945199  4955 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:58:54.985400  5070 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:58:54.870687  5047 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:54.987996  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:54.988852  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 286069us
I20260709 12:58:54.933375  5059 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:58:54.956194  5044 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.951066  5064 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:58:54.966853  4956 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:54.967082  5012 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:54.988917  5035 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.993984  5015 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:54.998622  1526 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:54.878355  5048 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:55.093199  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:54.978912  5039 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:54.983777  5061 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:58:55.239027  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.316030  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.104763  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.122506  1677 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:58:55.317629  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.113173  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:55.118021  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.312928  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 460048us
I20260709 12:58:55.314319  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:55.320129  1647 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.249s (SENT)
I20260709 12:58:55.320191  1679 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:55.316865  1682 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:55.321996  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.323654  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.332469  1679 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:55.071750  5057 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:55.064282  4950 consensus_meta.cc:287] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.207s	user 0.009s	sys 0.004s
I20260709 12:58:55.332609  1683 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:55.340515  5071 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:55.342120  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:55.349321  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.315611  5070 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:58:55.354171  2421 raft_consensus.cc:3055] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:55.317327  5015 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:55.349092  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:55.356611  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:55.394800  2435 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:55.357883  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:55.396086  2476 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:55.101397  5055 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:55.372323  2455 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:55.315181  5035 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:55.197139  4897 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.113200  5046 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.277s
I20260709 12:58:55.081578  5014 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.379776  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:55.380147  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:55.101603  5060 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.073916  4816 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:55.112453  5043 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.112520  5067 raft_consensus.cc:3055] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:55.269992  5008 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.388510  2421 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:55.355151  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:55.389349  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:55.471092  2423 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:55.471189  1526 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
W20260709 12:58:55.384444  5010 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.517s	user 0.006s	sys 0.009s
I20260709 12:58:55.346524  4609 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:55.412956  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1990) took 2529 ms. Trace:
I20260709 12:58:55.483776  1530 rpcz_store.cc:276] 0709 12:58:52.883734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.089687 (+205953us) service_pool.cc:224] Handling call
0709 12:58:53.103058 (+ 13371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.015588 (+912530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.412754 (+1397166us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54003192d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.412903 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027657600}
I20260709 12:58:55.382704  4972 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.100878  5062 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:55.392179  4943 consensus_meta.cc:287] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.438s	user 0.008s	sys 0.004s
W20260709 12:58:55.418761  5081 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 12:58:55.381525  5000 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:55.379876  5009 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:55.432715  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:55.509389  1683 raft_consensus.cc:2376] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11. Re-sending same reply.
W20260709 12:58:55.432472  4784 consensus_meta.cc:287] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.118s	user 0.013s	sys 0.001s
I20260709 12:58:55.442019  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:55.453186  2461 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:55.410830  5055 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.462915  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:55.463662  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1994) took 1041 ms. Trace:
W20260709 12:58:55.455910  4758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.026s	sys 0.018s
I20260709 12:58:55.414439  4699 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.480123  2435 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:55.387730  4950 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.419714  4951 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.487411  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.388693  4930 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:55.466306  5067 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:55.375540  5057 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.433459  4897 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:55.607038  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 220718us
I20260709 12:58:55.516868  1532 rpcz_store.cc:276] 0709 12:58:54.421923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.422047 (+   124us) service_pool.cc:224] Handling call
0709 12:58:54.422384 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.422717 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.422745 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.446359 (+ 23614us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.660919 (+214560us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:54.725836 (+ 64917us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.770859 (+ 45023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.771007 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.463401 (+692394us) raft_consensus.cc:1685] finished
0709 12:58:55.463430 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.463590 (+   160us) inbound_call.cc:177] Queueing success response
0709 12:58:55.511535 (+ 47945us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800096e20. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab522 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
Metrics: {"mutex_wait_us":44287,"prepare.queue_time_us":63584,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":65019,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":78351,"spinlock_wait_cycles":23379712,"thread_start_us":139480,"threads_started":1,"wal-append.queue_time_us":319848}
I20260709 12:58:55.594170  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.495087  5002 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.487728  5074 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
W20260709 12:58:55.520246  4758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.027s	sys 0.018s
I20260709 12:58:55.464861  5060 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:55.512593  5080 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:58:55.605113  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:55.475050  5043 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.500845  4609 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:55.509296  4764 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:55.498848  4639 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.612284  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.590741  5066 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:55.599426  4872 consensus_meta.cc:287] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.715s	user 0.013s	sys 0.001s
I20260709 12:58:55.651012  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:55.487711  5008 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.521399  5055 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:55.596077  5012 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.493870  5059 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.634873  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:55.498379  4943 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:55.499513  4972 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.645658  1683 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:55.632764  5002 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:55.657183  4872 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:55.658085  5085 log.cc:927] Time spent T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:58:55.658695  5066 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.663247  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.663941  1675 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:55.664001  5043 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:55.666944  4814 consensus_meta.cc:287] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.000s
I20260709 12:58:55.645200  5061 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.594456  4699 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.669992  5089 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:55.673795  5047 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:55.674067  5067 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.494369  5010 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.677955  5048 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:55.630028  5064 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:55.673834  5082 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 12:58:55.678992  5060 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:55.680502  5008 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.681066  4950 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.707650  4814 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.723958  4994 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:55.726722  4814 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.653091  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:55.728230  1608 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:55.729135  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 783) took 2455 ms. Trace:
I20260709 12:58:55.709633  5061 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.729579  2474 rpcz_store.cc:276] 0709 12:58:53.274003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.274163 (+   160us) service_pool.cc:224] Handling call
0709 12:58:53.274546 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.039958 (+765412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.728891 (+1688933us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54002931d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.729053 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755524864}
I20260709 12:58:55.732426  5061 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.618343  5039 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.725028  5066 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.745663  5067 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:55.710950  5089 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.759344  4609 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:55.768625  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.704080  5002 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:55.772971  5002 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:55.775133  4699 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:55.780450  5032 consensus_meta.cc:287] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.906s	user 0.005s	sys 0.005s
I20260709 12:58:55.694321  1527 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:55.695917  4943 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:55.692147  5012 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:55.697644  4824 consensus_meta.cc:287] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.001s
I20260709 12:58:55.951586  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1953) took 1478 ms. Trace:
W20260709 12:58:55.693109  4813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.011s	sys 0.044s
I20260709 12:58:55.698482  4897 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:55.700191  4972 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:55.702576  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 291009us
W20260709 12:58:55.691242  4932 consensus_meta.cc:287] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.369s	user 0.005s	sys 0.008s
I20260709 12:58:55.525445  5009 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.704998  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:55.969910  4813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.011s	sys 0.044s
I20260709 12:58:55.705693  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:55.684547  5056 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:55.701092  4764 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:55.710170  1678 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:55.682092  5087 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:58:55.729261  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:55.733757  5077 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:58:55.690522  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 56393.7us
I20260709 12:58:55.979897  4943 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:55.721438  5064 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:55.787668  4872 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.795902  5057 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.797052  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 542) took 1456 ms. Trace:
I20260709 12:58:55.797922  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 1993) took 1376 ms. Trace:
W20260709 12:58:55.802798  4999 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.889s	user 0.000s	sys 0.011s
I20260709 12:58:56.021848  1534 rpcz_store.cc:276] 0709 12:58:54.421635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.423089 (+  1454us) service_pool.cc:224] Handling call
0709 12:58:54.475001 (+ 51912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.722028 (+247027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.797718 (+1075690us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400318dd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.797867 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328760704}
W20260709 12:58:55.804102  5075 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.897s	user 0.006s	sys 0.003s
I20260709 12:58:55.820683  5061 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.821513  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 716) took 1311 ms. Trace:
W20260709 12:58:55.827354  2451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 789) took 2897 ms (client timeout 2165 ms). Trace:
I20260709 12:58:56.027841  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:56.028887  2475 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:55.828306  2428 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:55.835474  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:55.838359  5027 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.889s	user 0.014s	sys 0.015s
W20260709 12:58:55.869846  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.026552  2455 rpcz_store.cc:276] 0709 12:58:54.510264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.510395 (+   131us) service_pool.cc:224] Handling call
0709 12:58:54.516226 (+  5831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:55.411882 (+895656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.821241 (+409359us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54005267d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.821446 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968372608}
I20260709 12:58:55.870976  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.034718  1606 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:55.878841  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:55.882301  5054 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.952s	user 0.006s	sys 0.009s
I20260709 12:58:55.886921  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:55.888631  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2189) took 2022 ms. Trace:
I20260709 12:58:55.892740  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:56.043565  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 756) took 1969 ms. Trace:
I20260709 12:58:55.906682  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:55.907171  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:55.911173  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:55.911829  2461 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:58:55.916549  5015 consensus_meta.cc:287] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.501s	user 0.002s	sys 0.005s
I20260709 12:58:55.919803  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 554) took 1569 ms. Trace:
I20260709 12:58:55.924470  4827 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.925871  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:55.927230  5050 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:55.929653  5010 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.929683  4934 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:55.933027  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 754) took 1932 ms. Trace:
I20260709 12:58:55.932842  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:55.936628  5089 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:55.944828  5035 consensus_meta.cc:287] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.001s
I20260709 12:58:55.949726  4967 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:55.952020  1527 rpcz_store.cc:276] 0709 12:58:54.473025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.520110 (+ 47085us) service_pool.cc:224] Handling call
0709 12:58:54.520352 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:55.950740 (+1430388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.951330 (+   590us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003af054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.951522 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699421568}
I20260709 12:58:55.952968  1605 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:55.965689  2476 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:55.486624  5083 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.162s
I20260709 12:58:55.499312  5062 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.087112  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:55.970296  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.043s
I20260709 12:58:55.987366  2344 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:55.517167  5000 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:55.992944  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.000555  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:55.701305  5059 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.090248  1608 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:55.998499  4764 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.093132  1680 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:56.012604  1500 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:56.094017  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 81501.8us
I20260709 12:58:56.094908  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:56.096025  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:55.978826  4844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.132s	sys 0.174s
I20260709 12:58:56.021322  1602 rpcz_store.cc:276] 0709 12:58:54.340633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.340766 (+   133us) service_pool.cc:224] Handling call
0709 12:58:54.341060 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.700576 (+359516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.796834 (+1096258us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54003403d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.796998 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739121408}
I20260709 12:58:55.828007  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 755) took 1826 ms. Trace:
W20260709 12:58:56.026782  2451 rpcz_store.cc:269] 0709 12:58:52.930172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.036841 (+106669us) service_pool.cc:224] Handling call
0709 12:58:55.825525 (+2788684us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400750dd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:55.827208 (+  1683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2859474688}
I20260709 12:58:56.037328  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:55.732877  2421 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.105810  1675 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:56.106065  2421 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.044445  2435 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:56.044066  1678 rpcz_store.cc:276] 0709 12:58:54.074567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.074943 (+   376us) service_pool.cc:224] Handling call
0709 12:58:54.075349 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:55.998902 (+1923553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.033241 (+ 34339us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540045b5d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:56.043498 (+ 10257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3759269248}
I20260709 12:58:56.107288  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:56.045231  1600 rpcz_store.cc:276] 0709 12:58:54.349970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.938682 (+588712us) service_pool.cc:224] Handling call
0709 12:58:54.955364 (+ 16682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.976058 (+ 20694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.919417 (+943359us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5400268ed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.919713 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3565312}
I20260709 12:58:56.043378  1607 rpcz_store.cc:276] 0709 12:58:53.866633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.868742 (+  2109us) service_pool.cc:224] Handling call
0709 12:58:53.881830 (+ 13088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.934579 (+1052749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.888303 (+953724us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540020eed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.888551 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336038784}
I20260709 12:58:56.056690  1609 raft_consensus.cc:2410] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:56.058363  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.044155  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:56.085086  5012 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:58:56.059195  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 691) took 3354 ms. Trace:
I20260709 12:58:56.056864  5061 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.064311  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:56.065382  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:56.065840  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 133122us
I20260709 12:58:56.117514  1608 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:56.064738  1681 rpcz_store.cc:276] 0709 12:58:54.000920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.001054 (+   134us) service_pool.cc:224] Handling call
0709 12:58:54.035163 (+ 34109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.496914 (+461751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.496943 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:54.496984 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:54.497021 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.932741 (+1435720us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400443ed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.932808 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.932954 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061460224}
I20260709 12:58:56.118852  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:56.068166  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:56.074515  2475 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:56.075435  4934 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.085688  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 784) took 2810 ms. Trace:
I20260709 12:58:56.087286  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:56.122450  2428 rpcz_store.cc:276] 0709 12:58:53.275030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.275162 (+   132us) service_pool.cc:224] Handling call
0709 12:58:55.828040 (+2552878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.029957 (+201917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.085392 (+ 55435us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b5400750dd0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:56.085599 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5813260032}
I20260709 12:58:56.122987  1601 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.087793  2476 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:55.951371  4824 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:56.087807  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.010s	sys 0.044s
W20260709 12:58:56.088570  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 101328us
W20260709 12:58:56.091497  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.020951  4943 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:56.089613  1682 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:56.078789  4842 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:56.109300  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 65249.1us
I20260709 12:58:56.093303  5050 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:56.101097  1674 rpcz_store.cc:276] 0709 12:58:54.001359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.001704 (+   345us) service_pool.cc:224] Handling call
0709 12:58:54.002058 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.980049 (+977991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.827747 (+847698us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54002ff3d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:55.827936 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226865408}
I20260709 12:58:56.107288  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:56.099340  4967 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:56.114662  1525 rpcz_store.cc:276] 0709 12:58:52.705154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.709384 (+  4230us) service_pool.cc:224] Handling call
0709 12:58:52.709681 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:52.796061 (+ 86380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:52.796097 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:52.797018 (+   921us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.450918 (+653900us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:53.450962 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.451051 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.802074 (+2351023us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:56.034072 (+231998us) raft_consensus.cc:1685] finished
0709 12:58:56.034098 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.059109 (+ 25011us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85646,"raft.queue_time_us":85803,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":46242560,"thread_start_us":653482,"threads_started":1,"wal-append.queue_time_us":2065843}
I20260709 12:58:56.138341  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:56.107918  1602 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:56.061525  5015 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:55.992075  4932 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:56.164671  4967 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.118451  5010 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:56.171417  4967 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.171492  5010 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.172010  5010 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:56.115250  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:56.119997  1609 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:58:56.100864  4844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.133s	sys 0.174s
I20260709 12:58:56.121829  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:56.126040  2344 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:56.126286  2421 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:58:56.126822  1675 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:56.174615  2421 pending_rounds.cc:85] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 7
I20260709 12:58:56.174927  2421 pending_rounds.cc:107] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 7.8
W20260709 12:58:56.174953  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 48998.9us
I20260709 12:58:56.175447  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.176635  1675 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:58:56.098017  4764 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.130005  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:56.181129  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:56.182056  2451 raft_consensus.cc:2410] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:58:56.062839  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:56.183455  2461 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:56.184697  2423 raft_consensus.cc:2393] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:58:56.185755  5041 consensus_meta.cc:287] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.185s	user 0.010s	sys 0.003s
I20260709 12:58:56.185987  5015 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:56.186187  5041 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.187706  4932 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:56.131247  1606 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:56.179994  5012 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:56.190785  5061 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.107904  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:56.191563  1678 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:56.191437  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.192561  4934 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.099542  5056 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:56.193202  5056 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:56.133950  1676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.017s	sys 0.041s
I20260709 12:58:56.193583  5056 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:56.193783  1676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.017s	sys 0.041s
I20260709 12:58:56.139008  1682 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:56.138342  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.085312  5035 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.120888  1500 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:56.166087  1674 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: [6.6-9.8]
I20260709 12:58:56.226415  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:56.227583  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.109305  5068 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:56.173439  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2018) took 1226 ms. Trace:
I20260709 12:58:56.175314  2421 raft_consensus.cc:2889] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:56.128352  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:56.185642  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:56.190894  1607 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:56.134660  2435 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:58:56.130904  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:56.197962  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.132942  4842 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:56.224460  5055 consensus_meta.cc:287] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.003s
I20260709 12:58:56.199190  5009 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:56.129508  4851 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:58:56.192723  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.198203  5062 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.194479  4943 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:56.209420  5056 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.215555  5064 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.134385  5050 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.216053  5094 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.218050  5000 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:56.140929  5013 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:56.182806  4844 raft_consensus.cc:697] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:56.180182  5054 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:58:56.214169  5059 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.221607  1681 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 3.
I20260709 12:58:56.233634  1674 raft_consensus.cc:2410] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:56.249892  1602 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:56.211820  4967 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.254355  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:56.255290  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 134191us
I20260709 12:58:56.276017  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60652 (request call id 104) took 1312 ms. Trace:
I20260709 12:58:56.332960  1600 rpcz_store.cc:276] 0709 12:58:54.908358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.113942 (+1205584us) service_pool.cc:224] Handling call
0709 12:58:56.220638 (+106696us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:56.256955  1608 raft_consensus.cc:2376] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7. Re-sending same reply.
I20260709 12:58:56.265307  2421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:56.313309  1678 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:56.334184  2421 raft_consensus.cc:606] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:56.254742  1609 rpcz_store.cc:276] 0709 12:58:54.947329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.119060 (+1171731us) service_pool.cc:224] Handling call
0709 12:58:56.119606 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.173195 (+ 53589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.173380 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:56.334450  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.265592  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:56.335337  2451 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:56.265751  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 134926us
W20260709 12:58:56.296422  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 550) took 1953 ms (client timeout 1646 ms). Trace:
W20260709 12:58:56.294370  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.336369  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:56.329026  2461 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:56.300359  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:56.301040  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 302156us
I20260709 12:58:56.325718  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.338276  1680 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
W20260709 12:58:56.307919  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 465186us
I20260709 12:58:56.258356  2423 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.272472  1606 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:56.320164  1498 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:56.275489  2342 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.024s	sys 0.051s
W20260709 12:58:56.340378  2342 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.025s	sys 0.052s
I20260709 12:58:56.283444  1603 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:56.342434  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.335237  1608 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:58:56.337409  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.344969  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.345691  1680 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:56.253543  2475 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:56.347764  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:56.336194  1605 rpcz_store.cc:269] 0709 12:58:54.342888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.506827 (+163939us) service_pool.cc:224] Handling call
0709 12:58:56.296253 (+1789426us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400267ad4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:56.296353 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3229016832}
I20260709 12:58:56.350700  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.351809  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:56.352339  1605 raft_consensus.cc:2376] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7. Re-sending same reply.
I20260709 12:58:56.353113  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.346778  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:56.358661  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:56.359522  1605 raft_consensus.cc:2410] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:56.359845  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.360733  1682 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:58:56.360888  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.361487  1678 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [5.7-8.8]
I20260709 12:58:56.361407  1680 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 3.
I20260709 12:58:56.367058  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:56.367309  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:56.349646  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7c3ea752cffa4a138dd2984b56316ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3cabc5110903443ba3beb5cbb14afa91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:56.984601  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.270385  4932 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:56.994287  1682 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:56.451277  2475 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:56.456934  5089 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:56.995908  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 801) took 1087 ms. Trace:
I20260709 12:58:56.996137  5089 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:56.996426  2475 rpcz_store.cc:276] 0709 12:58:55.908500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.446943 (+538443us) service_pool.cc:224] Handling call
0709 12:58:56.451025 (+  4082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.995666 (+544641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.995855 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:56.872104  5035 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.796744  1678 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:56.985849  5083 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:56.985126  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.469094  1572 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:56.270519  5055 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.758483  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2194) took 1379 ms. Trace:
W20260709 12:58:56.829078  1601 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.000s
I20260709 12:58:56.496557  2421 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:57.001754  1601 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:58:57.001405  1603 rpcz_store.cc:276] 0709 12:58:55.379055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.122197 (+743142us) service_pool.cc:224] Handling call
0709 12:58:56.122489 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.341785 (+219296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.758118 (+416333us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000ecc54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:56.758393 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369643392}
I20260709 12:58:56.301744  5013 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:57.002641  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 2217) took 1231 ms. Trace:
I20260709 12:58:56.987090  4967 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.866925  5041 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:56.991142  1674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.014s	sys 0.006s
I20260709 12:58:56.999636  5083 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:56.930157  1676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.028s	sys 0.038s
I20260709 12:58:56.455921  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:56.990455  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 671593us
I20260709 12:58:56.495410  5061 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.500686  2342 leader_election.cc:336] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.580s (SENT)
I20260709 12:58:56.456529  5031 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:56.600564  4824 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.446802  5033 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.557s
W20260709 12:58:56.680678  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.019s	sys 0.044s
W20260709 12:58:56.691534  5096 log.cc:927] Time spent T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:58:56.372814  1500 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:57.002956  5013 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:57.007375  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:56.888427  5056 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.302420  5094 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.008478  1525 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:57.008653  5056 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:56.446955  4943 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:57.009950  4943 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:57.010097  5056 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.291707  5050 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.010550  4943 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:56.260054  4842 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:56.455087  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:56.565948  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 68519.3us
I20260709 12:58:56.654419  4844 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.001111  1608 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:56.370920  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:56.794759  5102 log.cc:927] Time spent T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.202s	user 0.001s	sys 0.001s
I20260709 12:58:57.003172  1601 rpcz_store.cc:276] 0709 12:58:55.770998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.087074 (+316076us) service_pool.cc:224] Handling call
0709 12:58:57.002567 (+915493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:56.523972  4897 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:57.004769  1676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.030s	sys 0.040s
W20260709 12:58:57.026536  1674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.015s	sys 0.006s
I20260709 12:58:56.380134  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:57.020272  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.005815  2342 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:57.014866  2475 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
W20260709 12:58:56.260566  5021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.020s	sys 0.036s
I20260709 12:58:57.002777  5055 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:56.495291  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2190) took 2593 ms. Trace:
I20260709 12:58:56.349706  5000 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.651312  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2016) took 1709 ms. Trace:
I20260709 12:58:56.466944  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:57.019171  2451 consensus_meta.cc:287] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.000s
I20260709 12:58:56.301424  4851 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.697s
I20260709 12:58:57.003223  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.051180  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.524784  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:56.986205  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:56.590453  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.025681  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.005276  1605 raft_consensus.cc:2393] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 11: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:56.476377  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:57.001257  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 532205us
I20260709 12:58:56.368055  1680 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:56.407253  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:57.042552  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.000s	sys 0.018s
I20260709 12:58:56.459730  5011 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:57.013962  5097 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:57.055462  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.005s	sys 0.017s
W20260709 12:58:57.055788  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.005s	sys 0.017s
I20260709 12:58:57.056301  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:57.006897  5033 consensus_queue.cc:1243] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:57.028256  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.059324  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:57.006969  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.026s	sys 0.055s
W20260709 12:58:56.990995  2423 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.652s	user 0.017s	sys 0.010s
I20260709 12:58:57.060216  2475 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:57.015502  1606 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:57.002561  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 802) took 1093 ms. Trace:
I20260709 12:58:57.044152  1608 raft_consensus.cc:2376] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7. Re-sending same reply.
I20260709 12:58:57.049898  2451 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:58:56.264649  4950 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:58:57.054705  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.000s	sys 0.018s
I20260709 12:58:56.446831  5015 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:57.060437  2423 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
W20260709 12:58:57.054916  2344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.663s (SENT) [suppressed 37 similar messages]
W20260709 12:58:57.044535  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 543873us
I20260709 12:58:57.110349  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:56.371336  5064 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:57.043161  5021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.570s	user 0.020s	sys 0.056s
I20260709 12:58:57.006019  5083 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:57.010727  5056 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:57.042585  5014 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:57.061988  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:56.276183  5068 raft_consensus.cc:697] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:57.006353  5061 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:57.117287  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 55356.3us
I20260709 12:58:57.107436  4943 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.010569  5094 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:57.106845  4827 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:57.107106  4851 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:56.579571  4828 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.481s
I20260709 12:58:57.043045  4934 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.045068  5034 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:57.109454  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 815) took 1093 ms. Trace:
I20260709 12:58:56.447050  5098 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:57.006702  4824 raft_consensus.cc:2764] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:56.371232  4972 consensus_queue.cc:1059] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.732s
I20260709 12:58:56.521086  5012 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.613s
I20260709 12:58:57.062783  5059 consensus_queue.cc:1059] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:58:57.131229  4828 consensus_queue.cc:1243] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:57.130825  4851 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:57.061162  5011 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:57.006253  5031 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:56.999179  5089 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:57.113708  4758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.022s	sys 0.011s
I20260709 12:58:57.042824  4897 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.112862  4950 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:57.116042  5064 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:57.101820  5097 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.107987  5033 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:58:57.055532  5000 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.125226  5046 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:57.113265  5015 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.120523  5083 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.121256  5014 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.153857  4897 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.170397  5015 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.171183  5014 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.172113  5064 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:57.175534  5010 consensus_meta.cc:287] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.952s	user 0.010s	sys 0.000s
I20260709 12:58:57.175267  5050 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.175931  5010 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:57.158571  5046 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.177801  5050 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:57.178500  5009 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:57.178875  5009 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:57.179103  5031 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:57.177824  5046 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:57.184056  5034 raft_consensus.cc:3055] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:57.184340  5116 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:57.184706  5034 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:57.184854  5116 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:57.185953  5116 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.186018  5034 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.187242  5116 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.187776  5034 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:57.190371  5055 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:57.190985  5055 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:57.192054  5055 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.193778  5055 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:57.196470  5056 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:57.179589  5009 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.198473  5097 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.199230  5009 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:57.150990  5068 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.202302  5061 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.203814  5010 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:57.205960  5046 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.207964  5046 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.168465  5083 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:57.237495  1416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 887690us
I20260709 12:58:56.455320  1429 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.248907  1429 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:56.992019  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 655667us
I20260709 12:58:57.255772  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:56.991671  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.019171  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.257054  1534 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:57.259724  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.260422  1527 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:58:57.260466  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.258962  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.261257  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.261397  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.262328  1531 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.263229  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.263691  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.264474  1529 raft_consensus.cc:2393] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.262167  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.265806  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.266479  1532 raft_consensus.cc:2393] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 4: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.266808  1530 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.259040  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.262348  1534 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:57.265370  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:57.267904  1525 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.268096  1531 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.044703  1604 rpcz_store.cc:276] 0709 12:58:53.866947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.868843 (+  1896us) service_pool.cc:224] Handling call
0709 12:58:53.882366 (+ 13523us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:53.882712 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.882747 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:53.883347 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 12:58:54.060276 (+176929us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:54.214084 (+153808us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.316117 (+102033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.316198 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.806726 (+1490528us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b180047e2a0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:58:55.881371 (+ 74645us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:56.460005 (+578634us) raft_consensus.cc:1685] finished
0709 12:58:56.460053 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.460233 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":326636,"prepare.queue_time_us":159926,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":234136,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":23782,"spinlock_wait_cycles":42612224,"thread_start_us":169166,"threads_started":1,"wal-append.queue_time_us":960399}
I20260709 12:58:57.270030  1601 raft_consensus.cc:2410] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:57.270488  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.111260  1608 raft_consensus.cc:2376] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7. Re-sending same reply.
I20260709 12:58:57.271498  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.062485  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.272589  1601 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:58:57.273089  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:57.273499  1605 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:57.273948  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.274398  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.272579  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 575) took 1120 ms. Trace:
I20260709 12:58:57.274907  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.275533  1600 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:57.275183  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.275291  1606 rpcz_store.cc:276] 0709 12:58:56.152401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.370604 (+218203us) service_pool.cc:224] Handling call
0709 12:58:57.272329 (+901725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.275836  1605 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:58:57.276664  1608 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.054050  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:57.276767  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.277012  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.053864  1607 rpcz_store.cc:276] 0709 12:58:54.941533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.113857 (+1172324us) service_pool.cc:224] Handling call
0709 12:58:56.139208 (+ 25351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.265369 (+126161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.650980 (+385611us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b540020e9d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:58:56.651229 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118402304}
I20260709 12:58:57.277763  1606 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
W20260709 12:58:57.278103  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 224014us
I20260709 12:58:57.278911  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2197) took 1866 ms. Trace:
I20260709 12:58:57.269822  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:57.279461  1606 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:57.280149  1602 raft_consensus.cc:2376] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6. Re-sending same reply.
I20260709 12:58:57.280658  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2199) took 1828 ms. Trace:
I20260709 12:58:57.281059  1606 rpcz_store.cc:276] 0709 12:58:55.452600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.278557 (+1825957us) service_pool.cc:224] Handling call
0709 12:58:57.279138 (+   581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.280397 (+  1259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.280568 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.259599  1526 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:57.062564  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.279430  1608 rpcz_store.cc:276] 0709 12:58:55.412422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.277425 (+1865003us) service_pool.cc:224] Handling call
0709 12:58:57.278073 (+   648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.278440 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.278468 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.278538 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:57.278580 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.278653 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.278807 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.062063  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:57.284480  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2203) took 1787 ms. Trace:
I20260709 12:58:57.284957  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2207) took 1680 ms. Trace:
I20260709 12:58:57.282239  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2201) took 1799 ms. Trace:
I20260709 12:58:57.285806  1602 rpcz_store.cc:276] 0709 12:58:55.483198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.281200 (+1798002us) service_pool.cc:224] Handling call
0709 12:58:57.281590 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.281849 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.281873 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.281941 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:57.281985 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.282053 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.282166 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.287514  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2209) took 1663 ms. Trace:
I20260709 12:58:57.287897  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2216) took 1549 ms. Trace:
I20260709 12:58:57.285426  1609 rpcz_store.cc:276] 0709 12:58:55.604905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.283440 (+1678535us) service_pool.cc:224] Handling call
0709 12:58:57.284029 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.284514 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.284545 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.284627 (+    82us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:58:57.284656 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.284705 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.284810 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.276877  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.271544  1604 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:57.288492  1602 rpcz_store.cc:276] 0709 12:58:55.738374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.286974 (+1548600us) service_pool.cc:224] Handling call
0709 12:58:57.287371 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.287607 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.287631 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.287682 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:57.287708 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.287752 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.287834 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:57.291304  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 170036us
I20260709 12:58:57.292088  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.279604  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2198) took 1853 ms. Trace:
I20260709 12:58:57.293705  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.292940  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:57.294093  1607 rpcz_store.cc:276] 0709 12:58:55.426557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.278099 (+1851542us) service_pool.cc:224] Handling call
0709 12:58:57.278639 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.279127 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.279149 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.279228 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:57.279279 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.279348 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.279446 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.295325  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.295686  1602 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:57.296442  1607 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:58:57.296713  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 576) took 1143 ms. Trace:
I20260709 12:58:57.294041  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.296461  1530 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.298311  1525 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.298418  1600 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:58:57.296626  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:57.299445  1607 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:58:57.300254  1600 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:58:57.300796  1600 pending_rounds.cc:85] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 6
I20260709 12:58:57.302637  1604 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:57.303730  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:57.304271  1604 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.305959  1605 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.306186  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.307458  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.308212  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2071) took 1325 ms. Trace:
I20260709 12:58:57.311645  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:57.114274  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1974) took 2011 ms. Trace:
I20260709 12:58:57.312631  1682 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:57.314100  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:57.312959  1676 rpcz_store.cc:276] 0709 12:58:55.102936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.103742 (+   806us) service_pool.cc:224] Handling call
0709 12:58:55.113729 (+  9987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:55.114178 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:55.114221 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:55.114817 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 12:58:56.197766 (+1082949us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:57.026795 (+829029us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.027128 (+   333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.027245 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.114015 (+ 86770us) raft_consensus.cc:1685] finished
0709 12:58:57.114037 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.114188 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5523,"prepare.queue_time_us":271330,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":14381,"raft.queue_time_us":41874,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":119742,"thread_start_us":1867111,"threads_started":2,"wal-append.queue_time_us":1178693}
I20260709 12:58:57.315651  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:57.316537  1682 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:57.311887  1675 rpcz_store.cc:276] 0709 12:58:55.982803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.269452 (+286649us) service_pool.cc:224] Handling call
0709 12:58:56.269870 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.273385 (+  3515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.273433 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:56.274032 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.106354 (+832322us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:57.106390 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.106454 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.307698 (+201244us) raft_consensus.cc:1685] finished
0709 12:58:57.307739 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.307973 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":455,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":10028,"thread_start_us":798531,"threads_started":1,"wal-append.queue_time_us":848686}
I20260709 12:58:57.114256  2423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 820) took 1090 ms. Trace:
I20260709 12:58:57.111621  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:57.308797  1526 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.310489  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2063) took 1656 ms. Trace:
I20260709 12:58:57.317417  2423 rpcz_store.cc:276] 0709 12:58:56.023461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.185365 (+161904us) service_pool.cc:224] Handling call
0709 12:58:57.114197 (+928832us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.318486  2428 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.319695  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:57.320597  2423 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:57.136570  2451 rpcz_store.cc:276] 0709 12:58:56.015899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.265306 (+249407us) service_pool.cc:224] Handling call
0709 12:58:57.109403 (+844097us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:57.112892  2342 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.646s (SENT)
I20260709 12:58:57.322386  2342 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:57.323626  2451 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:58:57.324700  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 725) took 1331 ms. Trace:
W20260709 12:58:57.324736  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 211872us
I20260709 12:58:57.308609  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:57.109925  2421 rpcz_store.cc:276] 0709 12:58:55.909095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.495865 (+586770us) service_pool.cc:224] Handling call
0709 12:58:56.496307 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.002332 (+506025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.002509 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.308561  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:57.122406  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:57.326531  1680 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:57.327450  1681 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
W20260709 12:58:57.326442  2342 leader_election.cc:336] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.676s (SENT)
W20260709 12:58:57.118485  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.106565  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:57.134186  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:57.327961  2461 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:58:57.135928  4813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.005s	sys 0.038s
I20260709 12:58:57.274917  1601 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:57.309379  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2066) took 1654 ms. Trace:
I20260709 12:58:57.310400  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:56.389603  4764 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.329528  2475 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.326423  2455 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:57.384505  2474 raft_consensus.cc:2393] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:58:57.385232  2455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 814) took 1369 ms (client timeout 1672 ms). Trace:
I20260709 12:58:57.301196  1600 pending_rounds.cc:107] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:58:57.385911  1600 raft_consensus.cc:2889] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:57.385759  2455 rpcz_store.cc:269] 0709 12:58:56.015466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.061679 (+ 46213us) service_pool.cc:224] Handling call
0709 12:58:57.384944 (+1323265us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540005b754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:57.385141 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778519808}
I20260709 12:58:57.325309  2451 rpcz_store.cc:276] 0709 12:58:55.993189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.322311 (+1329122us) service_pool.cc:224] Handling call
0709 12:58:57.322969 (+   658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.324277 (+  1308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.324603 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.387188  2455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:57.289577  1608 rpcz_store.cc:276] 0709 12:58:55.623829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.286001 (+1662172us) service_pool.cc:224] Handling call
0709 12:58:57.286410 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.286741 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.286772 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.286828 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:57.287309 (+   481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.287366 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.287457 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.284915  1606 rpcz_store.cc:276] 0709 12:58:55.497173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.281928 (+1784755us) service_pool.cc:224] Handling call
0709 12:58:57.283440 (+  1512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.284041 (+   601us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:57.284070 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.284193 (+   123us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:57.284252 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.284315 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.284426 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.297364  1602 rpcz_store.cc:276] 0709 12:58:56.152758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.294405 (+1141647us) service_pool.cc:224] Handling call
0709 12:58:57.294807 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.296337 (+  1530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.296560 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.329391  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 726) took 1329 ms. Trace:
W20260709 12:58:57.390107  2474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 795) took 1484 ms (client timeout 1670 ms). Trace:
W20260709 12:58:57.390590  2474 rpcz_store.cc:269] 0709 12:58:55.905886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.910896 (+  5010us) service_pool.cc:224] Handling call
0709 12:58:57.389868 (+1478972us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54005f6254. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:57.390042 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3079749888}
I20260709 12:58:57.391108  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.389551  2421 rpcz_store.cc:276] 0709 12:58:55.999890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.327430 (+1327540us) service_pool.cc:224] Handling call
0709 12:58:57.327977 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.328528 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.328580 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.328682 (+   102us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:57.328777 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.328905 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.329129 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.390601  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:57.366786  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:57.394191  4851 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:57.395215  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 68909.8us
W20260709 12:58:57.396548  2342 leader_election.cc:336] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.689s (SENT)
I20260709 12:58:57.356407  1677 rpcz_store.cc:276] 0709 12:58:55.654732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.012921 (+358189us) service_pool.cc:224] Handling call
0709 12:58:56.013494 (+   573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.013864 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.013893 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:56.014391 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:58:56.312377 (+297986us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:56.312408 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.312458 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.194311 (+881853us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:57.308801 (+114490us) raft_consensus.cc:1685] finished
0709 12:58:57.308843 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.309168 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":268,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"spinlock_wait_cycles":46316800,"thread_start_us":297436,"threads_started":1,"wal-append.queue_time_us":1133571}
W20260709 12:58:57.397719  4783 consensus_queue.cc:1175] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3cabc5110903443ba3beb5cbb14afa91" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 6 index: 6 } }
I20260709 12:58:57.399916  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.400394  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.400759  1530 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.401139  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.401316  1525 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:57.401819  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:57.401980  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.402649  1532 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:57.403091  1529 raft_consensus.cc:2368] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8.
I20260709 12:58:57.374534  1678 raft_consensus.cc:2410] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:57.253239  1429 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 8, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:57.403586  1530 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:58:57.403847  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 53458.3us
I20260709 12:58:57.405735  5031 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:57.406688  5031 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:57.407670  5059 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:57.383023  1531 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:58:57.409039  1525 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:57.409103  5061 consensus_queue.cc:1059] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:57.414861  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2219) took 1381 ms. Trace:
I20260709 12:58:57.415299  1609 rpcz_store.cc:276] 0709 12:58:56.033772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.289870 (+1256098us) service_pool.cc:224] Handling call
0709 12:58:57.362069 (+ 72199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.414169 (+ 52100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.414203 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.414284 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:57.414363 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.414448 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.414789 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1377,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":172}
I20260709 12:58:57.417209  5046 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:57.380618  4972 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:57.369446  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:57.318048  1683 rpcz_store.cc:276] 0709 12:58:55.654042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.012697 (+358655us) service_pool.cc:224] Handling call
0709 12:58:56.013246 (+   549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.014878 (+  1632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.014929 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:56.017319 (+  2390us) log.cc:844] Serialized 26 byte log entry
0709 12:58:56.477785 (+460466us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:56.542297 (+ 64512us) log.cc:844] Serialized 14 byte log entry
0709 12:58:56.570793 (+ 28496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.570907 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.310036 (+739129us) raft_consensus.cc:1685] finished
0709 12:58:57.310074 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.310322 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20881,"prepare.queue_time_us":200467,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":21472,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":21077,"spinlock_wait_cycles":14592,"thread_start_us":409027,"threads_started":1,"wal-append.queue_time_us":1105551}
I20260709 12:58:57.374218  5011 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.405866  2455 raft_consensus.cc:606] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:57.408411  5031 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.382210  5083 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.376760  5014 consensus_queue.cc:1059] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:58:57.461982  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 126167us
I20260709 12:58:57.466550  1604 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:58:57.413348  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 816) took 1397 ms. Trace:
W20260709 12:58:57.405728  2342 leader_election.cc:336] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.748s (SENT)
I20260709 12:58:57.404814  1429 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.459000  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:58:57.460646  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 53734.4us
W20260709 12:58:57.148605  4758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.023s	sys 0.011s
I20260709 12:58:57.393373  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:57.408463  5059 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.468466  2461 rpcz_store.cc:276] 0709 12:58:56.016148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.411530 (+1395382us) service_pool.cc:224] Handling call
0709 12:58:57.412174 (+   644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.412820 (+   646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.412872 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.412960 (+    88us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:57.413016 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.413107 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.413278 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5859}
I20260709 12:58:57.397229  4851 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:57.457764  5046 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:57.492902  1527 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.151434  4827 raft_consensus.cc:3055] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:57.460929  4972 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:58:57.494656  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:57.510659  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:57.488763  5059 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:57.510411  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.022s	sys 0.014s
W20260709 12:58:57.520606  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.022s	sys 0.015s
I20260709 12:58:57.520974  5041 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:57.521674  5116 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.494124  5046 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.525283  5056 consensus_queue.cc:1059] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:58:57.526279  4813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.006s	sys 0.038s
I20260709 12:58:57.526851  4827 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:57.528597  4827 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:57.521982  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 1.14915e+06us
I20260709 12:58:57.537832  5015 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:58:57.536484  1572 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:57.545066  4950 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.545143  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2208) took 1921 ms. Trace:
I20260709 12:58:57.550325  4764 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:57.550299  1603 rpcz_store.cc:276] 0709 12:58:55.623483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.284859 (+1661376us) service_pool.cc:224] Handling call
0709 12:58:57.285352 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.286185 (+   833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.286218 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.286966 (+   748us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.505897 (+218931us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:57.505956 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.506050 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.544655 (+ 38605us) raft_consensus.cc:1685] finished
0709 12:58:57.544683 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.544911 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79332,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":74638,"thread_start_us":218350,"threads_started":1,"wal-append.queue_time_us":246368}
I20260709 12:58:57.523929  5083 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:57.209208  5013 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:57.572060  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 57387.8us
I20260709 12:58:57.560586  5083 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:57.574523  5000 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.575601  5083 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.576301  5013 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:57.582067  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:57.582693  4827 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:57.571663  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.591318  1682 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
W20260709 12:58:57.573271  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 180360us
W20260709 12:58:57.577773  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 80799.5us
I20260709 12:58:57.606961  5122 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:57.607460  5015 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:57.607640  5122 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:57.608043  5015 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:57.607784  1429 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 6, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 6 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.609908  1525 raft_consensus.cc:2393] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:57.612025  2475 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:57.612746  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 731) took 1244 ms. Trace:
I20260709 12:58:57.607470  2421 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:57.576730  1647 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.500s (SENT)
I20260709 12:58:57.613122  2475 rpcz_store.cc:276] 0709 12:58:56.368770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.611348 (+1242578us) service_pool.cc:224] Handling call
0709 12:58:57.611774 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.612472 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.612687 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.621361  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 729) took 1302 ms. Trace:
I20260709 12:58:57.622004  2421 rpcz_store.cc:276] 0709 12:58:56.315105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.606688 (+1291583us) service_pool.cc:224] Handling call
0709 12:58:57.607221 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.617072 (+  9851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.617305 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.618882  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:57.622838  1527 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:58:57.597543  5000 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:57.625478  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 219789us
I20260709 12:58:57.639039  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:57.628278  2435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.005s	sys 0.013s
W20260709 12:58:57.627759  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.008s	sys 0.025s
I20260709 12:58:57.613611  4813 raft_consensus.cc:3055] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:58:57.646757  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.009s	sys 0.025s
W20260709 12:58:57.652083  2435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.005s	sys 0.014s
I20260709 12:58:57.627934  5000 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.646574  4813 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:57.655611  1674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.003s	sys 0.003s
W20260709 12:58:57.656260  1674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.003s	sys 0.004s
I20260709 12:58:57.656371  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 800) took 1748 ms. Trace:
I20260709 12:58:57.658206  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:57.609169  5122 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.657024  2435 rpcz_store.cc:276] 0709 12:58:55.908103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.263834 (+355731us) service_pool.cc:224] Handling call
0709 12:58:56.264324 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.264622 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.264668 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:56.282195 (+ 17527us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.655801 (+1373606us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:57.655907 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.656028 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.656084 (+    56us) raft_consensus.cc:1685] finished
0709 12:58:57.656098 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.656270 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":668110,"threads_started":1,"wal-append.queue_time_us":1303750}
I20260709 12:58:57.676944  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.655622  5000 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:57.609364  5015 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:57.684839  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.711974  2451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:57.712885  2451 raft_consensus.cc:606] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:57.713320  2451 raft_consensus.cc:614] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:57.714764  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 92287.5us
I20260709 12:58:57.717602  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:57.681049  2342 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.886s (SENT)
I20260709 12:58:57.648373  1429 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.656580  4813 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.728658  1530 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:57.730387  2342 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:57.708834  5014 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:57.746924  2475 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:57.754005  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.751612  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:57.763269  5021 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:57.763760  5121 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:58:57.764097  5050 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:57.765724  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.013s	sys 0.017s
W20260709 12:58:57.766134  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.013s	sys 0.017s
W20260709 12:58:57.766444  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 709243us
I20260709 12:58:57.767330  2339 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:58:57.769620  1679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.004s
W20260709 12:58:57.770058  1679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.004s	sys 0.004s
I20260709 12:58:57.770421  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:57.763800  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 100636us
I20260709 12:58:57.772475  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:57.774642  5012 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:57.775687  5097 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:57.775871  1529 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:57.776209  5097 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.776684  5097 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:57.777130  2344 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.015s	sys 0.019s
W20260709 12:58:57.777648  2344 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.015s	sys 0.019s
W20260709 12:58:57.778108  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 723151us
I20260709 12:58:57.778590  5098 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:57.779493  5098 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:57.780026  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.780607  5098 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:57.777905  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 50715.1us
I20260709 12:58:57.751346  4783 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:57.789791  1572 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:57.761864  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 180014us
I20260709 12:58:57.785228  5062 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:57.789491  4813 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:57.785527  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 208950us
I20260709 12:58:57.769418  2339 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:57.793381  5083 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:57.794508  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:57.794854  4764 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:57.795388  5055 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.796511  2475 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:58:57.797859  1429 catalog_manager.cc:5697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:57.798799  1647 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.627s (SENT)
W20260709 12:58:57.812390  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.812433  4934 consensus_meta.cc:287] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.008s
I20260709 12:58:57.814615  1500 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:57.815611  4844 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:57.839732  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 1987) took 2194 ms. Trace:
W20260709 12:58:57.816473  5034 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.628s	user 0.004s	sys 0.012s
I20260709 12:58:57.797205  5062 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:57.818082  2342 leader_election.cc:336] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.901s (SENT)
I20260709 12:58:57.819752  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:57.821367  5009 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.622s	user 0.002s	sys 0.014s
I20260709 12:58:57.821815  5015 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:57.824523  4783 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:57.825744  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 203012us
I20260709 12:58:57.733553  4972 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.828104  5014 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:58:57.758949  4932 consensus_meta.cc:287] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.012s
I20260709 12:58:57.795428  5041 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:57.831210  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.843958  1527 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
W20260709 12:58:57.850440  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.850862  1533 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
W20260709 12:58:57.851125  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 56824.7us
I20260709 12:58:57.851030  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:57.852139  1682 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:57.851886  4764 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.850502  5055 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:57.856287  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:57.867822  4934 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:57.895864  1500 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:57.870306  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:57.873801  4851 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:57.854220  1429 catalog_manager.cc:5697] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 5, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 5 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.882428  4783 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:57.902005  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 84004.5us
I20260709 12:58:57.893836  2475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:58:57.894246  4764 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:57.900244  4851 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.900557  5055 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:57.907130  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 87535us
W20260709 12:58:57.908628  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 109934us
I20260709 12:58:57.907270  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 727) took 1598 ms. Trace:
W20260709 12:58:57.917742  5112 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:58:57.908016  4932 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:57.918761  4972 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.919225  1534 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:57.919710  2423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 804) took 1944 ms. Trace:
I20260709 12:58:57.920085  1429 catalog_manager.cc:5697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 5, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 5 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.920156  2423 rpcz_store.cc:276] 0709 12:58:55.975583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.321443 (+1345860us) service_pool.cc:224] Handling call
0709 12:58:57.417922 (+ 96479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:57.517945 (+100023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.517976 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:57.518469 (+   493us) log.cc:844] Serialized 52 byte log entry
0709 12:58:57.653347 (+134878us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:57.653627 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.653729 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.919449 (+265720us) raft_consensus.cc:1685] finished
0709 12:58:57.919469 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.919630 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3553,"raft.queue_time_us":6998,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":134478,"threads_started":1,"wal-append.queue_time_us":398365}
I20260709 12:58:57.922356  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:57.923031  1429 catalog_manager.cc:5697] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:58:57.925762  5014 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:57.907648  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 818) took 1886 ms. Trace:
I20260709 12:58:57.927574  4783 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:57.923724  2423 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:58:57.911445  4851 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:57.877231  5041 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:58:57.914160  1678 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:58:57.928932  5120 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:57.929329  1500 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:57.914067  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:57.847255  1679 rpcz_store.cc:276] 0709 12:58:55.597419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.597647 (+   228us) service_pool.cc:224] Handling call
0709 12:58:55.598064 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:55.598543 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:56.109842 (+511299us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.064705 (+954863us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.770438 (+705733us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.771301 (+   863us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.771583 (+   282us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:57.771620 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.771757 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.787128 (+ 15371us) raft_consensus.cc:1685] finished
0709 12:58:57.787148 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.791421 (+  4273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3249,"prepare.queue_time_us":752674,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":1410,"raft.queue_time_us":46753,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":19689,"thread_start_us":2078045,"threads_started":3,"wal-append.queue_time_us":1012768}
W20260709 12:58:57.928143  4842 consensus_meta.cc:287] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.901s	user 0.006s	sys 0.007s
I20260709 12:58:57.928299  5014 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:57.896792  5050 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:57.939073  1531 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:57.929958  4934 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:58:57.945996  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:57.913367  2474 rpcz_store.cc:276] 0709 12:58:56.298142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.601229 (+1303087us) service_pool.cc:224] Handling call
0709 12:58:57.601684 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.602259 (+   575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.602297 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.602901 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.734519 (+131618us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:57.734570 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.734659 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.896377 (+161718us) raft_consensus.cc:1685] finished
0709 12:58:57.896408 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.896581 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3844,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":131085,"threads_started":1,"wal-append.queue_time_us":271535}
I20260709 12:58:57.924731  1429 catalog_manager.cc:5697] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 6, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 6 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.907667  5031 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:57.964584  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 90689.7us
I20260709 12:58:57.927361  2455 rpcz_store.cc:276] 0709 12:58:56.016608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.577057 (+1560449us) service_pool.cc:224] Handling call
0709 12:58:57.600425 (+ 23368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.601081 (+   656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.601115 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.601751 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.732479 (+130728us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:57.732521 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.732589 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.897606 (+165017us) raft_consensus.cc:1685] finished
0709 12:58:57.897628 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.902838 (+  5210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4780,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"thread_start_us":130349,"threads_started":1,"wal-append.queue_time_us":287738}
I20260709 12:58:57.932356  5056 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:57.965740  2475 raft_consensus.cc:606] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:57.968199  2475 raft_consensus.cc:614] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:57.944607  5041 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:57.964418  5011 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:57.961773  5050 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:57.982654  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.982179  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 761) took 1632 ms. Trace:
W20260709 12:58:57.983767  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 214561us
I20260709 12:58:57.987005  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:57.987854  1429 catalog_manager.cc:5697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 8, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:57.984838  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:57.970134  5120 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:57.981521  5031 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:57.974653  4934 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.003260  2455 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:57.964516  4842 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:58.005694  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 807) took 1962 ms. Trace:
W20260709 12:58:58.006206  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4545244450000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 12:58:57.981127  5056 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:57.989351  5122 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:58.008471  5000 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:58.053462  1417 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 172d54128ab740c980d9c27aa0ff1761 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fc6fbca2eb8d4bec997c51003e277180 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:58:58.054785  1609 raft_consensus.cc:3055] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:58.066181  1609 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:58.067245  1609 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.068439  1609 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:58.069620  1530 raft_consensus.cc:2410] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:58:58.002255  1429 catalog_manager.cc:5697] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 8, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.984990  1674 rpcz_store.cc:276] 0709 12:58:56.344919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.345545 (+   626us) service_pool.cc:224] Handling call
0709 12:58:56.345835 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.346031 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:57.048563 (+702532us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.945259 (+896696us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.965101 (+ 19842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.969285 (+  4184us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:57.969333 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.969401 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.977252 (+  7851us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109162,"prepare.queue_time_us":229892,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":114,"raft.queue_time_us":1859,"raft.run_cpu_time_us":6693,"raft.run_wall_time_us":48622,"spinlock_wait_cycles":20286208,"thread_start_us":1488029,"threads_started":3,"wal-append.queue_time_us":773605}
I20260709 12:58:57.985875  5050 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:58.061354  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 135874us
W20260709 12:58:58.074858  1647 leader_election.cc:336] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.672s (SENT)
I20260709 12:58:58.074851  1429 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 7, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:58:58.077510  1429 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 5, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:58:58.080006  1429 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 6, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 6 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:58.000510  5055 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.086369  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:58.086052  5055 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.086899  4934 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:57.998456  4764 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:58.087613  4764 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.088027  4764 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:58.088653  5055 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:58.090255  5056 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:58.093696  4783 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:58.094224  4783 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.094621  4783 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:58.102298  1609 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:58:58.104430  1609 pending_rounds.cc:85] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 7
I20260709 12:58:58.096235  1429 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 4, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:58.109896  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 100835us
I20260709 12:58:58.109993  5034 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:58:58.110615  1417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 57422.5us
I20260709 12:58:58.112310  4842 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:58.112530  5034 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:58.113236  4758 consensus_queue.cc:1059] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:58.114545  1609 pending_rounds.cc:107] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:58:58.114938  1609 raft_consensus.cc:2889] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:58.040815  5134 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.215s	user 0.002s	sys 0.000s
W20260709 12:58:58.051101  5138 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.228s	user 0.000s	sys 0.002s
I20260709 12:58:58.115661  2455 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:58:58.114130  1429 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 5, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 5 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.997861  5011 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:58.123607  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 130975us
I20260709 12:58:58.126562  5031 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.056116  2476 rpcz_store.cc:276] 0709 12:58:56.004061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.330593 (+1326532us) service_pool.cc:224] Handling call
0709 12:58:57.331259 (+   666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.331801 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:57.619035 (+287234us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.960518 (+341483us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.965480 (+  4962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.965531 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:57.965610 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.965711 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.966750 (+  1039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4767,"prepare.queue_time_us":322396,"prepare.run_cpu_time_us":151,"prepare.run_wall_time_us":9619,"raft.queue_time_us":45327,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":11784,"spinlock_wait_cycles":21618944,"thread_start_us":580090,"threads_started":3,"wal-append.queue_time_us":338941}
W20260709 12:58:58.128602  5059 consensus_meta.cc:287] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.005s
I20260709 12:58:58.127441  1429 catalog_manager.cc:5697] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 4, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:58.139357  2342 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.933s (SENT)
I20260709 12:58:58.140528  4758 raft_consensus.cc:3055] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:58.050280  5120 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.141919  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:58:58.153715  4827 consensus_meta.cc:287] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.006s
I20260709 12:58:58.154225  5033 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:58.157007  1683 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:58:58.170272  2342 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:58.145990  5046 consensus_meta.cc:287] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.002s
W20260709 12:58:58.175460  2342 leader_election.cc:336] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.774s (SENT)
I20260709 12:58:58.176165  5000 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:58.178805  2342 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.840s (SENT)
I20260709 12:58:58.179616  4972 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:58.179958  2342 leader_election.cc:336] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.882s (SENT)
I20260709 12:58:58.180298  4972 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.181057  5033 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.182271  5150 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.182886  5150 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.183445  4972 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:58.184659  5126 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.420s	user 0.000s	sys 0.002s
W20260709 12:58:58.187345  5128 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 12:58:58.188267  5098 consensus_queue.cc:1059] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:58.191028  4851 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.191780  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 817) took 2175 ms. Trace:
I20260709 12:58:58.185230  5150 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:58:58.162734  5116 consensus_meta.cc:287] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.003s
W20260709 12:58:58.201797  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 57126.9us
I20260709 12:58:58.156275  4758 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:58.210259  5000 raft_consensus.cc:3055] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:58.220932  5000 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:58:58.221932  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.142503  5014 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:58:58.224121  5014 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:58.224534  5014 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:58.225265  5097 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:58.225693  5014 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.228948  5000 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.230522  5000 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:58.230079  5011 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.232174  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:58.227277  5014 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:58.238721  4827 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:58.221088  4783 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.239244  4827 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.239657  4827 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:58.241070  4783 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:58.242180  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:58.244374  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.245318  5083 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:58.246011  5083 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:58.247287  5083 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.248665  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:58.250427  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:58:58.251839  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 126800us
I20260709 12:58:58.251096  2435 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:58:58.192283  2461 rpcz_store.cc:276] 0709 12:58:56.016384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.490671 (+1474287us) service_pool.cc:224] Handling call
0709 12:58:57.573867 (+ 83196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.731825 (+157958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.731854 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.764614 (+ 32760us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.942491 (+177877us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:57.942530 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.943150 (+   620us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.191451 (+248301us) raft_consensus.cc:1685] finished
0709 12:58:58.191477 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.191711 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48141,"raft.queue_time_us":55773,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":7813,"thread_start_us":177400,"threads_started":1,"wal-append.queue_time_us":378110}
W20260709 12:58:58.257802  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 77883.7us
W20260709 12:58:58.260015  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 72200us
I20260709 12:58:58.162922  5059 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.277871  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:58.219599  5116 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:58.192797  4842 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 12:58:58.286931  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.258567  5097 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:58.289258  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:58.201269  5046 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.294545  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 803) took 2385 ms. Trace:
W20260709 12:58:58.297776  5141 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 12:58:58.299595  5149 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:58:58.302507  2474 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:58.304447  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:58.304807  2475 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:58.312268  5059 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:58.313897  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2224) took 1011 ms. Trace:
I20260709 12:58:58.314319  1605 rpcz_store.cc:276] 0709 12:58:57.302735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.320118 (+ 17383us) service_pool.cc:224] Handling call
0709 12:58:57.357471 (+ 37353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:57.483482 (+126011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.483531 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:57.520242 (+ 36711us) log.cc:844] Serialized 52 byte log entry
0709 12:58:57.552387 (+ 32145us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4800250158. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d68c1aa1 00007f25d68b8b37 00007f25d68b89ca 00007f25d69b026f 00007f25d69aff37 00007f25d69c455c 00007f25d69c4508 00007f25d69c4488 00007f25d69c4443 00007f25d69c36ec 00007f25d58eda96
0709 12:58:57.737895 (+185508us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:57.805831 (+ 67936us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.835725 (+ 29894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.835798 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.916480 (+ 80682us) raft_consensus.cc:1685] finished
0709 12:58:57.916588 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.313716 (+397128us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b5400267fd0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:58.313835 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30799,"prepare.queue_time_us":52431,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":37168,"raft.run_cpu_time_us":4074,"raft.run_wall_time_us":77875,"spinlock_wait_cycles":140817024,"thread_start_us":248443,"threads_started":2,"wal-append.queue_time_us":378382}
I20260709 12:58:58.309346  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:58.319701  2342 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.204s (SENT)
I20260709 12:58:58.329047  2435 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:58:58.333248  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 54324us
I20260709 12:58:58.295095  2428 rpcz_store.cc:276] 0709 12:58:55.909492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.319600 (+1410108us) service_pool.cc:224] Handling call
0709 12:58:57.320147 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.321090 (+   943us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:57.321120 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.369803 (+ 48683us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.599352 (+229549us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:57.599413 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.599496 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.929999 (+330503us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:58:58.290281 (+360282us) raft_consensus.cc:1685] finished
0709 12:58:58.290316 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.294456 (+  4140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37185,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":43797,"spinlock_wait_cycles":12152192,"thread_start_us":201788,"threads_started":1,"wal-append.queue_time_us":276516}
I20260709 12:58:58.356098  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:58.329522  5055 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:58.357574  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 132863us
W20260709 12:58:58.379148  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.383764  1500 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:58.384853  1500 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:58.266300  4758 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:58.382670  1683 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:58.392513  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 200116us
W20260709 12:58:58.393059  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 73433.4us
I20260709 12:58:58.395666  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:58.396679  1679 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:58.349758  4851 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:58.356706  5059 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:58.400261  5055 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:58.405822  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:58.406489  1682 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:58.438107  5157 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:58:58.397506  4932 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:58:58.451355  5155 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:58:58.455726  1682 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:58.460486  1678 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:58.483572  1605 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:58:58.465301  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.469288  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 135730us
I20260709 12:58:58.370977  4764 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.461409  5059 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:58.477185  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:58.465361  4932 raft_consensus.cc:697] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:58:58.392872  4813 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:58.497208  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:58.467211  5012 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.502611  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:58.509687  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 110614us
I20260709 12:58:58.511974  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:58.512914  1678 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:58.504065  5000 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:58:58.514720  1677 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:58.513900  4932 consensus_queue.cc:237] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.519765  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:58:58.520382  1605 raft_consensus.cc:606] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:58.520716  1605 raft_consensus.cc:614] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:58.522408   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:58.525321   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:58.504108  4758 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:58.541179  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:58:58.548859  5159 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:58:58.567879  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:58.568634  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 53432.4us
I20260709 12:58:58.574935  1575 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:58.569849  5116 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.570128  5059 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:58.573184  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.566535  5122 consensus_meta.cc:287] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 12:58:58.510058  5012 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.596887  4813 raft_consensus.cc:697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:58.602145  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 99649.3us
I20260709 12:58:58.573669  5046 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:58.557624  4851 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:58:58.539882  5050 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:58.639521  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.661537  4844 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:58:58.689903  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.649772  5169 consensus_queue.cc:1059] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:58:58.713172  5171 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:58.713836  5171 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:58.660948  4827 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.594272  5116 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.624130  4764 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:58:58.672461  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:58.724764  1678 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:58:58.672843  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 705) took 1177 ms. Trace:
I20260709 12:58:58.663897  5000 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:58.682081  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 2002) took 1424 ms (client timeout 1707 ms). Trace:
I20260709 12:58:58.715879  2451 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:58.715569  5171 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:58.624385  5119 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:58.731122  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:58:58.621044  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 109781us
W20260709 12:58:58.727461  1533 rpcz_store.cc:269] 0709 12:58:57.257974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.261020 (+  3046us) service_pool.cc:224] Handling call
0709 12:58:58.681908 (+1420888us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540010a754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:58.682018 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345158016}
W20260709 12:58:58.687903  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 113038us
W20260709 12:58:58.719831  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.663565  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 150787us
I20260709 12:58:58.725528  1531 rpcz_store.cc:276] 0709 12:58:57.498465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.498638 (+   173us) service_pool.cc:224] Handling call
0709 12:58:58.672545 (+1173907us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540028f0d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:58:58.672709 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920760064}
I20260709 12:58:58.726042  5050 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:58.759613  1500 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:58.776259  1679 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:58:58.779259  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:58:58.781011  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:58:58.788511  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.792088  1679 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:58.793370  1678 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:58.794222  1683 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
W20260709 12:58:58.793334  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 86561.2us
W20260709 12:58:58.797034  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 45965.9us
W20260709 12:58:58.793018  5041 consensus_meta.cc:287] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.002s
I20260709 12:58:58.722340  4813 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:58.795151  5056 raft_consensus.cc:2764] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:58.820868  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:58.822986  5160 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:58.812640  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:58.824473  2435 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:58:58.828086  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.829378  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:58.830530  2476 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:58:58.803639  5171 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:58.834918  1679 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:58.800451  5119 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:58:58.844488  5046 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:58.823514  5160 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:58:58.853289  5055 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:58.856846  2344 connection.cc:256] RPC call timeout handler was delayed by -1.0544623490000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 12:58:58.865012  1575 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:58.847597  5062 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:58.866024  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:58.803390  5011 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:58:58.873615  2344 connection.cc:256] RPC call timeout handler was delayed by -1.0238623490000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 12:58:58.877686  1497 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:58.881394  5056 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:58.882411  5182 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:58:58.867127  5131 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.044s	user 0.007s	sys 0.000s
W20260709 12:58:58.888367  5153 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.738s	user 0.000s	sys 0.002s
I20260709 12:58:58.891885  5012 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:58.811429  5041 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:58.867863  5046 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.905542  1677 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:58.908026  5011 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:58.908586  5011 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.908948  5011 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:58.902837  5169 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:58.910600  5169 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.910974  5169 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:58.916294  5145 log.cc:927] Time spent T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.622s	user 0.000s	sys 0.002s
I20260709 12:58:58.920459  5041 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:58.897097  5014 consensus_meta.cc:287] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.004s
I20260709 12:58:58.972208  1678 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:58:58.906271  5046 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:59.129707  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.245857  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 405104us
W20260709 12:58:59.246341  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.164774  4934 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.247089  1575 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:59.091218  5011 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.248076  4934 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:58.966064  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 58961.8us
I20260709 12:58:59.251312  4934 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:59.199648  5059 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.264824  5059 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:59.072855  5126 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:58:59.240725  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 419892us
I20260709 12:58:58.926277  5160 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:58.897993  4827 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:59.253929  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 425223us
W20260709 12:58:59.247118  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.906457  5119 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:58:59.267365  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.267462  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.183409  5156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.005s	sys 0.015s
I20260709 12:58:59.273763  1605 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:59.251145  5011 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:58.941329  5181 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.122s	user 0.003s	sys 0.000s
I20260709 12:58:59.297940  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:59.299409  5179 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:59.300144  5179 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.300643  5179 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.301753  4851 consensus_queue.cc:1059] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:59.302886  4851 raft_consensus.cc:3055] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:59.303181  5050 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.304375  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:59.304087  5050 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.305068  2455 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:59.303277  4851 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:58:59.306532  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 1.22992e+06us
I20260709 12:58:59.242151  5056 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:59.306236  5160 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:59.281319  5012 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.309324  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:59.281503  5009 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:58:59.309929  4851 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:59.062887  5116 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:59.277500  5156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.005s	sys 0.015s
I20260709 12:58:59.313032  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:59.267997  5046 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.313316  1500 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:58:59.318823  1647 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.710s (SENT)
I20260709 12:58:59.311681  5031 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:59.314340  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:59.322986  1608 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:59.331712  1647 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:59.275595  5119 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:59.311954  5169 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:58:59.336912  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 50949.5us
I20260709 12:58:59.331103  5021 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:59.343542  4827 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:59.319222  5012 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.362915  1531 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:59.363718  1647 leader_election.cc:336] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.724s (SENT)
I20260709 12:58:59.347149  4851 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:59.346936  5014 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:59.365911  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:59.368939  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.368845  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:59.370133  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:59.352597  5021 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.370229  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.372036  1534 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:59.375468  5169 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:59.377319  1608 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:59.382385  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:59.383534  1605 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:58:59.364104  5050 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:59.381319  5021 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.381214  5014 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:59.376621  5119 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:58:59.389529  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 142594us
I20260709 12:58:59.396118  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:58:59.385150  5059 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:58:59.397086  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.403025  1605 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:58:59.392087  5031 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:59.404938  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:58:59.405155  1647 leader_election.cc:336] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.902s (SENT)
I20260709 12:58:59.405954  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.405975  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:59.421623  1530 raft_consensus.cc:2410] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:58:59.408142  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:59.424798  4758 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:59.424973  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:59.428892  5014 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:59.429410  5014 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:59.410487  5192 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:58:59.411083  1607 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:59.409294  1600 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:59.411264  5068 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:59.429833  5014 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:59.412379  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.413064  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.442184  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.442116  5010 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:58:59.443843  5012 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:59.444423  5021 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.445333  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:58:59.446676  4827 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:59.470499  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:59.470583  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:58:59.471937  1609 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:59.473129  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 74419.8us
I20260709 12:58:59.471329  1530 raft_consensus.cc:2376] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8. Re-sending same reply.
W20260709 12:58:59.462226  5189 log.cc:927] Time spent T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:58:59.438045  5068 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:59.479123  1647 leader_election.cc:336] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.965s (SENT)
I20260709 12:58:59.483361  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.461481  5179 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:59.470614  5046 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:59.502655  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.430050  5031 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.521783  5201 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.522593  5201 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:59.474401  5010 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:58:59.524961  5021 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:59.522953  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:59.489812  5068 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:59.531914  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.534881  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 86369.1us
I20260709 12:58:59.536123  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:59.534459  1609 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:58:59.470858  4851 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:58:59.522953  5012 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:59.542549  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:59.542794  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.542549  2428 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:59.543308  2451 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:58:59.525301  5201 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:59.550169  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:59.551092  1530 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:59.551748  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.566388  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 87296.8us
I20260709 12:58:59.567955  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:59.530779  4827 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:58:59.568935  2451 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.569713  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:59.571055  2435 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:59.570518  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.580828  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.584251  2476 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:59.585278  1528 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:59.603001  1601 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:58:59.559285  5012 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.603472  1601 pending_rounds.cc:85] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 6
I20260709 12:58:59.610961  1601 pending_rounds.cc:107] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:58:59.611488  1601 raft_consensus.cc:2889] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:59.614346  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:59.614965  1528 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:59.615820  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:58:59.619565  1647 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.152s (SENT)
I20260709 12:58:59.620103  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:59.621976  1534 raft_consensus.cc:2368] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11.
I20260709 12:58:59.624863  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.625517  1527 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:58:59.607090  5119 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.634493   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:59.590656  5015 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:58:59.661231  1527 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:58:59.671609  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.628279  4758 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:58:59.674304  1572 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.591s (SENT)
I20260709 12:58:59.678316  1534 raft_consensus.cc:2368] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8.
I20260709 12:58:59.674780  1572 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:59.614506  5200 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:58:59.698369  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.683604  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:58:59.705816  5174 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:59.707881  5215 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:59.713882  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.714510  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.699172  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:58:59.715762  1526 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:59.733777  4758 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:59.735340  1528 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:58:59.736040  4758 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:58:59.736845  4758 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:58:59.737900  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63629.5us
I20260709 12:58:59.742939  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:58:59.743166  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 127868us
W20260709 12:58:59.747373  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.758447  2455 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:59.762825  1533 raft_consensus.cc:2393] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:58:59.741215  2344 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:58:59.722024  5041 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:59.758188  5187 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:58:59.673043  5119 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:59.769656  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.666261  4827 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.739271  5216 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:59.779157  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:59.800434  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 74558.9us
I20260709 12:58:59.805971  4932 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.806874  4932 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:58:59.810158  4932 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:59.760491  4758 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:58:59.827672  1647 connection.cc:256] RPC call timeout handler was delayed by -1.7423345779999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2662s for a response
W20260709 12:58:59.828749  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 49720.5us
I20260709 12:58:59.831037  2344 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:58:59.788276  5116 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:59.772631  4844 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:58:59.842490  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 53937.6us
W20260709 12:58:59.848034  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 109236us
I20260709 12:58:59.853638  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:58:59.862588  1647 connection.cc:256] RPC call timeout handler was delayed by -1.5809239270000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 12:58:59.863171  4934 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:59.863550  1647 connection.cc:256] RPC call timeout handler was delayed by -1.3604239269999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23020000000000002s for a response
W20260709 12:58:59.863909  1647 connection.cc:256] RPC call timeout handler was delayed by -1.2800879929999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:58:59.864154  1647 connection.cc:256] RPC call timeout handler was delayed by -1.2305879929999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 12:58:59.864426  1647 connection.cc:256] RPC call timeout handler was delayed by -1.1306879929999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 12:58:59.828193  5031 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:59.862524  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:58:59.870409  1530 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:58:59.883607  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:59.884505  2474 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:59.821722  5068 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.900560  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:58:59.906766  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 44347.6us
I20260709 12:58:59.907809  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:58:59.899315  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:59.873203  5216 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:58:59.921772  1498 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:58:59.929847  1527 raft_consensus.cc:2368] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11.
I20260709 12:58:59.881189  5116 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:59.912976  2421 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:59.911582  2474 raft_consensus.cc:2410] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:58:59.935843  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:59.936270  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:59.936856  2455 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.895272  5050 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:58:59.943132  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:58:59.944811  2474 raft_consensus.cc:2393] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:59.946472  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:59.947291  2474 raft_consensus.cc:2368] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:58:59.954972  1678 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:58:59.955090  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47369.1us
I20260709 12:58:59.915362  4934 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:59.966513  4758 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:58:59.940598  5012 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:58:59.973989  2423 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:58:59.983116  1677 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:58:59.960966  5212 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.281s	user 0.002s	sys 0.000s
I20260709 12:59:00.006554  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:58:59.964974  5014 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.929176  5015 raft_consensus.cc:2764] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:59:00.025382  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.031067  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 116121us
W20260709 12:59:00.034543  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.981819  5178 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.061025  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63537.4us
I20260709 12:59:00.071756  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:58:59.982743  5116 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:00.076956  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.078214  1677 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:00.082090  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:00.176332  2451 consensus_meta.cc:287] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.004s
I20260709 12:58:59.909240  5222 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
W20260709 12:59:00.168627  2342 leader_election.cc:336] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.706s (SENT)
W20260709 12:59:00.177649  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 106016us
I20260709 12:59:00.155622  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:58:59.982633  5050 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:58:59.940186  5216 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:00.081975  5225 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 12:59:00.199990  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.199157  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.278342  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.198027  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.221897  5011 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:00.058501  5169 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.194002  5228 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:00.279680  1497 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:00.199788  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.201488  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.285147  1674 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:00.208861  1647 leader_election.cc:336] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.670s (SENT)
I20260709 12:59:00.200227  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.278271  1681 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:00.279577  1683 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:00.283095  2342 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:00.191946  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:00.288496  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.288617  1602 raft_consensus.cc:2410] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:00.280345  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.195494  2455 raft_consensus.cc:2410] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:59:00.287988  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 79145us
I20260709 12:59:00.280625  2474 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:00.281016  2451 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:00.178295  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:00.202301  5219 log.cc:927] Time spent T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 12:59:00.287310  1675 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:59:00.292641  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.292850  1604 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:00.298877  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 456138us
W20260709 12:59:00.200954  5224 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 12:59:00.302199  1682 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:00.307011  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.307626  2344 leader_election.cc:400] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8.
I20260709 12:59:00.307830  1683 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:00.308013  2344 leader_election.cc:403] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:00.311370  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48849.3us
I20260709 12:59:00.313233  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:00.058568  4851 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:00.309026  1680 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:00.318686  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:00.192819  5218 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 12:59:00.283668  5031 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.215121  5014 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:00.165549  5178 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:00.183962  5227 consensus_queue.cc:1059] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.357s
I20260709 12:59:00.193830  5116 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:00.442384  5234 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.723809  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 266704us
I20260709 12:59:00.731539  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:00.743186  5234 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:00.705104  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:00.450057  4851 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:00.616971  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2266) took 1043 ms. Trace:
I20260709 12:59:00.441960  5009 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.304s
I20260709 12:59:00.746223  4851 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:00.449493  5012 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.430172  5232 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.378s
W20260709 12:59:00.565151  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.284372  5228 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.753057  5228 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:00.754629  5232 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.428395  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.748940  5009 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:00.494445  2421 consensus_meta.cc:287] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:59:00.745874  1606 rpcz_store.cc:276] 0709 12:58:59.573342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.573618 (+   276us) service_pool.cc:224] Handling call
0709 12:58:59.573937 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:59.580747 (+  6810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.580775 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:59.608460 (+ 27685us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.704573 (+ 96113us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:59.704656 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.704806 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.616632 (+911826us) raft_consensus.cc:1685] finished
0709 12:59:00.616664 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.616877 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11664,"raft.queue_time_us":6591,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":4094,"thread_start_us":56622,"threads_started":1,"wal-append.queue_time_us":153394}
W20260709 12:59:00.479043  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 134455us
W20260709 12:59:00.442471  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 138664us
I20260709 12:59:00.369658  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.745487  5234 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:00.343837  1647 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.725s (SENT)
I20260709 12:59:00.769414  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:00.442708  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 163105us
I20260709 12:59:00.772135  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.772791  1530 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
W20260709 12:59:00.640290  2476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.005s	sys 0.011s
W20260709 12:59:00.773741  2476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.007s	sys 0.012s
I20260709 12:59:00.481101  2423 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:00.650672  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.014s	sys 0.003s
W20260709 12:59:00.774483  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.014s	sys 0.005s
I20260709 12:59:00.337450  2451 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:00.752391  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2267) took 1178 ms. Trace:
I20260709 12:59:00.760226  2421 raft_consensus.cc:2410] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:00.778529  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.779332  1682 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:59:00.780236  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:00.633747  2475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.005s	sys 0.011s
W20260709 12:59:00.782397  2475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.005s	sys 0.014s
W20260709 12:59:00.763489  1572 leader_election.cc:336] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.911s (SENT)
I20260709 12:59:00.773898  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.781289  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.713917  5050 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:00.783516  1532 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:00.786092  1682 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:59:00.782665  1678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.002s	sys 0.010s
W20260709 12:59:00.789995  1678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.002s	sys 0.010s
I20260709 12:59:00.338658  4844 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:00.791018  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.801654  1681 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:00.791172  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.515030  5119 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:00.792161  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:00.792704  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:00.793305  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.793922  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:00.794481  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.805811  1534 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:00.795049  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.807053  1526 raft_consensus.cc:2393] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:00.795568  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:00.796223  2344 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:00.777845  1600 rpcz_store.cc:276] 0709 12:58:59.573681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.574113 (+   432us) service_pool.cc:224] Handling call
0709 12:58:59.583436 (+  9323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:59.588111 (+  4675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.588142 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:59.590446 (+  2304us) log.cc:844] Serialized 52 byte log entry
0709 12:58:59.774764 (+184318us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:59.774800 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.774863 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.752048 (+977185us) raft_consensus.cc:1685] finished
0709 12:59:00.752078 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.752288 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6483,"raft.queue_time_us":4384,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":12970,"thread_start_us":143304,"threads_started":1,"wal-append.queue_time_us":238613}
I20260709 12:59:00.328063  5011 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:00.290972  5169 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:00.799700  1680 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:00.799927  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:00.817868  1528 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:00.740023  5068 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:00.750097  5031 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:00.810333  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.827102  1683 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:00.811111  1527 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:00.812544  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.781981  5012 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:00.782160  5230 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.814563  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 645828us
I20260709 12:59:00.814863  1525 raft_consensus.cc:2368] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:59:00.803365  5014 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:00.787798  4813 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.824707  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 501288us
W20260709 12:59:00.861708  1647 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.836s (SENT)
I20260709 12:59:00.862126  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:00.811074  5245 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:00.831279  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.801343  4844 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.859577  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.871026  1682 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:00.755313  5232 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:00.868036  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.875121  1680 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:59:00.878656  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.879284  1682 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:00.880869  1682 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:00.881374  1675 raft_consensus.cc:2410] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:59:00.866835  5227 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:00.882673  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.883340  1680 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
W20260709 12:59:00.888423  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 101760us
I20260709 12:59:00.895901  5233 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:00.874511  4844 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.864923  5230 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:00.931782  1572 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.074s (SENT)
I20260709 12:59:00.932860  1681 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:00.924571  1680 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:00.867890  5216 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:00.932260  1572 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:00.875573  5239 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:00.945982  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.971956  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.868809  4813 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:00.994899  1677 consensus_meta.cc:287] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.000s
I20260709 12:59:00.995527  1677 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:59:00.935537  5245 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:01.005734  1674 consensus_meta.cc:287] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.719s	user 0.005s	sys 0.005s
I20260709 12:59:00.999457  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:01.007995  2421 raft_consensus.cc:2410] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:59:01.003392  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50138.7us
I20260709 12:59:01.004639  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:00.998143  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:00.939107  5009 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8.
W20260709 12:59:00.993040  5231 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:59:01.010636  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:01.011408  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:01.017710  1680 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:01.009954  1677 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:01.012513  2451 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:01.009805  1674 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:59:01.013576  1675 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:01.013616  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.950052  5031 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.021889  5031 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:01.023341  5169 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.002959  5233 raft_consensus.cc:697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:01.025887  1533 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:01.024988  5233 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:01.030108  4813 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:01.010625  5245 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:00.916481  5227 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:00.948938  5012 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:01.040400  5238 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:59:01.040831  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 856) took 1317 ms. Trace:
W20260709 12:59:01.042953  5243 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:59:00.934209  5011 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:01.048373  5240 log.cc:927] Time spent T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:59:01.049906  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 857) took 1283 ms. Trace:
I20260709 12:59:01.050287  2476 rpcz_store.cc:276] 0709 12:58:59.766642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.766890 (+   248us) service_pool.cc:224] Handling call
0709 12:58:59.775134 (+  8244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:59.820044 (+ 44910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.820113 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:59.844871 (+ 24758us) log.cc:844] Serialized 26 byte log entry
0709 12:59:00.774129 (+929258us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:00.774157 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.774202 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:01.049633 (+275431us) raft_consensus.cc:1685] finished
0709 12:59:01.049651 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.049845 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4651,"raft.queue_time_us":39239,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8334,"spinlock_wait_cycles":2432,"thread_start_us":959077,"threads_started":2,"wal-append.queue_time_us":974711}
I20260709 12:59:01.002955  5228 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:00.998541  5232 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.041239  2461 rpcz_store.cc:276] 0709 12:58:59.723176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.739430 (+ 16254us) service_pool.cc:224] Handling call
0709 12:58:59.763813 (+ 24383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:59.776582 (+ 12769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.776670 (+    88us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:59.777271 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.928736 (+151465us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:59.928779 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.928862 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.079694 (+150832us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b48000cc3d8. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d68c1aa1 00007f25d68b8b37 00007f25d68b89ca 00007f25d69b026f 00007f25d69aff37 00007f25d69c455c 00007f25d69c4508 00007f25d69c4488 00007f25d69c4443 00007f25d69c36ec 00007f25d58eda96
0709 12:59:01.040466 (+960772us) raft_consensus.cc:1685] finished
0709 12:59:01.040489 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.040689 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97543,"raft.queue_time_us":3264,"raft.run_cpu_time_us":1765,"raft.run_wall_time_us":306493,"spinlock_wait_cycles":32577408,"thread_start_us":81773,"threads_started":1,"wal-append.queue_time_us":975079}
I20260709 12:59:01.018487  2344 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:59:01.067530  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 49114us
I20260709 12:59:01.067902  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:01.068974  2421 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:01.067049  2342 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.804s (SENT)
I20260709 12:59:01.071161  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:01.071898  2451 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:01.071703  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:01.074409  2474 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.005s	sys 0.007s
W20260709 12:59:01.074802  2474 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.005s	sys 0.007s
I20260709 12:59:01.075055  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:01.091118  1681 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:59:01.103812  2342 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.004s (SENT)
W20260709 12:59:01.104920  2342 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.016s (SENT)
I20260709 12:59:01.105330  2342 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:01.110294  2461 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:01.074699  5012 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:01.100033  5232 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.100147  5009 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:01.099961  5169 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:01.109207  4934 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.128492  5056 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.117038  5050 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:01.135687  5056 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:01.123016  5174 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.161824  5174 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:01.163985  5056 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.164412  5174 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.152272  5119 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.133159  5068 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.133452  5012 raft_consensus.cc:697] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:01.178963  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:01.182533  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.200606  2421 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:01.203562  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:01.206563  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:01.206614  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:01.207175  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:01.207337  1681 raft_consensus.cc:2376] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5. Re-sending same reply.
I20260709 12:59:01.207908  1527 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.200642  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:01.212371  1500 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:01.134056  5232 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:01.204519  1676 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:01.206704  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:01.225148  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:01.140024  5169 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:01.233737  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:01.234737  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:01.235445  2423 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
W20260709 12:59:01.239341  1575 connection.cc:256] RPC call timeout handler was delayed by -2.7347670880000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 12:59:01.239848  1575 connection.cc:256] RPC call timeout handler was delayed by -2.516067088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2268s for a response
W20260709 12:59:01.240180  1575 connection.cc:256] RPC call timeout handler was delayed by -1.7386788880000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:59:01.240496  1575 connection.cc:256] RPC call timeout handler was delayed by -1.4848788880000257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 12:59:01.240808  1575 connection.cc:256] RPC call timeout handler was delayed by -1.4227788880000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 12:59:01.233877  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:01.155553  4934 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:01.155505  4844 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:01.229274  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:01.229439  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:01.211522  5215 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:01.255797  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 392482us
I20260709 12:59:01.257866  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:01.256083  1603 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:01.260000  1531 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:01.227569  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 295791us
I20260709 12:59:01.219444  5228 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.262111  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.196866  5068 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:01.231079  5010 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:01.200639  5119 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:01.274788  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.275379  1533 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:01.266600  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:01.231302  5239 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.269465  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:01.271407  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.266124  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.276420  1525 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:01.227438  5244 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:59:01.212263  5021 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:59:01.280419  1534 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:01.281072  1526 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:59:01.292042  2342 leader_election.cc:336] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.879s (SENT)
W20260709 12:59:01.279618  5242 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.285s	user 0.000s	sys 0.003s
I20260709 12:59:01.293517  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:01.294349  5249 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:59:01.295228  5012 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:01.274855  5010 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.246157  4851 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:59:01.298005  5010 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:01.298141  5239 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:01.300402  1601 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:01.305915  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.323707  1609 raft_consensus.cc:2410] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:01.306885  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:01.307631  2455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 860) took 1285 ms. Trace:
I20260709 12:59:01.310773  4844 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.312618  5169 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.374392  1680 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:59:01.305949  5014 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:59:01.314395  5232 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.314484  5234 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:01.315591  5230 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.316323  4934 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:01.317183  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.301442  5239 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:01.319239  1601 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:01.319660  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.322295  1527 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:01.322489  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 775) took 1125 ms. Trace:
I20260709 12:59:01.302147  1531 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:01.324416  2455 rpcz_store.cc:276] 0709 12:59:00.022041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.321524 (+299483us) service_pool.cc:224] Handling call
0709 12:59:00.396253 (+ 74729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:00.783023 (+386770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:00.783054 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:00.790468 (+  7414us) log.cc:844] Serialized 26 byte log entry
0709 12:59:01.124994 (+334526us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:01.125038 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.125110 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:01.307401 (+182291us) raft_consensus.cc:1685] finished
0709 12:59:01.307423 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.307570 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82027,"raft.queue_time_us":414267,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4490,"thread_start_us":568656,"threads_started":2,"wal-append.queue_time_us":324660}
I20260709 12:59:01.319083  1528 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.334199  1603 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
W20260709 12:59:01.374969  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 68173us
I20260709 12:59:01.392158  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:01.457716  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.459115  1607 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
W20260709 12:59:01.375778  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 53755.5us
I20260709 12:59:01.376271  1525 raft_consensus.cc:2410] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:01.378177  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.387198  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:01.462147  2451 raft_consensus.cc:2410] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:01.387467  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:01.390585  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:01.462718  1530 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:01.317979  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:01.463152  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.435412  1678 rpcz_store.cc:276] 0709 12:59:00.196795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.197116 (+   321us) service_pool.cc:224] Handling call
0709 12:59:00.197514 (+   398us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:59:00.198020 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:00.198047 (+    27us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:59:00.198887 (+   840us) log.cc:844] Serialized 104 byte log entry
0709 12:59:00.792864 (+593977us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:00.792924 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.792991 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:01.322256 (+529265us) raft_consensus.cc:1685] finished
0709 12:59:01.322274 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.322432 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1554,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":591409,"threads_started":1,"wal-append.queue_time_us":688557}
I20260709 12:59:01.373662  5031 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:01.477717  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 825) took 1420 ms. Trace:
I20260709 12:59:01.478231  2474 rpcz_store.cc:276] 0709 12:59:00.057477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.341900 (+284423us) service_pool.cc:224] Handling call
0709 12:59:00.450311 (+108411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.450588 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:01.075212 (+624624us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.477347 (+402135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.477401 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:01.477451 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.477513 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.477653 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2129,"prepare.queue_time_us":809384,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":955131,"threads_started":2}
I20260709 12:59:01.487452  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:59:01.493670  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 59541.4us
I20260709 12:59:01.495709  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.497694  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:01.505991  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.542447  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.542801  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.542876  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.544690  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:01.551038  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.551831  1602 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:01.552965  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.553857  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.554081  1608 raft_consensus.cc:2410] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:01.499929  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:01.559085  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.562137  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.566882  1609 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:01.484830  5011 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:01.568359  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 136514us
I20260709 12:59:01.569535  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.570375  1605 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:01.572167  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.494395  5239 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:01.578159  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:01.579367  1606 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:01.591517  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.592281  1602 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:01.591547  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.595302  1601 raft_consensus.cc:2368] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11.
I20260709 12:59:01.595567  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.599074  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.621268  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.621428  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.594907  5014 raft_consensus.cc:2764] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:59:01.635612  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.572638  5169 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:01.635856  1528 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:01.636710  1604 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:01.630523  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:01.634023  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:01.494869  5031 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:01.572649  5011 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:01.643900  1530 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
W20260709 12:59:01.666548  5260 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:59:01.670508  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.661314  1602 raft_consensus.cc:2393] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:01.645838  1605 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:01.683001  1534 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
W20260709 12:59:01.690456  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 93591.5us
I20260709 12:59:01.691674  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:01.698386  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 198542us
I20260709 12:59:01.701534  1649 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:01.702179  1609 raft_consensus.cc:2410] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:01.670369  5119 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:01.713653  1498 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:01.676155  5255 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:01.687916  5059 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:01.720515  5239 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 12:59:01.715900  5259 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:59:01.733948  5011 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:01.732218  5015 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:01.735150  5015 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.735548  5015 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:01.712473  5241 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:01.750886  1606 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:01.750976  5241 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:01.704907  4844 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:59:01.755204  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 53780.2us
I20260709 12:59:01.772508  5031 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:01.744293  5059 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.755940  1498 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:01.806063  5263 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:59:01.788251  5274 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:01.809814  5266 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
W20260709 12:59:01.810269  5264 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:59:01.810604  5269 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:59:01.757388  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 436628us
W20260709 12:59:01.839416  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 83663.6us
I20260709 12:59:01.720924  5009 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:01.842864  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 64766us
W20260709 12:59:01.862457  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 103882us
I20260709 12:59:01.869314  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:01.827540  5010 consensus_meta.cc:287] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.001s
I20260709 12:59:01.869997  1534 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:59:01.872705  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:01.873487  5009 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:01.859987  5274 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:01.878654  5239 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:01.842345  5059 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.883030  1649 leader_election.cc:400] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:59:01.786830  4844 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:01.881898  5216 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:59:01.842602  5011 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:01.798293  5014 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 12:59:01.950553  1649 leader_election.cc:403] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:59:01.912303  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 322469us
I20260709 12:59:01.859234  5225 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:01.909950  5251 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.971266  5251 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:01.974040  5251 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:01.979143  5031 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:01.979661  5169 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:01.983973  4844 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:01.984876  1572 leader_election.cc:336] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.767s (SENT)
I20260709 12:59:02.004252  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.005548  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:02.009508  1572 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.790s (SENT)
W20260709 12:59:02.010733  1572 leader_election.cc:336] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.792s (SENT)
I20260709 12:59:02.012981  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.013491  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.014350  1683 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:02.018322  5282 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:01.910619  5010 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.001502  5225 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.020043  4851 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:02.044806  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 174679us
W20260709 12:59:02.022217  5277 log.cc:927] Time spent T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:59:01.858992  5273 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.190s
I20260709 12:59:02.026584  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.053341  1675 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:02.026860  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.027552  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.054031  1678 raft_consensus.cc:2376] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5. Re-sending same reply.
I20260709 12:59:02.054116  1676 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:02.028100  5178 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:02.029111  5245 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:02.034523  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:01.910131  5274 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:02.043883  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:02.064814  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 82146.4us
I20260709 12:59:02.068892  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.057618  1682 raft_consensus.cc:2376] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5. Re-sending same reply.
W20260709 12:59:02.071252  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.072849  1526 raft_consensus.cc:2393] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:02.073534  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:02.074509  2455 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:02.075227  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:02.076864  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:02.064728  4851 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.051595  5225 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.093014  5009 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:01.910497  5241 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:02.096211  1497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.222s (SENT) [suppressed 73 similar messages]
I20260709 12:59:02.112051  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.103682  2344 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:59:02.104156  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 57626.3us
I20260709 12:59:02.123623  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.124043  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.126827  1677 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:02.133771  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.135162  2344 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:02.136343  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:02.139825  1530 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:59:02.039564  5282 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:02.153329  1677 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:02.156795  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.159425  1534 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:59:02.161600  1677 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:02.165831  1683 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:59:02.167644  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:02.173084  1527 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:59:02.174839  1678 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:59:02.175981  1675 raft_consensus.cc:1240] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:02.173425  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.162186  5012 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:02.175179  1678 pending_rounds.cc:85] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 7
I20260709 12:59:02.182866  1678 pending_rounds.cc:107] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:59:02.183167  1678 raft_consensus.cc:2889] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:02.161288  5009 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:02.113658  5014 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 12:59:02.188021  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 82987us
W20260709 12:59:02.190568  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 113806us
I20260709 12:59:02.191083  1498 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:02.127292  5015 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:02.169865  5241 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.193922  1676 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:02.199923  2339 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:02.201154  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:02.206089  1647 leader_election.cc:336] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.663s (SENT)
W20260709 12:59:02.217666  1647 leader_election.cc:336] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.674s (SENT)
I20260709 12:59:02.188077  5009 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.158687  5225 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:02.228834  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.189380  5281 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:02.231948  1678 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:02.196645  5056 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:02.237955  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.236572  1647 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.238350  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:02.242987  1676 raft_consensus.cc:2393] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:02.241988  4758 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:02.232988  5009 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:02.229383  5280 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:59:02.217666  5283 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:02.265904  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.266857  1678 raft_consensus.cc:2376] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11. Re-sending same reply.
I20260709 12:59:02.244015  5012 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:02.268489  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 68655.7us
I20260709 12:59:02.272073  2339 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:02.272704  5293 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:02.273517  5293 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:02.274155  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:02.275218  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 57647.3us
W20260709 12:59:02.275806  1647 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.707s (SENT)
W20260709 12:59:02.270241  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 164646us
I20260709 12:59:02.281247  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.228901  5059 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:02.287990  1647 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.046s (SENT)
I20260709 12:59:02.288728  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.291013  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:02.222417  5282 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.300719  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:02.304198  1679 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:02.304020  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.304863  1681 raft_consensus.cc:2376] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10. Re-sending same reply.
I20260709 12:59:02.297487  5280 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:02.309248  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.293864  5293 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:02.316145  5294 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:02.316672  5294 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.316476  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.317073  5294 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.301926  5056 raft_consensus.cc:697] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:02.310170  5179 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:02.305152  5283 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:02.334163  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 95882.2us
I20260709 12:59:02.312813  5282 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:02.353888  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.359997  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.360639  1609 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:02.333019  5179 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.366943  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.370704  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.371093  1606 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:02.367398  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.336894  5283 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.369490  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.372697  1600 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:02.374017  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.375054  1602 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:02.375290  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.354601  5280 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:02.387329  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 250981us
I20260709 12:59:02.387593  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.380306  1602 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:02.360353  5295 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.388625  1602 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:02.401597  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:02.402469  1606 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:02.377601  5179 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.404201  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.408847  1602 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:02.367905  5227 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:02.368640  5015 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:02.410946  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.410948  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:02.413918  1497 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.591s (SENT)
W20260709 12:59:02.414932  1572 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.189s (SENT)
I20260709 12:59:02.385872  5283 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:02.417259  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 120416us
I20260709 12:59:02.420235  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.442477  1600 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:02.442742  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.443398  1606 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:02.403671  5225 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:02.438645  2339 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:02.354133  5012 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.445433  1609 raft_consensus.cc:2393] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:02.447945  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.448721  1674 raft_consensus.cc:2376] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11. Re-sending same reply.
I20260709 12:59:02.442560  5014 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:02.458369  5014 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.417126  5227 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:02.472016  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 58107.7us
I20260709 12:59:02.441870  5288 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:02.396458  5280 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:02.486624  1497 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.629s (SENT)
I20260709 12:59:02.488453  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.488835  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.409379  5295 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.491056  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.491716  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.491972  5307 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:59:02.523368  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.524132  1681 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:02.495981  5294 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.498431  5014 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:02.505146  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.530733  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.509631  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:02.510330  5296 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:59:02.510545  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.519795  1606 raft_consensus.cc:2376] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8. Re-sending same reply.
I20260709 12:59:02.543289  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.442234  5056 consensus_queue.cc:237] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:02.545130  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 58572.7us
I20260709 12:59:02.487236  5059 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:02.529944  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.549269  1678 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:02.508755  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.550209  1675 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:02.531432  1682 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:02.531843  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:02.532579  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 93960.6us
I20260709 12:59:02.544296  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:02.546353  1497 leader_election.cc:336] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.632s (SENT)
I20260709 12:59:02.551798  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.552438  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.546960  5274 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:02.557238  5274 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:02.567505  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.568410  1682 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.569734  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.570662  1677 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:02.571302  1602 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:02.564024  5294 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:02.565857  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.566273  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:02.575919  1497 leader_election.cc:336] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.661s (SENT)
I20260709 12:59:02.576406  5011 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:02.489974  5293 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:02.578608  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.580894  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.581714  1606 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:02.582804  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.583739  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:02.619235  1497 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.753s (SENT)
I20260709 12:59:02.619663  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.497361  5009 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.578919  2461 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:59:02.619663  1600 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:02.620682  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.622816  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:02.620191  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.542428  5288 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:02.542026  5227 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:02.618626  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.624043  1606 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:02.625968  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.626560  1678 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:02.626992  1606 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:02.628171  1606 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:59:02.629981  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:02.637658  5295 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:02.640220  1674 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:02.642194  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.643491  1609 raft_consensus.cc:2368] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:59:02.646770  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:02.649403  1600 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:02.651369  1682 raft_consensus.cc:2410] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:59:02.654146  1678 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:02.657002  1647 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:02.659168  1600 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:02.577471  5283 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.661131  1647 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.648317  5298 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.644999  5225 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:59:02.668087  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.674031  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.664196  5274 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:02.678821  5299 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:02.679633  5299 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.685832  5313 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.686508  5313 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.670866  5298 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.690183  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.690896  1676 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.639021  5293 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.693919  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.694547  1677 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:59:02.696749  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:02.697589  1529 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:02.699081  1675 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:02.700583  2461 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:02.755813  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56207.9us
I20260709 12:59:02.756762  1647 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.757977  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:02.760951  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:02.761782  1525 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:02.764581  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.756294  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:02.778354  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:02.778602  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:02.779691  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:02.672057  5284 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:02.780221  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 78437.9us
I20260709 12:59:02.784483  1532 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:59:02.788057  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.784922  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:02.798843  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.669128  4758 consensus_queue.cc:1059] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:59:02.801841  1676 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:02.808483  1529 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:02.810354  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:02.811108  1527 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:02.670573  5307 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:59:02.812868  1525 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:02.822232  1531 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:02.824971  1532 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:02.824776  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:02.755152  5274 raft_consensus.cc:697] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:02.828271  1529 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 10. Ops: []
W20260709 12:59:02.826962  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 133138us
I20260709 12:59:02.834444  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:02.835507  1530 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:02.673623  5179 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.801070  5059 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.709950  5244 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:59:02.893916  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:02.907155  2451 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:02.800205  5014 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:02.903589  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71626.8us
I20260709 12:59:02.905627  1527 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:02.827608  5225 consensus_queue.cc:1059] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:59:02.917590  5281 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:02.918247  5225 raft_consensus.cc:3055] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:02.918879  5225 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:59:02.922281  5314 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:59:02.920064  5225 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:02.927157  5316 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
W20260709 12:59:02.927997  2342 leader_election.cc:336] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.695s (SENT)
W20260709 12:59:02.928745  2342 connection.cc:256] RPC call timeout handler was delayed by -1.1431443410000384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2685s for a response
W20260709 12:59:02.929045  2342 connection.cc:256] RPC call timeout handler was delayed by -1.1066713939999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32010000000000005s for a response
I20260709 12:59:02.929767  5068 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:02.930665  5244 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:02.932097  5244 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:02.932256  5255 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:02.929872  5317 log.cc:927] Time spent T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:59:02.938053  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:02.942394  1530 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:02.939967  2451 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:02.980819  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:02.906255  5284 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.982470  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:02.826674  5011 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:59:02.985926  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:02.825402  5288 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 12:59:02.918354  5311 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:02.827886  5295 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:59:02.938352  5009 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:02.995388  5319 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:02.927224  5225 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:02.998562  5321 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.997978  5274 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.000113  5179 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.000689  5284 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:02.941080  5287 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.102s	user 0.004s	sys 0.000s
I20260709 12:59:02.990232  5283 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:02.983250  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 45292.8us
I20260709 12:59:02.939139  5059 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.028776  2342 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:03.004822  5273 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:03.034768  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.039654  2342 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:03.042114  2342 leader_election.cc:400] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11.
I20260709 12:59:03.065959  2342 leader_election.cc:403] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:03.046304  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 247548us
W20260709 12:59:03.049638  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 239934us
I20260709 12:59:03.044114  5307 raft_consensus.cc:2764] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:59:03.034729  5282 consensus_meta.cc:287] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.677s	user 0.008s	sys 0.004s
I20260709 12:59:02.918246  5281 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:03.056064  1649 connection.cc:256] RPC call timeout handler was delayed by -1.7190509459999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 12:59:03.044540  5009 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:03.046070  1575 connection.cc:256] RPC call timeout handler was delayed by -1.59377628499999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 12:59:03.026430  5313 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:03.011196  5311 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.069761  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:03.073513  1649 connection.cc:256] RPC call timeout handler was delayed by -1.6335509460000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 12:59:03.075779  1575 connection.cc:256] RPC call timeout handler was delayed by -1.5352762849999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260709 12:59:03.003185  5255 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.076638  1497 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:03.082373  1649 connection.cc:256] RPC call timeout handler was delayed by -1.5993509460000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:59:03.083451  1649 connection.cc:256] RPC call timeout handler was delayed by -1.4625509460000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:59:03.083765  1649 connection.cc:256] RPC call timeout handler was delayed by -1.3860509460000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 12:59:03.083662  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:03.044334  5234 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:03.045162  5298 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:03.082515  1575 connection.cc:256] RPC call timeout handler was delayed by -1.5316762849999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 12:59:03.084230  1649 connection.cc:256] RPC call timeout handler was delayed by -1.3761509459999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 12:59:03.070930  5319 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11.
W20260709 12:59:03.101256  1575 connection.cc:256] RPC call timeout handler was delayed by -1.4983762849999493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 12:59:03.090883  1497 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:59:03.102123  1575 connection.cc:256] RPC call timeout handler was delayed by -1.4443762849999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:59:03.103001  1575 connection.cc:256] RPC call timeout handler was delayed by -1.3804762849999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 12:59:03.103706  1575 connection.cc:256] RPC call timeout handler was delayed by -1.3372762849999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
I20260709 12:59:03.103982  2342 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:03.104087  1575 connection.cc:256] RPC call timeout handler was delayed by -1.3219762849999483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:59:03.104683  1575 connection.cc:256] RPC call timeout handler was delayed by -1.3138762849999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:59:03.105144  1575 connection.cc:256] RPC call timeout handler was delayed by -1.2328762849999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 12:59:03.105484  1575 connection.cc:256] RPC call timeout handler was delayed by -1.1743762849999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 12:59:03.105901  1575 connection.cc:256] RPC call timeout handler was delayed by -1.1437762849999444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 12:59:03.105542  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:03.106262  1575 connection.cc:256] RPC call timeout handler was delayed by -1.109576284999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 12:59:03.106634  1575 connection.cc:256] RPC call timeout handler was delayed by -1.0870762849999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:59:03.107265  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.107551  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:03.110150  5311 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:03.026396  5321 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.112860  5321 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:03.114142  5320 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:59:03.117395  5281 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.119532  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:03.119936  5255 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.120213  2475 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.123415  5059 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:03.124138  5290 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.773s	user 0.000s	sys 0.001s
I20260709 12:59:03.072580  5288 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:59:03.144383  1649 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:03.147289  5284 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.151158  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:03.151927  2423 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:03.086246  5307 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.088202  5316 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:03.101805  5253 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.144170  5244 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:03.155913  5244 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:03.156355  5244 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.081624  5282 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:03.157881  5282 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:03.158526  5267 log.cc:927] Time spent T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 1.606s	user 0.008s	sys 0.038s
I20260709 12:59:03.160491  5282 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.153836  5316 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.161491  5316 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.078799  5323 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:59:03.161754  1649 leader_election.cc:400] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 4. Current term is 5.
I20260709 12:59:03.162295  5323 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:03.162674  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.163705  2474 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:03.163918  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.164373  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 877) took 1104 ms. Trace:
I20260709 12:59:03.164784  2474 rpcz_store.cc:276] 0709 12:59:02.059771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.060039 (+   268us) service_pool.cc:224] Handling call
0709 12:59:03.163150 (+1103111us) spinlock_profiling.cc:243] Waited 8.73 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:59:03.163330 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.164116 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.164316 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20089600}
I20260709 12:59:03.165874  5331 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:03.088869  5325 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:59:03.162681  5323 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:03.167945  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:03.167243  5059 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:02.296934   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:03.166275  5326 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:03.183341  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 599) took 1851 ms (client timeout 2206 ms). Trace:
W20260709 12:59:03.172325  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 65145.4us
W20260709 12:59:03.186839  1607 rpcz_store.cc:269] 0709 12:59:01.331656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.167607 (+1835951us) service_pool.cc:224] Handling call
0709 12:59:03.183279 (+ 15672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:03.186736  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 799) took 1115 ms. Trace:
I20260709 12:59:03.188514  1500 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.179982  2475 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:03.191565  1575 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.191413  1679 rpcz_store.cc:276] 0709 12:59:02.071533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.071675 (+   142us) service_pool.cc:224] Handling call
0709 12:59:02.089825 (+ 18150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.304618 (+214793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.186485 (+881867us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54001b9754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:03.186671 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492527360}
I20260709 12:59:03.184800  2455 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:03.192603  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 213842us
W20260709 12:59:03.195360  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 128460us
W20260709 12:59:03.196157  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 88721.1us
I20260709 12:59:03.197453  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:03.197844  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.198549  1682 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:03.199841  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.200748  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.201431  1676 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:59:03.201941  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.202729  1678 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:03.204918  2455 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:59:03.205761  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.206354  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:03.206974  1606 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.165333  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.085772  5234 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.211686  1678 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:03.142629  5313 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:03.215049  1678 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:59:03.221290  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 56025.9us
I20260709 12:59:03.212453  1676 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:03.215840  1572 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:03.218992  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 128180us
I20260709 12:59:03.220430  1575 leader_election.cc:400] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11.
I20260709 12:59:03.222918  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.223160  1575 leader_election.cc:403] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:59:03.177707  5255 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:03.227474  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:03.228049  1609 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.221534  1678 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.234282  2339 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:03.234375  1678 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.229760  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.237138  1682 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:03.201125  5245 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.251695  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.251888  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.252132  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.252471  1680 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:03.253227  1675 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:03.245934  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.255252  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.257541  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.259164  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.261448  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.262063  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.218761  5021 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.262301  1530 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:03.263669  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.219305  5282 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:03.226111  5313 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.265625  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.264357  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.267765  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.268481  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.269459  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.226261  5059 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:03.279749  2455 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:03.229362  5321 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:03.327035  5321 raft_consensus.cc:697] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:03.264528  5119 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.327495  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:03.327996  5321 consensus_queue.cc:237] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.327884  5119 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.328774  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:03.280355  5298 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:59:03.321357  1609 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:03.271646  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:03.324214  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:03.262357  5288 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 12:59:03.331194  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 76043.4us
I20260709 12:59:03.331336  1675 raft_consensus.cc:2376] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7. Re-sending same reply.
I20260709 12:59:03.231911  5056 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:03.332048  1575 leader_election.cc:400] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11.
I20260709 12:59:03.324975  5313 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.332542  1575 leader_election.cc:403] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:59:03.262176  5307 consensus_queue.cc:1059] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:59:03.333707  5333 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:03.332139  5056 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.334407  5333 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11.
I20260709 12:59:03.262670  5293 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:59:03.335500  5283 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:03.334416  5056 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.336033  5283 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.323498  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:03.324728  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.346580  1533 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:03.349865  1527 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:03.350591  1680 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:03.246433  5268 consensus_queue.cc:1059] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:59:03.249737  5011 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:03.366775  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.263463  4934 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:03.381489  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:03.376508  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7c3ea752cffa4a138dd2984b56316ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3cabc5110903443ba3beb5cbb14afa91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:03.380782  1606 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
W20260709 12:59:03.390621  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 119057us
I20260709 12:59:03.183337  5323 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.419680  1678 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
W20260709 12:59:03.389860  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 57945.7us
I20260709 12:59:03.366963  5011 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.453161  1678 pending_rounds.cc:85] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 8
I20260709 12:59:03.453635  1678 pending_rounds.cc:107] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:59:03.454182  1678 raft_consensus.cc:2889] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:03.453855  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.455765  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.456772  1678 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:03.419230  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 153126us
W20260709 12:59:03.456308  1572 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.863s (SENT)
W20260709 12:59:03.456717  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 187389us
I20260709 12:59:03.229521  5331 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 12:59:03.229447  5326 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 12:59:03.377753  5298 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:03.466325  5298 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.466766  5298 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.325551  5021 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.388267  4934 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:03.461971  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.485671  1678 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:03.463868  5119 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.464090  5337 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11.
I20260709 12:59:03.460536  1572 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:03.464654  5327 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:03.502329  5327 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.502846  5327 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.503558  5021 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.443717  5294 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:03.506249  5294 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.506752  5294 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.442523  5283 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:03.510080  4934 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:03.514689  5335 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:59:03.516368  5271 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:03.517005  5271 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.517673  5169 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:03.519479  5169 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:03.520362  5169 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.521644  5169 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.524314  5313 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.518018  5271 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.530860  5271 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:03.479128  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:03.447269  5319 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:03.534662  5319 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:03.535636  5319 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.492897  1679 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:03.455368  5011 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.388679  5316 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:03.509230  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 1979) took 2292 ms (client timeout 2126 ms). Trace:
W20260709 12:59:03.553895  1528 rpcz_store.cc:269] 0709 12:59:01.217166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.217285 (+   119us) service_pool.cc:224] Handling call
0709 12:59:03.508996 (+2291711us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b540028f354. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:03.509130 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194322688}
I20260709 12:59:03.555282  5216 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:03.555466  5316 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:03.555781  5216 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.556635  5216 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.557183  5313 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:03.542824  5274 raft_consensus.cc:3055] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:03.543828  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.547538  5299 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:03.548869  2474 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 12. Ops: []
I20260709 12:59:03.537228  5319 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.582844  1606 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:03.574641  5216 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:03.540007  5244 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.573969  5274 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.594512  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:03.595515  1606 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.609912  5234 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.613044  5234 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.615638  5239 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:03.617414  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 394546us
I20260709 12:59:03.619220  1497 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:03.623271  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:03.634685  1497 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:03.638504  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:03.624542  5251 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:03.645918  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:03.624399  5178 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:59:03.616369  5239 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.636379  5119 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:03.645375  1606 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:03.652287  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:03.637583  5316 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:03.657063  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.654124  1609 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:03.646975  4932 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:03.661478  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.663484  1534 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 9. Ops: []
I20260709 12:59:03.664477  1649 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:03.665323  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.651836  5015 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:03.665441  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:03.656556  5251 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.658154  5119 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:59:03.675417  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.662791  4932 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.675997  4932 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:03.637230  5274 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.678604  5274 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:03.663173  5021 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:03.669045  5268 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:03.672245  5338 log.cc:927] Time spent T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:59:03.670326  5284 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:03.681622  5059 consensus_queue.cc:1175] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" responder_term: 6 status { last_received { term: 4 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:03.670691  5232 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:03.686976  5232 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:03.687922  5232 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.690640  5119 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:03.697209  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.693217  5294 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.708353  5294 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:03.710041  5244 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:03.711293  5350 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:59:03.712606  4932 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.700748  5327 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.683606  5326 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 12:59:03.715821  5353 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:59:03.715829  5021 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:03.713598  5056 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.693020  5298 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.731325  5271 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.734580  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.745601  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.746887  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.737000  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:03.741554  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 73191.6us
W20260709 12:59:03.683990  5354 log.cc:927] Time spent T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.174s	user 0.003s	sys 0.002s
I20260709 12:59:03.745770  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.736050  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:03.751847  1529 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:03.748461  1530 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:03.749972  1531 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:03.757411  1532 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:59:03.757917  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.759356  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.759447  5021 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.760507  5011 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.761914  4851 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.751649  5271 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.751834  5268 raft_consensus.cc:3055] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:03.769281  5268 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.768654  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:03.758666  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:03.771806  1609 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.773238  1529 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:03.774734  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.775511  1649 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.775803  1529 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:03.778314  1529 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:59:03.777365  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.780061  5234 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:03.767062  5010 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.782598  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:03.784021  5234 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.759505  5230 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:03.784817  5230 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.785250  5230 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:03.786360  5268 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.787822  5268 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:03.790865  5298 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.791554  5326 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:03.792037  5326 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.757288  5216 consensus_queue.cc:1059] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:03.792958  5326 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.795804  2451 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:03.777911  5362 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:03.798257  5362 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.799152  5362 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.813472  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.813743  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.814451  1675 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:03.815305  5327 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:03.814517  1679 raft_consensus.cc:2393] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 5: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:03.810364  5014 raft_consensus.cc:3055] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:03.831305  5014 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.832381  5014 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:03.834511  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.835855  1679 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:03.866184  1529 raft_consensus.cc:1240] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:03.882478  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:03.883507  1679 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:03.894049  1609 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:03.895161  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:03.895838  1679 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.894743  2451 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:03.898475  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.899227  1529 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:03.902484  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:03.903066  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.905720  5010 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:03.906265  5010 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.906698  5010 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.895714  5014 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:03.913951  4932 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.926195  1679 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:03.933921  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.934875  4932 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:03.935355  4932 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.935741  4932 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.935628  1497 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:03.936328  5010 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.936831  5357 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:03.937376  5357 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:03.938206  5357 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:03.934890  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.939323  5010 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:03.944372  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2293) took 2609 ms. Trace:
I20260709 12:59:03.945889  1601 rpcz_store.cc:276] 0709 12:59:01.311740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.666773 (+355033us) service_pool.cc:224] Handling call
0709 12:59:02.230311 (+563538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.230491 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.230516 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:02.230556 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:02.230603 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.230657 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.921063 (+1690406us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54002693d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:03.921187 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295393536}
I20260709 12:59:03.943674  5327 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:03.933928  5372 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:59:03.986060  5372 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:03.986536  5372 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:03.987664  5372 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:03.988955  5372 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:03.919826  5216 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:59:03.998550  5370 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:59:03.984113  5327 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:04.018066  5363 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:59:04.046307  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:04.047291  2451 raft_consensus.cc:2410] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:04.049122  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.031980  5315 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.050637  5274 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:04.043409  5280 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:04.051108  5244 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.081761  1601 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:04.044961  5232 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 12:59:04.082609  5367 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:59:04.091382  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 69828.4us
I20260709 12:59:04.063592  5274 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.096843  1676 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:04.096896  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:04.055809  5315 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.108407  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.113391  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:04.115061  1674 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:04.116979  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:04.114315  2461 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:04.122054  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.130290  4932 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.132673  4932 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:04.093551  5331 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.129428  5230 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.139464  5315 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:04.140208  5230 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:04.145155  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:04.146461  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:04.147596  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:04.148250  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:04.148609  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:04.149240  2461 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:04.149289  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:04.154839  1529 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:04.150002  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:04.067075  5244 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:04.183049  1647 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.302s (SENT)
I20260709 12:59:04.190328  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:04.190788  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 90695.7us
W20260709 12:59:04.182209  5265 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 2.462s	user 0.016s	sys 0.011s
I20260709 12:59:04.201799  5327 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:04.203601  5244 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:04.203773  1601 raft_consensus.cc:3055] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:04.204289  1601 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:04.205685  1500 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:04.205104  1601 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.207516  1601 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:04.208809  5010 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:04.210331  5274 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:04.215516  5011 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:04.217900  1601 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:04.222486  1529 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:04.184762  5014 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:04.224776  1674 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:04.225999  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:04.226647  1674 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:04.230873  1676 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:04.234656  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:04.235337  2423 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:04.242805  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:04.243829  1529 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
W20260709 12:59:04.244362  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.231875  5014 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.250942  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.251917  1679 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:04.257551  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:04.267865  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.268515  1674 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:04.270645  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:04.280576  2461 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:04.288574  1679 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:04.293087  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:04.303406  1674 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:04.308336  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:04.309293  1601 raft_consensus.cc:2376] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9. Re-sending same reply.
I20260709 12:59:04.326907  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2306) took 1124 ms. Trace:
I20260709 12:59:04.334106  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2307) took 1131 ms. Trace:
I20260709 12:59:04.335856  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 1989) took 1075 ms. Trace:
I20260709 12:59:04.334699  1604 rpcz_store.cc:276] 0709 12:59:03.202544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.203324 (+   780us) service_pool.cc:224] Handling call
0709 12:59:03.229774 (+ 26450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.229965 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:03.446350 (+216385us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.333597 (+887247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:04.333678 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:04.333747 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.333859 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.334027 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":792783,"prepare.queue_time_us":209550,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":83,"thread_start_us":221363,"threads_started":2,"wal-append.queue_time_us":197990}
I20260709 12:59:04.337611  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2070) took 1830 ms. Trace:
I20260709 12:59:04.338155  1602 rpcz_store.cc:276] 0709 12:59:02.507646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.624922 (+117276us) service_pool.cc:224] Handling call
0709 12:59:02.625312 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.654817 (+ 29505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.654854 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:02.655805 (+   951us) log.cc:844] Serialized 26 byte log entry
0709 12:59:03.155564 (+499759us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b18003b3680. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d15380d1 00007f25d1953a0f
0709 12:59:03.251438 (+ 95874us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:03.577831 (+326393us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.337098 (+759267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.337179 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:04.337221 (+    42us) raft_consensus.cc:1685] finished
0709 12:59:04.337357 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.337521 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":860883,"prepare.queue_time_us":203864,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":14828,"raft.queue_time_us":11950,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4187,"spinlock_wait_cycles":3411200,"thread_start_us":289665,"threads_started":2,"wal-append.queue_time_us":785657}
I20260709 12:59:04.341665  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2308) took 1138 ms. Trace:
W20260709 12:59:04.327703  5268 consensus_meta.cc:287] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.010s
I20260709 12:59:04.328640  5230 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:04.329257  5014 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:04.353255  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 45928us
W20260709 12:59:04.330114  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 876266us
I20260709 12:59:04.354595  2423 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:04.354799  1575 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.331041  5345 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:04.332037  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 871573us
I20260709 12:59:04.332734  5283 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:04.336381  1534 rpcz_store.cc:276] 0709 12:59:03.260401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.260558 (+   157us) service_pool.cc:224] Handling call
0709 12:59:03.325457 (+ 64899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.663910 (+338453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.335484 (+671574us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54000c80d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:04.335725 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776626944}
W20260709 12:59:04.359808  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.360908  1526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 740) took 2494 ms (client timeout 2078 ms). Trace:
I20260709 12:59:04.364261  1572 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:04.361793  1525 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:59:04.366529  1526 rpcz_store.cc:269] 0709 12:59:01.866103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.868656 (+  2553us) service_pool.cc:224] Handling call
0709 12:59:04.360614 (+2491958us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54003197d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:04.360814 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436406016}
I20260709 12:59:04.342259  1600 rpcz_store.cc:276] 0709 12:59:03.202816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.203404 (+   588us) service_pool.cc:224] Handling call
0709 12:59:03.212943 (+  9539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.213152 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:03.282766 (+ 69614us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.341130 (+1058364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:04.341209 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:04.341287 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.341401 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.341587 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":779681,"prepare.queue_time_us":177183,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":4353920,"thread_start_us":320409,"threads_started":2,"wal-append.queue_time_us":356334}
I20260709 12:59:04.333554  1608 rpcz_store.cc:276] 0709 12:59:03.202261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.205070 (+  2809us) service_pool.cc:224] Handling call
0709 12:59:03.205338 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.205526 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:03.231076 (+ 25550us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.326207 (+1095131us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b18001dfe60. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce825c0a 00007f25d7f65219 00007f25ce8ada40 00007f25ce8a84e4 00007f25ce8a8455 00007f25d1990060 00007f25d19a2716 00007f25d19b3287 00007f25d19b3208
0709 12:59:04.326424 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:04.326494 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:04.326564 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.326654 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.326814 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69781,"prepare.queue_time_us":58621,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":946465,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":158554496,"thread_start_us":150702,"threads_started":1,"wal-append.queue_time_us":290281}
I20260709 12:59:04.372016  1607 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:04.372795  1607 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:04.373860  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:04.374891  1603 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:04.375406  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2055) took 1987 ms. Trace:
I20260709 12:59:04.375727  1603 rpcz_store.cc:276] 0709 12:59:02.387672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.352997 (+1965325us) service_pool.cc:224] Handling call
0709 12:59:04.375349 (+ 22352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.376737  1533 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:04.372830  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:04.380507  1607 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.383543  1607 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:04.375283  5325 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:04.385509  1647 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.042s (SENT)
I20260709 12:59:04.386204  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:04.386107  5325 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.387491  5268 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:04.388404  5325 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:04.357854  5230 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.372956  5295 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:59:04.391170  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 801) took 2215 ms. Trace:
I20260709 12:59:04.395197  5346 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:04.397042  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:04.398406  5230 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:04.400038  5328 raft_consensus.cc:2764] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:59:04.391050  5234 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:04.413138  5234 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.408314  1500 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:04.415074  1500 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:04.408455  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:04.417091  1678 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:04.424443  5174 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:04.427311  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 72656.6us
I20260709 12:59:04.428117  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.429219  1677 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:04.429971  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:04.430904  1678 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:04.432457  5251 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:04.437805  5345 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:04.438411  5345 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:04.438819  5345 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:04.440727  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.441256  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.444118  5328 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:04.444680  1534 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:04.446583  5328 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:04.447391  5328 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:04.461362  1677 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:04.461998  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:04.466010  1678 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:04.468098  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:04.470396  1680 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:59:04.471745  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 51781.5us
W20260709 12:59:04.474172  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.476446  1681 raft_consensus.cc:1275] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:59:04.480878  5375 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 12:59:04.481222  5301 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:04.482909  5355 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.820s	user 0.000s	sys 0.004s
W20260709 12:59:04.483668  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 55624.9us
I20260709 12:59:04.489678  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.474970  5174 raft_consensus.cc:697] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:04.489979  1572 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:04.490391  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 108882us
I20260709 12:59:04.494125  1680 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:04.494762  1498 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:04.506058  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.506505  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:04.486019  5251 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:04.508085  1607 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:59:04.509599  1607 pending_rounds.cc:85] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 5
I20260709 12:59:04.509944  1607 pending_rounds.cc:107] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:59:04.510289  1607 raft_consensus.cc:2889] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:04.508890  1498 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:04.505052  5255 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:04.516094  5255 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.513895  5015 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:04.516502  5255 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:04.516680  5282 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.512517  5283 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:04.522337  5283 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.522738  5283 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:04.493887  5346 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:04.508641  5373 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.423s	user 0.002s	sys 0.001s
I20260709 12:59:04.525748  5021 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:04.525871  5174 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.526384  5015 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:04.530972  1575 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.531953  5325 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:59:04.549490  2344 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.551730  2344 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:04.553776  5015 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.558032  5282 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:04.559410  5251 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.530115  4842 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:59:04.566385  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.567582  1575 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:04.571321  1647 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.662s (SENT)
I20260709 12:59:04.571807  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:04.572592  5331 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:04.512420  5302 consensus_queue.cc:1059] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:59:04.525172  5387 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:04.574975  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:04.578590  5327 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:04.579831  5312 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:04.580937  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 44335.6us
I20260709 12:59:04.507761  5286 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:59:04.586946  5282 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:04.587633  5358 log.cc:927] Time spent T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.926s	user 0.000s	sys 0.002s
I20260709 12:59:04.580853  5271 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:04.606544  5281 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:04.607522  5281 raft_consensus.cc:3055] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:04.607896  5281 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:04.591523  5328 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.594465  5056 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:04.594921  5315 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:04.617293  5315 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:04.524574  5301 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:59:04.596947  5244 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:04.596976  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.619493  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:04.620450  2339 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:04.597790  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 876) took 2542 ms. Trace:
I20260709 12:59:04.581795  5337 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:04.621944  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:04.577106  2344 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:04.618281  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.626720  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.628803  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.630463  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.622373  2476 rpcz_store.cc:276] 0709 12:59:02.055480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.065132 (+  9652us) service_pool.cc:224] Handling call
0709 12:59:03.183136 (+1118004us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800113198. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:59:03.183314 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.183525 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:03.202150 (+ 18625us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.585621 (+1383471us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18004314a0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25d15404bc 00007f25ce88e48b 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d153823a
0709 12:59:04.597383 (+ 11762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:04.597438 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:04.597484 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.597551 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.597714 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11359,"prepare.queue_time_us":19963,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":11609,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"spinlock_wait_cycles":31283328,"thread_start_us":44323,"threads_started":1,"wal-append.queue_time_us":156910,"wal-append.run_cpu_time_us":1535,"wal-append.run_wall_time_us":1104269}
I20260709 12:59:04.606617  5302 raft_consensus.cc:3055] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:04.633947  5302 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:04.625947  5327 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.634950  5302 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.636277  5302 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:04.637920  5328 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:04.609139  5281 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.645433  5281 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:04.649132  5315 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.612947  5271 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:04.604529  1498 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:04.614282  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.614926  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.615391  5216 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:04.616086  5282 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:04.616261  5286 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:04.617426  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:04.659152  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:04.659981  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 82971.4us
I20260709 12:59:04.661170  2339 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:04.730101  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 830) took 2027 ms. Trace:
I20260709 12:59:04.751257  1679 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:04.751693  2474 rpcz_store.cc:276] 0709 12:59:02.703043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.181789 (+478746us) service_pool.cc:224] Handling call
0709 12:59:03.182143 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.577328 (+395185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.729824 (+1152496us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540059f954. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:04.730025 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842840960}
I20260709 12:59:04.632556  5312 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:04.673578  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 2038) took 1894 ms. Trace:
I20260709 12:59:04.755594  1525 rpcz_store.cc:276] 0709 12:59:02.778707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.827530 (+ 48823us) service_pool.cc:224] Handling call
0709 12:59:04.361446 (+1533916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:04.367158 (+  5712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.673264 (+306106us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54003197d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:04.673471 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3526761856}
I20260709 12:59:04.654984  5227 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:04.753938  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 92876.9us
I20260709 12:59:04.758967  1675 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:04.759927  1674 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:04.665081  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.602798  1575 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.394162  1683 rpcz_store.cc:276] 0709 12:59:02.175832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.178292 (+  2460us) service_pool.cc:224] Handling call
0709 12:59:02.178544 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.178743 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:02.215368 (+ 36625us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.217443 (+  2075us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.217848 (+   405us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.496599 (+1278751us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b1800414460. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:59:03.548560 (+ 51961us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b1800414460. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:59:04.390214 (+841654us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b1800414460. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce825c0a 00007f25d7f65219 00007f25d154ed70 00007f25d1542293 00007f25d1537cea 00007f25d153823a 00007f25d19a2a2a 00007f25d19b20bf 00007f25d19b2038
0709 12:59:04.390654 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.390806 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:04.390848 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:04.390899 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.390979 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.391111 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1832,"prepare.queue_time_us":1318519,"prepare.run_cpu_time_us":235,"prepare.run_wall_time_us":235,"raft.queue_time_us":4418,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":259,"spinlock_wait_cycles":39034240,"thread_start_us":25183,"threads_started":1}
W20260709 12:59:04.780586  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.785921  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.790885  1677 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:59:04.795243  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 192531us
I20260709 12:59:04.740535  5346 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:04.817989  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.750876  5286 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:04.693050  5244 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:04.819638  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.826709  1676 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:04.828042  1575 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.689642  5327 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:04.775904  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 171453us
I20260709 12:59:04.824060  1679 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
W20260709 12:59:04.825295  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.755484  5216 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.831804  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:04.828491  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 746) took 2196 ms. Trace:
I20260709 12:59:04.855232  2421 rpcz_store.cc:276] 0709 12:59:02.632288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.632469 (+   181us) service_pool.cc:224] Handling call
0709 12:59:02.645434 (+ 12965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.827852 (+182418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.827883 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:02.827922 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:02.827963 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.828244 (+2000281us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54005d0a54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:04.828287 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.828425 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418993408}
I20260709 12:59:04.724988  5337 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.790618  4842 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:04.777245  5294 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:04.845392  1682 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:04.837853  5169 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:04.871434  1674 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:04.874991  1675 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:04.818325  5321 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:04.838505  5268 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.858740  5227 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.885319  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:04.838055  5244 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:04.843863  5333 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:04.877673  5216 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:04.852727  5015 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.853029  5031 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.883490  5331 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:04.901966  5227 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:04.892335  4842 raft_consensus.cc:697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:04.912065  1647 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:04.895341  5325 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:04.898352  5294 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:04.926679  5031 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.902526  5244 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:04.906185  5271 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:04.948603  5323 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:04.957772  5364 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 1.003s	user 0.001s	sys 0.003s
I20260709 12:59:04.961504  5282 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.962428  5294 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.887800  5337 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:04.967850  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.968683  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56718.6us
I20260709 12:59:04.852054  5346 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:04.888803  5345 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.904634  5268 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.941684  5284 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:04.913254  5387 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:59:04.925954  5331 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:04.918879  5248 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:59:04.989735  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 173420us
W20260709 12:59:04.994707  2342 leader_election.cc:336] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.796s (SENT)
I20260709 12:59:04.919140  5015 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:04.945900  5271 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:04.972472  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 71826.3us
I20260709 12:59:04.995379  5331 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:05.004923  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:05.005985  1674 raft_consensus.cc:2393] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:04.913530  5286 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:05.009068  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 258906us
I20260709 12:59:04.992156  5284 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:04.967321  5325 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.007521  5271 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:05.023710  1607 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:05.032042  1600 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:05.058210  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.059298  1606 raft_consensus.cc:2368] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9.
I20260709 12:59:05.062168  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.061970  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.015769  5284 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:05.064316  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.066058  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.077073  1600 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:05.013015  5312 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:05.077914  1606 raft_consensus.cc:2410] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:59:05.030208  5283 consensus_meta.cc:287] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.002s
I20260709 12:59:05.036338  5346 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.097749  5312 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.098563  5283 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.022799  5280 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.100299  5280 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:05.101120  5283 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.047209  5286 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:05.103711  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.027789  5268 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:05.108345  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:05.108490  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.113257  1605 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:05.113682  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:05.114454  1527 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:05.026443  5325 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.118036  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:05.119743  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:05.061955  5328 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.120070  5010 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.120481  5328 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.121122  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:05.121984  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:05.012032  4842 consensus_queue.cc:237] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:05.122629  1682 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:05.025115  5337 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.125756  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:05.054601  5327 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:05.127233  5327 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.128456  5244 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.120615  5010 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:05.133116  5230 consensus_queue.cc:1059] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:05.103396  5366 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.056s	user 0.004s	sys 0.000s
I20260709 12:59:05.138019  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:05.139036  5010 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:05.139317  5255 consensus_meta.cc:287] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.006s
I20260709 12:59:05.056264  5031 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:05.123817  5015 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:05.021889  5215 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:59:05.140879  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:05.140722  5216 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.139786  5255 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:05.168022  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.106731  5174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.016s	sys 0.016s
W20260709 12:59:05.169535  5174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.016s	sys 0.017s
I20260709 12:59:05.169660  5239 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.122714  5328 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.170018  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.170670  1604 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:05.171676  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:05.172315  5234 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.176385  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.181814  5283 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:05.183466  5283 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:05.182402  5397 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:05.196027  1605 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:05.102320  5280 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:05.187511  1575 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:05.191931  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 181526us
I20260709 12:59:05.205892  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:05.171684  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:05.206188  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.205235  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 205116us
I20260709 12:59:05.147795  1682 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:05.206137  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:05.207309  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:05.183920  5283 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:05.211133  2474 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 9. Ops: [7.8-7.8]
W20260709 12:59:05.212931  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 47791.4us
I20260709 12:59:05.213138  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:05.210493  5400 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:05.208050  1527 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:05.206990  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.207883  1678 raft_consensus.cc:2410] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:59:05.228561  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.211218  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.224555  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:05.229001  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.227421  1528 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:59:05.206787  1604 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:05.202683  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.236594  1528 raft_consensus.cc:1275] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:05.236871  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:05.237185  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:05.236914  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:05.236588  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 206246us
I20260709 12:59:05.238070  5397 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:59:05.202477  5328 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:05.242342  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.163333  4813 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:59:05.210835  5031 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:05.251816  2475 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:05.263552  1679 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:05.263634  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:05.264811  1682 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:05.265667  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.263753  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.228418  5010 consensus_queue.cc:1059] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:59:05.269490  1675 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:05.239667  5394 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:05.283888  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:05.290968  1674 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:05.324537  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.325677  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.229687  5012 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 12:59:05.347276  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.348203  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.348718  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:05.248597  5397 consensus_queue.cc:1243] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:05.285496  5059 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:05.355792  1679 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:05.356228  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.357015  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.357857  5301 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.377043  1525 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:59:05.287604  5394 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:05.358794  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.360700  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.243511  5331 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:05.327401  5010 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:05.371814  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:05.377518  1604 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:05.272081  5328 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.276733  5280 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:59:05.373790  1572 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.400460  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:05.389168  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.401971  1608 raft_consensus.cc:2410] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:05.403012  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.393323  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:05.409943  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.413228  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.413477  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.346133  5050 consensus_queue.cc:1059] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:59:05.418081  1608 raft_consensus.cc:2410] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:05.418007  2421 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:05.420181  2475 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:59:05.420678  2475 pending_rounds.cc:85] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 9
I20260709 12:59:05.420962  2475 pending_rounds.cc:107] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:59:05.421262  2475 raft_consensus.cc:2889] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:05.338308  5227 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.373114  5288 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:05.424190  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.425024  2428 raft_consensus.cc:2410] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:05.425668  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:05.429478  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.388043  5244 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:05.392920  5394 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:05.441900  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.441984  2435 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:05.412333  5282 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:05.457064  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.457515  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.424523  5323 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:05.418828  5059 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:05.424695  5248 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:05.436519  5357 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:05.398356  5301 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:05.467545  1606 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:05.491864  5255 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:05.492367  5216 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:05.493623  5402 log.cc:927] Time spent T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:59:05.404531  5010 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.494621  5323 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:05.466789  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.502101  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.508759  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:05.499245  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.464296  5059 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:05.514226  1679 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:05.557276  2474 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:05.557441  1679 pending_rounds.cc:85] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 3
W20260709 12:59:05.557818  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 55833.1us
I20260709 12:59:05.518981  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.558597  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:05.520045  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.557827  1679 pending_rounds.cc:107] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:05.559242  1606 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:05.559628  1679 raft_consensus.cc:2889] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:05.524748  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:05.560195  1680 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:05.497470  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.561175  1604 raft_consensus.cc:2410] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:05.540095  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.543278  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.561945  1608 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
W20260709 12:59:05.537699  2342 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.023s (SENT)
I20260709 12:59:05.566984  2342 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.568792  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.571664  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.572372  1608 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
W20260709 12:59:05.574465  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 342187us
I20260709 12:59:05.575914  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:05.577029  1605 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:05.533522  5400 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:05.579353  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.580142  1608 raft_consensus.cc:2410] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:05.577821  2339 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:05.581516  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 141750us
I20260709 12:59:05.568293  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.587790  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.588527  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.589148  1604 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:05.594699  1680 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
W20260709 12:59:05.596139  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 58664.8us
I20260709 12:59:05.596628  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.596992  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.597493  1608 raft_consensus.cc:2410] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:05.599891  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:05.602404  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:05.604359  2342 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.135s (SENT)
I20260709 12:59:05.604255  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:05.605000  2342 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.568881  5255 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:05.575066  5397 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:05.629346  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:05.631847  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.634781  1605 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:05.640496  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.578480  5328 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.584425  5403 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:05.642444  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.643729  1604 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
W20260709 12:59:05.606065  2342 leader_election.cc:336] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.206s (SENT)
W20260709 12:59:05.662853  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56811.2us
I20260709 12:59:05.585637  5234 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:05.562788  5274 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:59:05.649899  1606 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
W20260709 12:59:05.637406  5406 log.cc:927] Time spent T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:59:05.601115  5031 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:05.610659  5294 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:05.575311  5282 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:59:05.645473  5346 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:05.610548  5244 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:05.682631  2474 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:05.610606  5398 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:05.650501  5337 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:05.677309  5312 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:05.668972  5325 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:05.750979  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:05.670315  5331 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:05.754730  1605 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:05.678086  5012 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:05.665614  4813 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:59:05.689637  5248 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.672160  5409 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:05.760506  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 208419us
I20260709 12:59:05.679268  5031 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:05.756703  5286 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.004s
I20260709 12:59:05.682958  5417 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.682601  5397 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:05.782001  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 113290us
W20260709 12:59:05.772327  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.666164  5323 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:05.772511  5374 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.619s	user 0.005s	sys 0.000s
I20260709 12:59:05.771205  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.767649  5294 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:05.788498  1600 raft_consensus.cc:2410] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:59:05.807678  5286 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.782012  5409 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:05.810086  5420 log.cc:927] Time spent T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 12:59:05.810674  5412 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:59:05.751632  5227 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:05.818702  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48430.6us
I20260709 12:59:05.765940  4932 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:59:05.819706  5331 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:05.820307  5415 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
W20260709 12:59:05.821419  5413 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:59:05.807396  5417 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:05.823875  5405 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:59:05.824815  5010 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.807796  5397 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:05.830435  5283 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.596s	user 0.001s	sys 0.010s
I20260709 12:59:05.832002  5398 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.756352  5400 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:05.811157  5408 log.cc:927] Time spent T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.314s	user 0.001s	sys 0.001s
W20260709 12:59:05.829303  5284 consensus_meta.cc:287] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.000s
I20260709 12:59:05.885272  5283 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.893846  5284 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.895925  5283 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.811796  5274 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.897217  5274 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.898027  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:05.899269  5274 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.900557  5294 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.901165  1609 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:05.896505  5284 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:05.842860  2344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.005s
I20260709 12:59:05.845347  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.766662  5357 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:59:05.905180  2344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.013s	sys 0.009s
I20260709 12:59:05.818575  4842 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.791438  5031 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:05.873255  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.839558  5234 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:05.875787  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 204346us
I20260709 12:59:05.841447  5286 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:05.773847  5248 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.929682  2461 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:05.774106  5012 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.891201  5417 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:05.892400  5397 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.894157  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:05.908027  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 62755.9us
I20260709 12:59:05.937395  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.938165  2342 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.852361  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:05.906001  4842 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:05.918907  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 45778.1us
I20260709 12:59:05.915192  5050 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:05.939702  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.913069  5274 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.941395  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.926484  5331 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.889204  5398 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.945802  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.927721  5284 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:05.946177  2342 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:05.947578  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 95329.8us
W20260709 12:59:05.938285  5271 consensus_meta.cc:287] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.847s	user 0.011s	sys 0.001s
I20260709 12:59:05.930393  5323 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:05.947292  5268 raft_consensus.cc:2764] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:05.932566  5234 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.945668  5216 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:05.959151  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:05.961843  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
W20260709 12:59:05.952368  5431 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:06.003819  1572 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:05.966118  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:06.007050  1607 raft_consensus.cc:2410] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:59:05.979219  5398 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.982156  5248 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:05.982331  1679 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:05.982817  5430 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:05.984243  5298 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:05.984635  5010 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:05.947067  5274 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:05.961730  5400 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:59:05.954206  5284 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:05.953670  5271 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.953994  5216 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.986908  5286 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:05.987474  1680 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:06.081525  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:05.988934  5012 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:05.991135  5411 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.419s	user 0.000s	sys 0.003s
I20260709 12:59:05.950217  5357 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:05.951227  5331 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:05.958608  5323 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:05.994064  1600 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 12. Ops: [10.10-10.10]
I20260709 12:59:05.950577  5436 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:05.950356  5403 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:05.996086  5394 consensus_meta.cc:287] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 12:59:05.964044  5234 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.117867  5234 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.118814  1609 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:59:06.119427  1609 pending_rounds.cc:85] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 6
I20260709 12:59:06.118522  5234 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.008292  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:06.063194  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 53386.5us
I20260709 12:59:06.121877  2476 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:06.009203  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:06.027549  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.125062  5011 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:05.953449  4842 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:06.127918  5394 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.115005  5449 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:59:06.130276  5394 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:06.132555  5396 raft_consensus.cc:3055] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:06.133490  5396 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:06.137878  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:06.140096  5323 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:06.143127  5401 log.cc:927] Time spent T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.643s	user 0.003s	sys 0.000s
I20260709 12:59:06.144573  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2140) took 1327 ms. Trace:
I20260709 12:59:06.144934  5345 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:06.134473  5396 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.146340  5396 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:06.144982  1681 rpcz_store.cc:276] 0709 12:59:04.824939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.832581 (+  7642us) service_pool.cc:224] Handling call
0709 12:59:04.841780 (+  9199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:04.842379 (+   599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:04.842423 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:04.877092 (+ 34669us) log.cc:844] Serialized 26 byte log entry
0709 12:59:05.216042 (+338950us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:05.216098 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.216187 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:06.142546 (+926359us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:06.144260 (+  1714us) raft_consensus.cc:1685] finished
0709 12:59:06.144287 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.144508 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6506,"raft.queue_time_us":105,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":34365,"spinlock_wait_cycles":23556864,"thread_start_us":310323,"threads_started":1,"wal-append.queue_time_us":535151}
I20260709 12:59:06.019273  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:06.070425  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 66695.7us
I20260709 12:59:06.029321  1602 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:05.975370  5346 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.158589  5346 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.159475  1602 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:59:06.159993  1602 pending_rounds.cc:85] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 8
I20260709 12:59:06.160311  1602 pending_rounds.cc:107] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:59:06.160588  1602 raft_consensus.cc:2889] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:06.161957  1600 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:06.162483  5234 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.164036  5174 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:06.169718  5251 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.170297  5251 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.172221  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:05.953094  5409 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:05.962522  5294 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:06.079912  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 134843us
I20260709 12:59:06.064211  5280 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:05.963240  5325 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.161345  5346 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.065608  5298 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.009907  5434 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:06.228334  5434 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.097216  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:06.104148  5271 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.106302  5331 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.092340  5216 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.107558  1608 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:06.092232  5357 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.109794  5403 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.111292  5404 raft_consensus.cc:3055] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:06.265916  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:06.077476  5398 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:06.087831  5284 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.114679  5274 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:06.119619  1609 pending_rounds.cc:107] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:59:06.280015  1609 raft_consensus.cc:2889] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:06.282578  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:06.155690  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:05.964497  5427 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:06.177693  1606 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:06.284066  2451 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:06.290594  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:06.291023  1500 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:06.192487  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:06.198557  1680 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:06.292704  1679 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 11: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:06.090481  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:06.189088  5251 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.189802  5169 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:06.206575  5325 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.205258  5280 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.211582  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:06.155145  5031 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.266644  5357 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:06.224296  1527 pending_rounds.cc:85] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 1
I20260709 12:59:06.304172  1527 pending_rounds.cc:107] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:06.304466  1527 raft_consensus.cc:2889] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:06.224695  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.304930  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:06.226679  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.269896  5404 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:06.251641  1530 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:06.253445  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:06.267175  1608 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 8: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:06.267383  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:06.269125  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.231021  5298 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:06.288733  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:06.296964  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.298609  1532 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:06.294128  1678 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:06.298862  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.293366  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:06.315039  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.315482  1680 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:59:06.222949  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:06.302847  1604 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:06.303416  1675 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:06.251392  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.319149  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:06.319595  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:06.304184  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:06.321537  1606 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:06.231683  5294 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:59:06.316418  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:06.319792  1530 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:06.323693  1606 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:06.310938  5169 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.323812  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:06.326260  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:06.333840  1679 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:06.300801  5331 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.298005  5398 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:06.265722  5312 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:59:06.306125  5346 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.300644  5280 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:06.326588  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:06.302610  5438 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.308015  5274 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.337651  1647 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:06.358387  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.302831  5304 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.341498  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:06.266088  5400 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:59:06.291904  5230 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:59:06.349062  1530 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:06.348977  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:06.318200  5409 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.334977  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.359853  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.360280  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:06.370314  1528 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:06.371614  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:06.372326  1528 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:06.373087  5418 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:06.362636  1678 raft_consensus.cc:2393] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:06.308260  5271 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.313865  5434 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:06.363919  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.359019  1533 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:06.376495  1530 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:06.367475  1674 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:06.373050  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.374131  5271 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:06.374527  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:06.366005  2344 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:06.377694  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.377993  1682 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:06.379134  5056 raft_consensus.cc:3055] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:06.382507  5216 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.383365  1675 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:59:06.383742  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.384126  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2344) took 1218 ms. Trace:
I20260709 12:59:06.384577  5448 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.386385  1680 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:06.385985  5398 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:06.386502  5284 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.343379  5234 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:59:06.388571  5031 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.326738  5295 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:06.471050  5436 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:06.390111  5450 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:06.389770  5404 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.349669  5331 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.488047  5059 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.489914  1674 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:06.385051  5409 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.491209  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:06.491961  2428 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:06.362951  5438 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.489396  5059 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:06.496212  5438 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.363091  5346 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:06.499022  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2083) took 1319 ms. Trace:
I20260709 12:59:06.499487  1600 rpcz_store.cc:276] 0709 12:59:05.179215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.103367 (+924152us) service_pool.cc:224] Handling call
0709 12:59:06.103867 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:06.162306 (+ 58439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.498785 (+336479us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b5400406ad4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:06.498966 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132855552}
I20260709 12:59:06.500284  5346 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:06.501127  1606 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:06.369544  5304 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:06.456382  5301 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:06.514812  5304 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:06.436694  5325 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.521071  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 748) took 1334 ms. Trace:
I20260709 12:59:06.521420  5403 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:06.471218  5448 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:06.524422  5443 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.534s	user 0.000s	sys 0.003s
I20260709 12:59:06.454077  5327 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:06.526965  5327 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:06.527926  5327 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.528929  5327 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:06.452222  5444 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.457s	user 0.003s	sys 0.000s
I20260709 12:59:06.529487  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.537097  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.368707  5400 consensus_queue.cc:1243] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:06.550526  5012 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:06.550944  2428 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:59:06.370198  5274 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.347760  5430 consensus_queue.cc:1059] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:59:06.368227  5268 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:06.462011  1675 pending_rounds.cc:85] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 7
I20260709 12:59:06.554360  5268 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.462070  1603 rpcz_store.cc:276] 0709 12:59:05.165618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.937660 (+772042us) service_pool.cc:224] Handling call
0709 12:59:05.947001 (+  9341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:06.125531 (+178530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:06.125563 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:06.125640 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:06.125674 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.383908 (+258234us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54002684d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:06.383953 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.384061 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410052992}
I20260709 12:59:06.554905  5268 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:06.554788  1675 pending_rounds.cc:107] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 12:59:06.556202  5439 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.561s	user 0.002s	sys 0.002s
I20260709 12:59:06.462801  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:06.557035  5169 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.557582  5169 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.557761  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.560115  5169 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:06.568526  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.569829  1531 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:06.572650  5169 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.573196  5169 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.576144  5169 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.550529  5404 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:06.445325  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:06.579502  1608 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:06.576175  1534 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:59:06.579721  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.358187  5294 consensus_queue.cc:1243] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:06.473002  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:06.585862  1534 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:59:06.587044  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 44958.2us
I20260709 12:59:06.587307  1682 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:06.444185  1530 raft_consensus.cc:1240] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:06.478614  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.428087  5056 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:06.430444  5230 consensus_queue.cc:1059] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:59:06.458127  5445 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.521618  2435 rpcz_store.cc:276] 0709 12:59:05.187104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.187259 (+   155us) service_pool.cc:224] Handling call
0709 12:59:05.217338 (+ 30079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.460786 (+243448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.520815 (+1060029us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54007256d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:06.521010 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516117376}
I20260709 12:59:06.526589  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2343) took 1361 ms. Trace:
I20260709 12:59:06.399991  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:06.421496  1532 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:06.532675  1602 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:06.466552  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 100621us
I20260709 12:59:06.609573  1601 rpcz_store.cc:276] 0709 12:59:05.165279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.903324 (+738045us) service_pool.cc:224] Handling call
0709 12:59:05.903613 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.903841 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.903865 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:05.904277 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:59:05.935030 (+ 30753us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:05.935071 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.935643 (+   572us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:06.523699 (+588056us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:06.526261 (+  2562us) raft_consensus.cc:1685] finished
0709 12:59:06.526285 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.526518 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48253312,"thread_start_us":30357,"threads_started":1,"wal-append.queue_time_us":85458}
W20260709 12:59:06.598560  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 125646us
I20260709 12:59:06.614276  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.542992  5271 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:06.546716  5031 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.547510  2475 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:06.556074  1675 raft_consensus.cc:2889] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:06.465061  1526 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
W20260709 12:59:06.584620  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48198.4us
I20260709 12:59:06.623745  2344 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:06.624948  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:06.628865  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.629093  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:06.603967  1531 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:59:06.554705  5274 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.607462  5010 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.616505  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:06.633484  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.618357  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.629889  1601 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:06.643133  2344 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:06.645500  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:06.603538  5286 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:06.639493  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:06.636183  5251 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:06.658103  1603 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:06.597533  5315 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:59:06.597743  5288 consensus_queue.cc:1059] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:59:06.646802  5417 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:06.686897  1603 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:06.645433  5403 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:06.619159  5445 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:06.652896  5434 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:06.709077  1603 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:06.696131  2435 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:06.657622  5450 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:06.658887  5465 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:59:06.636862  5031 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.641651  5010 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.711866  1531 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:06.645290  5230 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:59:06.729590  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 56602.3us
I20260709 12:59:06.735826  5445 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:06.693895  5403 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:06.743459  1608 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:06.693197  5418 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:59:06.726325  5434 raft_consensus.cc:697] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:06.693539  5357 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:06.759593  5396 consensus_meta.cc:287] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.004s
W20260709 12:59:06.764261  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 57057.6us
I20260709 12:59:06.712998  5394 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:59:06.743520  5403 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:06.759485  5445 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.766753  5274 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.799240  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.765862  4932 consensus_queue.cc:1059] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:59:06.806111  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.808320  5010 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.799587  5445 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.793480  5230 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:59:06.850486  5031 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.792981  5233 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:59:06.853225  5434 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.804598  5417 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:06.855458  5448 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:06.857393  4842 raft_consensus.cc:3055] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:06.857497  5445 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:06.857892  4842 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:06.856271  5417 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:06.860179  5298 consensus_meta.cc:287] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.005s
I20260709 12:59:06.850476  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:06.860669  5298 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:06.862498  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:06.864214  5031 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:06.864985  5031 consensus_queue.cc:1059] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:06.866369  5398 raft_consensus.cc:3055] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:06.866767  5398 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:06.867627  5398 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.868700  5398 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:06.874061  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.874902  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 87435.1us
W20260709 12:59:06.876235  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 72745.5us
I20260709 12:59:06.809931  5274 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.855471  5357 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:06.868986  5268 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:06.891811  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:06.873956  5427 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:06.869750  5239 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:06.896947  1533 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:06.946355  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 54650.3us
I20260709 12:59:06.947201  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:59:06.956729  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 79875us
W20260709 12:59:06.960142  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.960886  5409 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:06.966068  5414 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 1.202s	user 0.003s	sys 0.001s
I20260709 12:59:06.969974  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.970309  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.970947  1529 raft_consensus.cc:2410] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:06.971861  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.972142  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.972621  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.972934  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.973315  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.973775  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.974503  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.974694  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.975668  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.976554  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.976807  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:06.940662  5448 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:06.969995  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:06.980247  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.981736  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.983959  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:06.985117  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.986485  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:06.945750  5455 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:06.990614  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:06.991211  2435 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:06.864996  5280 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:06.998401  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:06.945840  5427 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:06.949440  5286 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:06.952219  5031 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:07.022344  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 44018.7us
I20260709 12:59:07.031307  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:07.031759  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:06.991869  5295 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:59:06.987190  5271 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.035337  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:07.036470  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 47132.3us
I20260709 12:59:07.034004  1498 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:07.001279  5409 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:07.031055  5031 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:07.040798  5445 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:06.994184  5357 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:59:07.040628  5059 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:07.059983  5432 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:07.021107  5174 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:07.074149  5298 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:07.074455  5268 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:07.050761  5274 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:07.059248  5031 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:07.063163  5059 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.085124  5481 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:07.097784  5481 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:07.098520  5481 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:07.090675  5280 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:07.103840  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.105773  4842 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:07.107281  4842 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.111933  5294 raft_consensus.cc:3055] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:07.112545  5294 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:07.119745  5056 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:07.096068  5464 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.359s	user 0.003s	sys 0.000s
I20260709 12:59:06.991475  5448 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:07.133318  5294 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:07.186116  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 55531.5us
I20260709 12:59:07.187132  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:07.044526  5271 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:07.190747  5271 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:07.126514  5282 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:07.192946  5282 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:07.196110  5282 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:07.196924  5282 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.200670  5448 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:07.207304  5448 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:07.207554  5440 log.cc:927] Time spent T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 1.221s	user 0.004s	sys 0.003s
W20260709 12:59:07.208168  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 153937us
I20260709 12:59:07.064193  5409 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:07.218997  5331 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:07.231117  2339 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:07.065156  5432 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:07.126621  5059 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:07.245990  5282 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:07.286883  5432 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:07.326797  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.704064  1647 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:07.185583  5056 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:07.362118  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.226614  5481 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:07.518723  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 483438us
I20260709 12:59:07.728770  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 942) took 1539 ms. Trace:
I20260709 12:59:07.732288  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:07.599628  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.002s	sys 0.007s
W20260709 12:59:07.733474  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.002s	sys 0.007s
I20260709 12:59:07.732031  2474 rpcz_store.cc:276] 0709 12:59:06.189488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.190491 (+  1003us) service_pool.cc:224] Handling call
0709 12:59:06.191124 (+   633us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:06.191679 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:06.191724 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:06.519322 (+327598us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b2c00012a88. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d0291a11 00007f25d02a1372 00007f25d19d3a01 00007f25d199843a 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2
0709 12:59:06.519937 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 12:59:06.642263 (+122326us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:06.642301 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.642370 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:07.095327 (+452957us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:07.728427 (+633100us) raft_consensus.cc:1685] finished
0709 12:59:07.728457 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:07.728650 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":405,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11479,"spinlock_wait_cycles":9791104,"thread_start_us":121936,"threads_started":1,"wal-append.queue_time_us":192956}
W20260709 12:59:07.600333  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.002s	sys 0.007s
W20260709 12:59:07.604188  5239 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.005s	sys 0.005s
I20260709 12:59:07.700881  5394 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:07.703689  5400 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:07.704105  5331 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.703931  5271 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:07.065681  5427 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:07.704741  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 517695us
W20260709 12:59:07.706305  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 475293us
I20260709 12:59:07.706841  5450 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:07.597162  5430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.027s	sys 0.009s
W20260709 12:59:07.711297  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 478332us
W20260709 12:59:07.597666  5233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.014s	sys 0.046s
I20260709 12:59:07.714745  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:07.716398  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:07.598510  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.012s	sys 0.047s
W20260709 12:59:07.793852  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.014s	sys 0.050s
I20260709 12:59:07.719718  1609 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:59:07.744275  5239 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.006s	sys 0.006s
I20260709 12:59:07.722851  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:07.600267  5471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.001s	sys 0.009s
I20260709 12:59:07.744603  1602 raft_consensus.cc:1217] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-10.9]   Dedup: 5.7->[8.8-10.9]
I20260709 12:59:07.751343  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:07.812376  1602 pending_rounds.cc:85] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 7
I20260709 12:59:07.812621  1602 pending_rounds.cc:107] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:59:07.812862  1602 raft_consensus.cc:2889] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:07.812892  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:07.768456  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:07.721130  5244 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.795290  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:07.820034  1609 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:07.701880  5286 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:07.802350  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:07.751750  5400 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:07.799593  1607 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:59:07.813697  1603 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:07.792927  5233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.014s	sys 0.050s
W20260709 12:59:07.795425  5430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.027s	sys 0.012s
W20260709 12:59:07.811877  5471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.001s	sys 0.009s
I20260709 12:59:07.780859  5331 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:07.723021  5448 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:07.730268  5403 consensus_meta.cc:287] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.937s	user 0.013s	sys 0.003s
I20260709 12:59:07.831836  5286 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:07.793473  5484 log.cc:927] Time spent T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:59:07.885207  1609 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:07.794668  5450 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:07.866842  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 162813us
I20260709 12:59:07.819928  5498 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:07.838842  5400 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:07.882408  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:07.967330  1605 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 7: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:07.861500  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 93155.5us
W20260709 12:59:07.954730  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 197244us
I20260709 12:59:07.833487  5244 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:07.882682  5417 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:08.126084  5505 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.126785  5244 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.126935  5505 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.128512  5244 consensus_queue.cc:1059] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:08.129904  5286 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.130851  5286 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.131402  5286 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.133596  5387 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:08.133785  5271 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:08.134259  5387 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:08.134608  5271 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.135439  5387 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:08.092959  4842 consensus_meta.cc:287] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.985s	user 0.007s	sys 0.007s
I20260709 12:59:08.144630  5244 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.145277  5244 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.147945  5480 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:07.895124  5403 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.094502  5251 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.975353  5498 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.208366  5239 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:08.096591  5510 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
I20260709 12:59:08.188889  5251 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.111907  5417 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.208051  5387 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:08.210471  5502 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:08.240543  5398 consensus_meta.cc:287] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.371s	user 0.008s	sys 0.013s
W20260709 12:59:08.262334  5409 consensus_meta.cc:287] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.002s	user 0.007s	sys 0.009s
I20260709 12:59:08.265883  5286 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.246850  5282 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.284197  5516 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:08.286106  5504 raft_consensus.cc:3055] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:08.286592  5504 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:08.286475  5506 consensus_queue.cc:1059] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:08.285199  5516 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.271689  5481 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:08.281620  5496 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 12:59:08.300635  5516 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.290350  5505 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:08.289075  5409 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:08.281806  5502 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:08.283010  5487 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.457s	user 0.000s	sys 0.002s
W20260709 12:59:08.339699  5486 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.619s	user 0.003s	sys 0.000s
W20260709 12:59:08.345206  5499 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:59:08.312949  5505 raft_consensus.cc:3055] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:08.288000  5504 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.289683  5507 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.354195  5505 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:59:08.356859  5512 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.077s	user 0.000s	sys 0.003s
I20260709 12:59:08.356359  5504 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.354741  5501 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.357967  5450 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.360357  5448 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:08.373440  5505 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.361625  5507 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.380474  5516 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:08.381503  5507 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.383615  5498 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.385480  5502 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:08.371176  5501 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.388926  5501 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:07.734057  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 700069us
W20260709 12:59:08.425452  1531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.004s	sys 0.004s
W20260709 12:59:08.426157  1531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.004s	sys 0.005s
I20260709 12:59:08.425839  1525 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
W20260709 12:59:07.735129  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.002s	sys 0.008s
I20260709 12:59:08.428232  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 777) took 1324 ms. Trace:
W20260709 12:59:08.432682  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.007s	sys 0.001s
W20260709 12:59:08.433338  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.007s	sys 0.001s
I20260709 12:59:08.434615  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 649) took 1303 ms. Trace:
W20260709 12:59:08.435205  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 442933us
I20260709 12:59:08.438930  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 648) took 1324 ms. Trace:
W20260709 12:59:08.440527  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.010s	sys 0.010s
W20260709 12:59:08.440970  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.010s	sys 0.010s
I20260709 12:59:08.439459  1608 rpcz_store.cc:276] 0709 12:59:07.114465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.114702 (+   237us) service_pool.cc:224] Handling call
0709 12:59:07.115183 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:07.115698 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:07.115743 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:07.116545 (+   802us) log.cc:844] Serialized 52 byte log entry
0709 12:59:07.610788 (+494243us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:07.610880 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:07.611083 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:08.438219 (+827136us) raft_consensus.cc:1685] finished
0709 12:59:08.438275 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:08.438672 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2495,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":493494,"threads_started":1,"wal-append.queue_time_us":701890}
W20260709 12:59:08.443224  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.435235  1601 rpcz_store.cc:276] 0709 12:59:07.131068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.131438 (+   370us) service_pool.cc:224] Handling call
0709 12:59:07.131845 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:07.182016 (+ 50171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:07.182047 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:07.182537 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:59:07.517076 (+334539us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:07.517128 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:07.517216 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:08.433837 (+916621us) raft_consensus.cc:1685] finished
0709 12:59:08.433890 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:08.434297 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2988,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":19638,"thread_start_us":334162,"threads_started":1,"wal-append.queue_time_us":1101749}
I20260709 12:59:08.421110  1421 maintenance_manager.cc:419] P d61986b01a0f484cbe47a3797e9dc27f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033419
W20260709 12:59:08.450062  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.429005  1531 rpcz_store.cc:276] 0709 12:59:07.103867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.226100 (+122233us) service_pool.cc:224] Handling call
0709 12:59:07.226531 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:07.226994 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:07.227037 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:07.263113 (+ 36076us) log.cc:844] Serialized 52 byte log entry
0709 12:59:08.427146 (+1164033us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:08.427322 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:08.427512 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:08.427605 (+    93us) raft_consensus.cc:1685] finished
0709 12:59:08.427626 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:08.428033 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80927,"raft.queue_time_us":16209,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5808,"thread_start_us":633795,"threads_started":1,"wal-append.queue_time_us":453754}
I20260709 12:59:08.245373  5239 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.471266  5239 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:08.235517  5271 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:08.524739  2344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.000s	sys 0.023s
W20260709 12:59:08.545027  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.007s
W20260709 12:59:08.579655  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 153055us
W20260709 12:59:08.530875  2344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.000s	sys 0.024s
W20260709 12:59:08.592355  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.000s	sys 0.012s
I20260709 12:59:08.592898  4842 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.543963  5059 consensus_meta.cc:287] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.919s	user 0.013s	sys 0.001s
W20260709 12:59:08.588968  1602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.003s	sys 0.008s
W20260709 12:59:08.573133  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 791184us
W20260709 12:59:08.544865  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.020s	sys 0.011s
W20260709 12:59:08.604588  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.024s	sys 0.013s
W20260709 12:59:08.604645  1602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.004s	sys 0.009s
W20260709 12:59:08.609666  5233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.002s	sys 0.014s
W20260709 12:59:08.610364  5233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.002s	sys 0.015s
I20260709 12:59:08.609364  4842 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.613476  5282 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.618803  5494 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:08.531473  5516 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.544651  5502 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.619174  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:08.615062  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.000s	sys 0.007s
W20260709 12:59:08.609453  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.002s	sys 0.009s
I20260709 12:59:08.592682  5403 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.581326  5511 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:08.626854  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.002s	sys 0.010s
I20260709 12:59:08.626408  5450 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.628365  5503 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.629081  5450 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.629244  5503 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.629688  5417 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:08.625051  5031 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.523s	user 0.018s	sys 0.006s
I20260709 12:59:08.631165  5031 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.631742  5503 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.632642  5511 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.634018  1606 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:08.635746  5511 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:08.639163  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 743735us
I20260709 12:59:08.628165  5331 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:08.644629  1575 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.515s (SENT) [suppressed 19 similar messages]
I20260709 12:59:08.646039  5525 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.647169  5525 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:08.627295  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.000s	sys 0.008s
I20260709 12:59:08.649871  5524 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.650753  5524 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:08.651129  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 918838us
I20260709 12:59:08.544499  5508 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.566295  5509 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.544277  5507 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:08.620735  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 627577us
I20260709 12:59:08.531337  5286 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.566401  5504 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 12:59:08.663717  5504 consensus_queue.cc:1243] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:08.621661  5494 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.665038  5031 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.666378  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:08.666664  5494 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.614466  5282 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.666989  1498 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:08.673890  5524 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:08.675226  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.675729  5511 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.676395  5502 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:08.677783  5488 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
I20260709 12:59:08.677491  5516 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.678516  5395 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:08.679738  5514 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 12:59:08.681334  5294 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:08.682427  5394 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.931s	user 0.004s	sys 0.011s
I20260709 12:59:08.631778  5450 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:08.685611  5523 log.cc:927] Time spent T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 12:59:08.688961  5481 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.689734  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.620442  4842 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.546260  5244 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:08.691258  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 49872.5us
I20260709 12:59:08.714947  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 2060) took 1746 ms. Trace:
I20260709 12:59:08.715565  5502 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:08.716089  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.005s	sys 0.018s
I20260709 12:59:08.716329  5516 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:08.717684  5059 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.721431  5395 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.715602  5508 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:08.722898  1603 consensus_meta.cc:287] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.889s	user 0.020s	sys 0.000s
W20260709 12:59:08.722996  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56161us
W20260709 12:59:08.723258  5432 consensus_meta.cc:287] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.973s	user 0.013s	sys 0.005s
I20260709 12:59:08.723737  5357 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.705328  5494 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:08.759990  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 115542us
I20260709 12:59:08.716619  5286 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.702979  5507 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:08.753532  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.006s	sys 0.022s
I20260709 12:59:08.754786  5529 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:08.764150  1609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.007s	sys 0.019s
I20260709 12:59:08.766855  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2105) took 1047 ms. Trace:
I20260709 12:59:08.770267  1600 rpcz_store.cc:276] 0709 12:59:07.714647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.714761 (+   114us) service_pool.cc:224] Handling call
0709 12:59:07.715062 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:07.715388 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:07.715415 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:07.723700 (+  8285us) log.cc:844] Serialized 26 byte log entry
0709 12:59:08.434296 (+710596us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:08.434420 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:08.434574 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:08.678649 (+244075us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:08.724262 (+ 45613us) raft_consensus.cc:1685] finished
0709 12:59:08.724285 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:08.762294 (+ 38009us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":415245,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"spinlock_wait_cycles":24190720,"thread_start_us":652306,"threads_started":1,"wal-append.queue_time_us":559315}
W20260709 12:59:08.773991  1609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.007s	sys 0.020s
I20260709 12:59:08.730929  5511 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.732887  5331 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:08.776502  5227 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.776927  5357 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.778524  5494 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:08.808130  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 2066) took 1837 ms (client timeout 2134 ms). Trace:
I20260709 12:59:08.808611  5494 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.809288  5524 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:08.809834  5271 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.810395  5288 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:08.780369  1572 connection.cc:256] RPC call timeout handler was delayed by -1.0207100449999871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 12:59:08.810717  5271 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.765437  1603 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:08.759948  4842 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:08.782531  1680 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:08.747095  5394 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:08.730783  1534 rpcz_store.cc:276] 0709 12:59:06.968635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.973727 (+  5092us) service_pool.cc:224] Handling call
0709 12:59:06.974024 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:06.982557 (+  8533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:06.982594 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:06.988933 (+  6339us) log.cc:844] Serialized 26 byte log entry
0709 12:59:07.794336 (+805403us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:07.794373 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:07.794431 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:08.676786 (+882355us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:08.714230 (+ 37444us) raft_consensus.cc:1685] finished
0709 12:59:08.714252 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:08.714633 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8698,"raft.queue_time_us":19687,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":29143,"spinlock_wait_cycles":18867968,"thread_start_us":773529,"threads_started":1,"wal-append.queue_time_us":1299367}
W20260709 12:59:08.791566  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.797761  5526 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.801047  5400 consensus_meta.cc:287] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.005s
I20260709 12:59:08.802032  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:08.801743  5481 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.802912  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:08.803027  5508 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.803120  5395 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:08.769215  5432 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.804365  5244 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:08.805871  5517 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.809713  5506 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:08.732761  5450 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:08.810644  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:08.819953  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 153835us
I20260709 12:59:08.805470  5331 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.820330  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:08.821462  1679 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:08.821367  5357 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:08.808643  1525 rpcz_store.cc:269] 0709 12:59:06.970444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.973517 (+  3073us) service_pool.cc:224] Handling call
0709 12:59:08.807826 (+1834309us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003ae154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:08.807996 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3336624512}
I20260709 12:59:08.822060  5503 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:08.825793  5227 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.827824  5312 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.828475  5403 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.828999  5504 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.829972  5239 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.809803  5529 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.846040  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 653) took 1133 ms. Trace:
W20260709 12:59:08.874454  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 89486.9us
I20260709 12:59:08.811535  5511 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:59:08.854821  5432 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.855268  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2110) took 1128 ms. Trace:
I20260709 12:59:08.854001  1608 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:08.857026  4842 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.858615  5271 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:08.858887  1675 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:08.774825  5509 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.860140  5498 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.810014  5524 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.878369  5403 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.882937  1603 rpcz_store.cc:276] 0709 12:59:07.717434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.812596 (+ 95162us) service_pool.cc:224] Handling call
0709 12:59:08.842015 (+1029419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:08.880534  1601 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:08.845983  5400 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.971715  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:08.969535  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 81509.7us
W20260709 12:59:08.929172  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 54168.3us
W20260709 12:59:08.975247  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.874359  1602 rpcz_store.cc:276] 0709 12:59:07.712426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.712532 (+   106us) service_pool.cc:224] Handling call
0709 12:59:07.712855 (+   323us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:08.637803 (+924948us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:08.696939 (+ 59136us) log.cc:844] Serialized 14 byte log entry
0709 12:59:08.749615 (+ 52676us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:08.812073 (+ 62458us) log.cc:844] Serialized 52 byte log entry
0709 12:59:08.812236 (+   163us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:08.812275 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:08.825000 (+ 12725us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:08.830165 (+  5165us) raft_consensus.cc:1685] finished
0709 12:59:08.830185 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:08.845976 (+ 15791us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34833,"prepare.queue_time_us":107529,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":493402,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":39225,"spinlock_wait_cycles":2529152,"thread_start_us":880097,"threads_started":3,"wal-append.queue_time_us":77670}
I20260709 12:59:08.973449  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:08.980854  5521 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.981051  1675 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:08.982071  5527 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.981738  5521 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.982583  5527 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.983637  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:08.984405  1607 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:08.984778  5521 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.987460  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:08.988112  1605 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
W20260709 12:59:08.988358  5056 consensus_meta.cc:287] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.257s	user 0.008s	sys 0.010s
I20260709 12:59:08.989353  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:08.989668  2474 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:08.990694  5312 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:08.978245  5534 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:08.996449  5537 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.997185  5282 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.997255  5537 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.998056  5282 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.998720  5282 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.999184  5538 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:08.999958  5538 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.975268  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:08.979625  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 88505.5us
W20260709 12:59:09.007576  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 119495us
I20260709 12:59:08.881703  5504 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:08.886704  5450 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.007136  5294 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:09.019320  5294 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:09.022131  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.022250  5059 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:08.892824  5526 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.023741  1678 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:09.024586  5227 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.024786  5526 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:09.027138  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 170335us
I20260709 12:59:08.919811  5503 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.051651  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:08.985378  5398 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.055344  1602 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:09.060858  1608 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:09.061802  5507 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.063244  5400 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.063441  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.064533  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.100522  4842 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:09.102469  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.105055  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.106233  1601 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
W20260709 12:59:09.104562  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 76552.4us
I20260709 12:59:08.892418  5517 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.925706  5498 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:08.985321  5528 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:09.110997  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:09.111707  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 54326.7us
I20260709 12:59:08.985330  5501 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:09.115065  1525 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:09.061437  5436 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:09.118829  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 65242.8us
I20260709 12:59:09.008548  5525 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.099925  5230 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.104494  5239 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.116715  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:08.978534  5331 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.115870  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.060032  5294 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:08.974745  5506 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.123569  1529 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.139328  5504 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.139451  5506 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.139746  5503 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.140115  1677 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
W20260709 12:59:09.141088  5251 consensus_meta.cc:287] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.864s	user 0.010s	sys 0.002s
I20260709 12:59:09.141619  5251 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.143679  1533 raft_consensus.cc:2393] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:09.144184  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 651) took 1962 ms. Trace:
I20260709 12:59:09.123448  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.144562  1606 rpcz_store.cc:276] 0709 12:59:07.182138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.182270 (+   132us) service_pool.cc:224] Handling call
0709 12:59:07.182601 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:08.634646 (+1452045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.143924 (+509278us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003403d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:09.144128 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3336875392}
I20260709 12:59:09.123634  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.124507  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.125149  1534 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:09.108458  5312 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:09.132472  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.152387  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.132728  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.147047  1680 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:09.153038  1601 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:09.164729  5537 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.166579  2421 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:09.166517  5230 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.168625  5527 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.169775  1674 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:09.160249  5294 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:09.174044  5294 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.176429  5294 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.177361  5527 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:09.178254  1649 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:09.178092  5527 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.180354  5282 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.180716  5527 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.181742  5526 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:09.182390  5286 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.183003  5286 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:09.183095  5527 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:09.183511  5524 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.183910  5527 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:09.184996  5427 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:09.133803  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.181406  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:09.122053  5507 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:09.156080  5525 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:09.183924  5286 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:09.209537  1427 catalog_manager.cc:5697] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 4 to 7, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:09.236613  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.237640  2476 raft_consensus.cc:2410] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:09.238034  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.238873  2435 raft_consensus.cc:2410] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:09.238780  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:09.239948  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.241022  5481 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.169427  5230 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.225733  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.224294  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.253512  1649 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:09.202227  5538 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.257009  1680 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:09.237370  5505 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:09.257817  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.259009  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.264057  1603 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:59:09.122382  5436 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:09.221243  5522 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.831s	user 0.001s	sys 0.002s
I20260709 12:59:09.212057  5331 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.224009  5286 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.262548  1606 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:09.147446  5501 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:09.267124  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 101230us
I20260709 12:59:09.230530  5509 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:09.252478  5515 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.871s	user 0.002s	sys 0.000s
I20260709 12:59:09.269443  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:09.291010  5542 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:59:09.291160  5498 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.252259  5432 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:09.292724  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.292683  5432 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:09.293767  1606 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:09.293840  5450 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.195803  5398 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.294656  5517 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.295378  5432 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.296548  5398 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.299913  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 654) took 1542 ms. Trace:
I20260709 12:59:09.206868  5239 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:09.313992  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.307653  1531 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:09.314805  1602 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:09.309154  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.315680  1601 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:09.315986  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.220640  5528 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.316608  1602 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
W20260709 12:59:09.313373  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 109468us
I20260709 12:59:09.318830  5528 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.310079  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.302547  1609 rpcz_store.cc:276] 0709 12:59:07.757176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.886820 (+129644us) service_pool.cc:224] Handling call
0709 12:59:07.887275 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:08.843646 (+956371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:08.848475 (+  4829us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:08.891616 (+ 43141us) log.cc:844] Serialized 26 byte log entry
0709 12:59:09.018213 (+126597us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:09.018254 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.018382 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:09.299708 (+281326us) raft_consensus.cc:1685] finished
0709 12:59:09.299725 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:09.299855 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":447902,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"thread_start_us":933906,"threads_started":2,"wal-append.queue_time_us":93946}
I20260709 12:59:09.311096  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.320619  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.316609  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.326030  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.326479  1678 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:09.326679  1680 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:09.326886  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:09.320644  1605 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:09.327630  1609 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:09.261955  5357 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.268062  5059 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:09.346462  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:09.302032  5251 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.346827  1601 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:09.255573  5507 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.354948  1602 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
W20260709 12:59:09.361095  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.346424  5527 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.367504  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:09.375108  5501 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.338457  5357 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:09.369756  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:09.378767  1602 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:09.361502  5059 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.392968  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:09.406945  5403 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.407686  5519 consensus_queue.cc:1059] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:09.409078  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:09.413151  1603 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:09.413859  1600 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:09.417475  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.418277  1525 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:59:09.419255  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.421900  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.394968  5506 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.433459  1604 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.430225  2344 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:09.435346  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.439287  1600 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:09.442445  1603 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:09.455555  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:09.460537  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.463006  5529 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.445627  5403 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:59:09.478300  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 62329.1us
I20260709 12:59:09.427066  5059 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.484540  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.484681  5528 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:59:09.490432  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.491722  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.491875  5294 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:09.492403  1678 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:59:09.504056  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:09.507169  1603 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:09.513001  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:09.539219  5436 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.552850  5507 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.564092  1681 raft_consensus.cc:1240] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.579461  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.580248  1681 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:09.569969  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:09.585615  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 129738us
I20260709 12:59:09.586431  2339 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:09.566069  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.594790  5312 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:09.595432  5312 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.595938  5312 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:09.596094  5520 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.596746  5520 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.598839  2475 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:09.600667  5230 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:09.601996  5357 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.603634  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:09.481451  5506 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:09.643618  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:09.651835  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 192315us
I20260709 12:59:09.654767  1602 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:09.655478  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.655308  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.681290  1531 raft_consensus.cc:2410] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:09.682762  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.573661  5403 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:09.700415  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.700896  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.582222  5528 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:09.701928  5528 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.702793  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:09.710765  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 107237us
I20260709 12:59:09.712181  2339 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:09.710330  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.703011  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.718760  2461 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:09.723728  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.727826  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.739713  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.567198  5492 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.254s
I20260709 12:59:09.744706  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:09.744971  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.746084  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.747004  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.748360  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:09.750401  1427 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.702687  5520 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:09.755597  5427 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:09.755904  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.756927  1675 raft_consensus.cc:2410] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:59:09.758921  2474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 774) took 1991 ms (client timeout 1887 ms). Trace:
W20260709 12:59:09.759677  5550 log.cc:927] Time spent T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:59:09.759436  2474 rpcz_store.cc:269] 0709 12:59:07.767772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.768125 (+   353us) service_pool.cc:224] Handling call
0709 12:59:09.758700 (+1990575us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400551754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:09.758837 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2423153536}
I20260709 12:59:09.745396  1676 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:09.762530  5548 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:59:09.762869  5509 raft_consensus.cc:3055] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:09.763299  5509 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:09.764189  5509 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.767112  5506 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.704017  5403 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.767992  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.756130  5427 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:09.765302  5509 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:09.782096  1682 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:09.783353  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:09.784571  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.785233  1682 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:09.785916  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.785801  1427 catalog_manager.cc:5697] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 2 to 6, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.787609  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.788275  1674 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:09.787667  1427 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.788679  1676 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:09.789131  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:09.789706  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.790053  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.790360  1683 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:59:09.790788  1676 raft_consensus.cc:2410] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:59:09.791220  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.791569  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.792410  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:09.792551  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:09.793974  1676 raft_consensus.cc:2410] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:59:09.794796  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 55363.3us
I20260709 12:59:09.798460  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:09.802740  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.812644  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.813125  5059 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:09.813608  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:09.813902  5528 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:09.814177  1676 raft_consensus.cc:2376] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12. Re-sending same reply.
I20260709 12:59:09.814767  5528 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.815623  5528 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:09.826694  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:09.829205  1683 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:09.744781  5436 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:09.828709  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:09.812744  1429 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40874 (request call id 353) took 22417 ms (client timeout 15000 ms). Trace:
I20260709 12:59:09.771528  5403 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:09.773993  5427 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:09.844097  1603 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:09.845893  1675 raft_consensus.cc:2410] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:09.859668  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 773) took 2892 ms. Trace:
I20260709 12:59:09.860131  2475 rpcz_store.cc:276] 0709 12:59:06.967259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.969163 (+  1904us) service_pool.cc:224] Handling call
0709 12:59:06.969487 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:09.599317 (+2629830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.859386 (+260069us) spinlock_profiling.cc:243] Waited 2.63 s on lock 0x7b54005f6254. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:09.859566 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6045358464}
I20260709 12:59:09.861598  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.863260  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.864979  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.839509  5436 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:09.866375  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.867470  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.865993  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.867079  5436 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:09.813156  1427 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 6 to 10, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.865641  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.872424  1427 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.867801  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:09.875524  1531 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:09.891902  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:09.896878  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.898116  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.898931  2461 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:09.901850  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:09.902559  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:09.780927  5312 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:09.922583  1609 consensus_meta.cc:287] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.594s	user 0.004s	sys 0.008s
I20260709 12:59:09.922686  1533 raft_consensus.cc:1240] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:09.922783  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 55143us
W20260709 12:59:09.979916  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 267783us
I20260709 12:59:10.108022  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:09.840447  1429 rpcz_store.cc:269] 0709 12:58:47.395302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.396098 (+   796us) service_pool.cc:224] Handling call
0709 12:58:47.494614 (+ 98516us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b540012eb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1902090 00007f25d19a0f3a 00007f25d77571cc 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc 00007f25d5d15392 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:09.812489 (+22317875us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:58.566892 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:58.625185 (+ 58293us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:58.625259 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:58:58.625317 (+    58us) tablet.cc:662] Decoding operations
0709 12:58:58.627649 (+  2332us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:58.627751 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:58.627803 (+    52us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:58:58.799501 (+171698us) tablet.cc:701] Row locks acquired
0709 12:58:58.818203 (+ 18702us) write_op.cc:260] PREPARE: finished
0709 12:58:58.861759 (+ 43556us) write_op.cc:270] Start()
0709 12:58:58.897969 (+ 36210us) write_op.cc:276] Timestamp: P: 1783601938839149 usec, L: 0
0709 12:58:58.901072 (+  3103us) op_driver.cc:348] REPLICATION: starting
0709 12:58:58.943723 (+ 42651us) log.cc:844] Serialized 7481 byte log entry
0709 12:58:59.310529 (+366806us) op_driver.cc:464] REPLICATION: finished
0709 12:58:59.526104 (+215575us) write_op.cc:301] APPLY: starting
0709 12:58:59.544420 (+ 18316us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:59.591148 (+ 46728us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:59.591430 (+   282us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:59.630933 (+ 39503us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:59.634368 (+  3435us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:58:59.634422 (+    54us) write_op.cc:312] APPLY: finished
0709 12:58:59.634957 (+   535us) log.cc:844] Serialized 132 byte log entry
0709 12:58:59.635375 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:59.635583 (+   208us) write_op.cc:454] Released schema lock
0709 12:58:59.635675 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:59.636130 (+   455us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:59.636159 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12162,"reported_tablets":46,"spinlock_wait_cycles":8459520,"child_traces":[["op",{"apply.queue_time_us":166418,"apply.run_cpu_time_us":7548,"apply.run_wall_time_us":145662,"num_ops":19,"prepare.queue_time_us":256048,"prepare.run_cpu_time_us":13719,"prepare.run_wall_time_us":762455,"raft.queue_time_us":52052,"raft.run_cpu_time_us":10354,"raft.run_wall_time_us":82265,"replication_time_us":409265,"thread_start_us":546075,"threads_started":4,"wal-append.queue_time_us":311138,"wal-append.run_cpu_time_us":4720,"wal-append.run_wall_time_us":1385146}]]}
I20260709 12:59:09.972580  2344 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:09.928853  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:10.110548  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 138086us
I20260709 12:59:09.972029  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.098434  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.106485  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.109270  1609 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:09.928747  1427 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 5 to 6, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.114655  1527 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:10.127405  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45362 (request call id 854) took 1310 ms. Trace:
I20260709 12:59:10.132776  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:10.127946  1677 rpcz_store.cc:276] 0709 12:59:08.805319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.819928 (+ 14609us) service_pool.cc:224] Handling call
0709 12:59:10.115892 (+1295964us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54003557d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:10.115986 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661425536}
I20260709 12:59:10.141103  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.095963  5059 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.147442  2423 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:10.150784  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.151499  2455 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:10.125726  5509 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:10.157871  5509 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.157886  5521 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:10.158390  5509 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:10.158804  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:10.160032  5521 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:10.160445  5521 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.160805  5521 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:10.099102  5528 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:10.170193  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 462826us
I20260709 12:59:10.170240  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:10.146790  1427 catalog_manager.cc:5697] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:10.166124  2344 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:10.177014  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.095415  5436 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.182451  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.184923  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:10.185307  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:10.185880  1679 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:10.183308  2461 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:10.187357  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:10.188506  1677 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:59:10.195959  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.199654  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.180624  5528 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:10.211760  1677 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:10.173539  5059 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.212791  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.214799  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.176223  5403 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.215745  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.216001  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.218508  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.221535  1676 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:10.218294  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.216825  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.235563  5436 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:10.209393  1427 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 6 to 7, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.213122  5239 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:10.239823  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.237318  1427 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 6 to 7, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.244159  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.252315  1533 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:10.256227  5312 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:10.257256  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.256349  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:10.265915  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 79420.7us
I20260709 12:59:10.271852  1679 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:10.274852  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.253947  5239 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.280532  1427 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:10.278007  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:10.287518  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.292181  1683 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:10.300599  1677 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:10.300957  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.301821  5519 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:10.302281  5519 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.302677  5519 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:10.302806  1677 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:10.288177  5239 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:10.318543  1683 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:59:10.331559  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:10.332593  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.367976  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.293859  5331 raft_consensus.cc:2764] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:10.379331  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.384442  1679 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:10.386210  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:10.388068  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 110135us
I20260709 12:59:10.309769  5506 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:10.389073  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 180994us
W20260709 12:59:10.398761  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 188071us
I20260709 12:59:10.403008  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.420852  1682 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
W20260709 12:59:10.423393  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 245297us
W20260709 12:59:10.427124  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 139145us
I20260709 12:59:10.430470  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:10.434844  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:10.439503  2342 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:10.440439  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 302466us
I20260709 12:59:10.444387  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:10.447005  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.447398  2342 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:10.446094  5294 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:10.454620  5312 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:10.454869  5294 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.455209  5312 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.455456  5294 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:10.455685  5312 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:10.455834  5059 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:10.458810  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.462642  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:10.466010  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:10.464993  5427 consensus_meta.cc:287] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.001s
W20260709 12:59:10.476022  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.467882  2342 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:10.447748  5507 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:10.449676  5528 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:10.507113  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.493057  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:10.509457  1683 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:10.501343  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.531158  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.492190  5403 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:10.498385  5507 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.458506  5562 consensus_queue.cc:1059] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:59:10.550705  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:10.559199  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 96605.6us
I20260709 12:59:10.500134  5059 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:10.565047  5059 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:10.491551  5427 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.564375  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.562175  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.506759  5436 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:10.506618  5528 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.574867  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2110) took 1112 ms. Trace:
I20260709 12:59:10.551944  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.589497  1682 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:10.582448  1683 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:10.559626  5507 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:10.589893  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:10.593593  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 163179us
I20260709 12:59:10.586238  1680 rpcz_store.cc:276] 0709 12:59:09.455396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.477683 (+ 22287us) service_pool.cc:224] Handling call
0709 12:59:09.711750 (+234067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:09.758009 (+ 46259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:09.758048 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:09.758553 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:59:10.223985 (+465432us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:10.224027 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.224104 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:10.567068 (+342964us) raft_consensus.cc:1685] finished
0709 12:59:10.567110 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:10.567302 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":465012,"threads_started":1,"wal-append.queue_time_us":767737}
I20260709 12:59:10.606069  2344 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:10.606323  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.607003  1683 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:10.608438  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.608717  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.494302  5576 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:59:10.614825  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.612815  1677 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:10.615785  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.617035  1682 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:10.617087  1683 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:10.569851  5059 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:10.618912  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:10.575565  5436 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.590556  5528 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.624864  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:10.625106  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:10.629626  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:10.630290  1533 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:10.626820  5436 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.634254  5580 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:10.634629  5575 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:59:10.634795  5580 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.635217  5580 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:10.637094  5567 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:59:10.638789  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:10.639602  1525 raft_consensus.cc:2393] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:10.640381  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:10.642174  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:10.642807  5568 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:59:10.644088  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:10.644760  1607 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:10.646950  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:10.647543  1607 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:10.649331  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:10.649931  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:10.658128  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:10.660989  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.661641  1676 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:10.662284  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:10.663414  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:10.666293  1533 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:10.672454  2344 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:10.672864  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:10.667176  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.656889  5312 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.669212  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.669740  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.683095  1683 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:10.669947  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.670724  5580 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:10.642233  5561 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:59:10.650000  1607 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:10.684981  1677 raft_consensus.cc:2410] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:59:10.661016  1575 connection.cc:256] RPC call timeout handler was delayed by -1.2124570409999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 12:59:10.726150  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:10.682232  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:10.700402  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 232604us
I20260709 12:59:10.727185  1600 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:10.727412  2342 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:10.700428  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 90914.9us
I20260709 12:59:10.731665  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:10.659122  5501 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:10.714695  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.701463  5562 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:10.736877  1647 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:10.790987  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 63634.9us
I20260709 12:59:10.649957  5427 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:10.838137  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 153063us
I20260709 12:59:10.836874  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:10.842125  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 49472.2us
I20260709 12:59:10.841287  1678 raft_consensus.cc:2410] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:59:10.844851  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 107995us
W20260709 12:59:10.845999  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 173607us
I20260709 12:59:10.856451  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:10.857368  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2115) took 1364 ms (client timeout 1809 ms). Trace:
W20260709 12:59:10.858227  1678 rpcz_store.cc:269] 0709 12:59:09.493244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.521363 (+ 28119us) service_pool.cc:224] Handling call
0709 12:59:10.836663 (+1315300us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b58000e6a98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:59:10.857247 (+ 20584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3269376}
W20260709 12:59:10.840531  5509 consensus_meta.cc:287] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.005s
W20260709 12:59:10.842810  5572 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:59:10.862836  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 136814us
I20260709 12:59:10.829582  5562 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.837117  5573 raft_consensus.cc:2764] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:59:10.829231  5501 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.865445  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:10.837922  5584 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:10.890502  5580 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:10.891724  5521 consensus_meta.cc:287] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.006s
I20260709 12:59:10.892213  5521 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.893643  2428 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:10.881507  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:10.898674  1678 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:10.857067  5582 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:10.868568  5562 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:10.901543  5582 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.908020  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.856665  5239 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:10.882478  5501 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:10.880249  5592 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.949904  5592 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.908742  2455 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:59:10.953292  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.954012  2455 raft_consensus.cc:2368] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:10.954757  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.955549  2455 raft_consensus.cc:2410] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:10.916527  5059 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.891767  5294 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.910410  5589 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:10.928011  5519 consensus_meta.cc:287] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.003s
I20260709 12:59:10.929417  5403 raft_consensus.cc:3055] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:10.929807  5521 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:10.930274  5584 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:10.936327  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.937371  2423 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:10.970295  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.970664  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.938323  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.938669  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.861804  5509 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.939564  5573 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:10.908434  5582 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:10.943259  5570 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.443s	user 0.004s	sys 0.000s
I20260709 12:59:10.863855  5595 consensus_queue.cc:1059] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:59:10.995563  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.996414  1527 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:10.997592  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:10.952163  5239 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:10.957897  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.003546  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:10.961930  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 61235.7us
I20260709 12:59:10.916994  5528 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.937985  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:10.970361  2435 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:10.973276  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:10.941100  5507 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:10.973770  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:10.928040  5506 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.034480  5506 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.034528  2451 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:10.963454  5563 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:10.965090  5230 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:10.994292  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:11.007611  1529 raft_consensus.cc:2393] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 8: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:11.009109  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:11.037714  1531 raft_consensus.cc:2368] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:11.010594  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:11.011430  5589 raft_consensus.cc:697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:11.039515  5556 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:11.039949  5556 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.039786  5589 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.011338  5562 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.041783  5592 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.043514  5562 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:10.965430  5588 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.044561  5588 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.046815  5588 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:10.970125  5519 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.012934  5595 raft_consensus.cc:3055] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:10.962218  5436 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.015034  5528 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.015852  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:11.016453  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:11.017166  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:11.040887  5556 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.018374  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:11.031216  5059 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.032814  5294 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.079515  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.049176  5519 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.068275  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2130) took 1320 ms. Trace:
W20260709 12:59:11.072948  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 299040us
I20260709 12:59:10.965458  5403 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:11.079402  1530 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:11.066759  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 181689us
I20260709 12:59:11.083861  1675 rpcz_store.cc:276] 0709 12:59:09.747908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.757547 (+  9639us) service_pool.cc:224] Handling call
0709 12:59:11.067984 (+1310437us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b540045b5d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:11.068183 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2935552}
I20260709 12:59:11.093627  1534 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:11.095790  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.100785  2455 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:11.069610  5595 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:10.998536  5573 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.106133  2476 raft_consensus.cc:1240] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:11.105898  2435 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:11.029476  5501 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:11.111896  1649 connection.cc:256] RPC call timeout handler was delayed by -2.373962425000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 12:59:11.106025  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:11.114971  1649 connection.cc:256] RPC call timeout handler was delayed by -2.293862425000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 12:59:11.115342  1649 connection.cc:256] RPC call timeout handler was delayed by -2.274062425000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:59:11.115667  1649 connection.cc:256] RPC call timeout handler was delayed by -2.1669624250000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:59:11.115942  1649 connection.cc:256] RPC call timeout handler was delayed by -2.1156624250000391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 12:59:11.116181  1649 connection.cc:256] RPC call timeout handler was delayed by -2.0823624250000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 12:59:11.115173  1530 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
W20260709 12:59:11.119959  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 254567us
I20260709 12:59:11.121076  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.132555  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.101904  5556 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:11.099009  5592 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.134160  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:11.140427  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:11.140486  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.141180  1530 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:11.143419  5584 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:11.143916  5584 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.143959  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.144392  5584 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.112316  5312 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:11.144637  2474 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:11.145533  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.146077  2474 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:11.146797  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.149706  2474 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:11.150997  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.152016  1575 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.152881  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.153017  5576 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:11.149518  2423 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:11.153494  5576 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:11.153956  5576 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.154270  5592 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.157138  5592 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.140394  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:11.157660  5331 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:11.119427  5059 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:11.096848  5577 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:59:11.170780  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.171344  1498 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.126091  5574 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:59:11.189502  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.197718  2451 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:11.205667  5605 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:11.210547  5432 consensus_queue.cc:1059] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:11.211740  5432 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:59:11.214273  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48162.7us
I20260709 12:59:11.170799  5599 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:11.213158  5432 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:11.215243  5577 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 12:59:11.233161  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 80353.2us
I20260709 12:59:11.237604  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.235630  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.171296  5059 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:11.241864  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 357805us
I20260709 12:59:11.241784  5357 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:11.257794  2451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:11.258252  5357 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.258666  2451 raft_consensus.cc:606] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:11.259562  1649 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.241917  5492 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:11.242395  5331 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:11.260372  5501 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:11.260805  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.261289  5501 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.261943  5239 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.262277  5509 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:59:11.178027  5587 consensus_queue.cc:1059] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:59:11.257999  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.186087  5582 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.259244  5357 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:11.274454  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 95563.5us
I20260709 12:59:11.263767  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.260972  5331 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:11.268023  2339 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.270443  5056 consensus_queue.cc:1059] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:11.271387  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.271642  5492 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.286818  5492 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.272804  5587 raft_consensus.cc:3055] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:11.289880  5587 raft_consensus.cc:740] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.278200  5585 consensus_queue.cc:1059] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:11.281044  5501 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:11.294088  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.281924  5556 raft_consensus.cc:3055] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:11.271699  5403 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.282455  5509 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:11.305356  5573 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.284621  5312 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:11.305542  5584 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.308044  5584 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.177685  5595 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.309055  5595 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:11.285739  5059 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.241935  5590 raft_consensus.cc:3055] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:11.295907  1572 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.298255  5556 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.275899  5507 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.326876  5610 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:11.327183  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 63482.3us
I20260709 12:59:11.327826  5606 raft_consensus.cc:3055] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:11.327291  5556 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.328219  5606 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:11.302605  5599 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:11.328786  1649 leader_election.cc:400] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:11.300112  1575 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:11.330488  5599 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:11.330566  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.331063  5599 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.331346  5501 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.331588  5599 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.331944  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.302451  5580 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:11.333647  5357 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:11.327311  5610 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.334991  5610 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.336722  5610 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:11.302279  5577 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.337592  5577 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.328755  5556 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:11.333437  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.338935  5577 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:11.339602  5577 consensus_queue.cc:1243] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:11.339721  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.340824  5577 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.330549  5587 consensus_queue.cc:260] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.320454  5576 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.343065  5519 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:11.343321  5587 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:11.343500  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.326319  5582 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.343554  5519 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:11.344532  1575 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.345139  5519 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.346163  1572 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.346444  5519 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.345615  5576 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.346634  5403 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.346710  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.347285  5576 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:11.347713  5576 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:11.347725  1606 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:11.348137  5576 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:11.348517  1572 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.349112  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.350749  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.351430  1606 raft_consensus.cc:2376] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10. Re-sending same reply.
I20260709 12:59:11.338064  1649 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.316188  5590 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.354624  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.356587  5580 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:11.294909  5436 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.355815  5582 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:11.357954  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.358656  1606 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:11.358970  5582 consensus_queue.cc:1059] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:11.359993  5580 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:11.360114  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.360394  5580 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:11.360972  1606 raft_consensus.cc:2376] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8. Re-sending same reply.
W20260709 12:59:11.297506  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 58036.5us
I20260709 12:59:11.314345  1497 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:11.332085  5501 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:11.367151  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.367136  5580 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.367990  1600 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:11.367165  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.369587  1606 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:11.341427  5577 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:11.366264  5501 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.371477  5501 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:11.371932  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 57679.3us
I20260709 12:59:11.372361  5056 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:11.373687  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.375377  5436 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.373687  1497 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:11.377218  5574 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.377698  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.386185  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:11.386459  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:11.368297  5580 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:11.389269  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.389485  5582 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:11.389981  5582 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.389336  5059 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:11.390389  5331 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.391079  1649 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.381660  5608 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:11.391767  5608 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.392184  5608 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.309356  5506 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.382651  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:11.384744  2461 pending_rounds.cc:85] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 5
I20260709 12:59:11.394905  5506 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.395046  2461 pending_rounds.cc:107] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:59:11.395577  2461 raft_consensus.cc:2889] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:11.390980  5331 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.397482  5501 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.399819  5501 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.399856  5331 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.400877  5331 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.402356  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.408987  5331 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.379001  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:11.410928  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:11.417852  5574 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:11.418686  5432 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:11.419875  5613 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:11.420217  5331 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:11.420296  5613 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.420854  5331 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.421309  5331 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.421432  5613 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.423177  5613 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:11.390432  5582 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:11.414685  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:11.412791  1572 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.430624  2475 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
W20260709 12:59:11.433131  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 217697us
I20260709 12:59:11.410718  5584 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:11.436991  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 75246.5us
I20260709 12:59:11.437873  1498 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.436805  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:11.443077  1572 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:11.437405  5609 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.444133  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.432597  5506 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:11.446344  1603 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:11.448084  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.450616  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.451457  1600 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:11.451560  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.452181  1609 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.454540  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.455250  1606 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:11.458384  1602 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:11.459076  5059 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:11.459610  5609 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.459710  5059 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:11.444705  5605 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:11.461971  5605 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.463505  1603 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:11.464259  5605 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.465055  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:11.444872  5577 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:11.466120  5558 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:11.466603  5558 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:11.467047  5558 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:11.453588  5506 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.474081  5506 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:11.481154  1498 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:11.460813  5059 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.482048  5432 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:11.482484  5432 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:11.482882  5432 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:11.450475  5585 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:11.483775  5585 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.484791  5585 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.437881  5576 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.490996  1609 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
W20260709 12:59:11.494043  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 67840.2us
I20260709 12:59:11.512310  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.513003  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.515029  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.515725  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.516017  1675 raft_consensus.cc:2410] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:59:11.516322  1609 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:11.513129  1601 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:11.519415  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:11.520066  1683 raft_consensus.cc:2376] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8. Re-sending same reply.
I20260709 12:59:11.517251  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.521102  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.521262  1607 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:11.521828  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.521041  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.523399  1680 raft_consensus.cc:2410] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:11.522516  1678 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:11.465230  5331 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.524986  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.525300  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.527642  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:11.528118  1607 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:11.529527  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:11.530053  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.530149  1683 raft_consensus.cc:2376] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9. Re-sending same reply.
I20260709 12:59:11.530771  1600 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:11.503204  5576 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.539809  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:11.540603  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.544428  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:11.545095  1675 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:11.547333  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.548130  1678 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:11.548996  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.535738  1609 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:11.549607  1607 raft_consensus.cc:2376] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9. Re-sending same reply.
I20260709 12:59:11.552237  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.552912  1681 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:11.553754  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.554544  1679 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:11.554595  1683 raft_consensus.cc:1240] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: [6.7-7.8]
I20260709 12:59:11.555136  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.555737  1680 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:11.556094  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.556945  1683 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:59:11.560245  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.560530  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.560635  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.561393  1674 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:11.524251  5432 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.552152  5573 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.565608  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.566310  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.566231  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.567149  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.571990  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:11.570176  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.571283  1676 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:11.575631  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.576507  2475 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:11.577140  2461 raft_consensus.cc:2368] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:11.570762  1677 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:59:11.558241  5556 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:11.574455  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:11.582340  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.581393  1678 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:11.587165  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.581418  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.569839  5607 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.615376  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.616554  1600 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:11.581022  5556 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.573931  5573 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.628857  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:11.608031  5519 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:11.631283  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.632436  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.615505  5592 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:11.636768  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:11.614974  5576 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:11.577230  5606 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.577432  5590 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:11.709893  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.639644  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:11.778137  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.661881  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:11.665686  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.622664  5556 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:11.638000  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 69591us
I20260709 12:59:11.780030  1606 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:11.786808  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.786952  1602 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:11.677184  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.658638  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:11.788920  1600 raft_consensus.cc:2368] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8.
W20260709 12:59:11.640322  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 201830us
I20260709 12:59:11.790310  2455 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:11.783735  2461 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.662243  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:11.684460  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.638083  2342 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.791924  1605 raft_consensus.cc:2368] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:11.778139  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:11.708603  5618 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 12:59:11.794106  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 156133us
I20260709 12:59:11.795037  2342 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.687844  1604 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:11.708351  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 66709.6us
I20260709 12:59:11.798461  1675 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:11.799175  1678 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:11.799531  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 115171us
I20260709 12:59:11.801779  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.738358  5331 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.662277  5403 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:11.803941  2342 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:11.792515  1608 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
W20260709 12:59:11.804935  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.811940  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:11.727928  5601 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.661402  5432 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:11.806679  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:11.807036  2476 raft_consensus.cc:1240] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:11.823840  1675 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.824389  1649 leader_election.cc:400] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:11.824904  1649 leader_election.cc:403] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.808198  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:11.809129  2475 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:11.809175  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.620748  5607 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.794123  5606 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:11.790597  5577 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:11.803249  5617 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:11.799474  5436 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.799661  5584 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.810550  5507 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:11.785029  5582 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.637830  5519 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:11.810398  5509 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:11.838831  5607 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.830844  1575 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:11.944912  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 114139us
I20260709 12:59:11.833587  5312 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:11.865630  5618 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:59:11.817979  5611 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:11.876626  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:11.883682  5619 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:59:11.843799  5609 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:59:11.895860  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 61743.8us
I20260709 12:59:11.881635  5605 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.870978  5622 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:11.895898  1675 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:11.944218  5509 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:11.907328  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 72190.8us
I20260709 12:59:11.829475  5601 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:11.908675  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 116682us
I20260709 12:59:11.993438  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.995272  1572 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:11.885780  5056 consensus_queue.cc:1059] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 12:59:11.920384  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 116316us
I20260709 12:59:11.967192  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:11.972034  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:11.880901  5573 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:11.976310  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.002743  1675 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:11.953979  5507 raft_consensus.cc:697] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:11.978049  5605 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:11.979005  5622 raft_consensus.cc:697] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:11.980870  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:11.986815  5628 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:59:11.975325  5617 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:12.002113  1678 raft_consensus.cc:2368] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13.
I20260709 12:59:11.953256  5576 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:11.960795  5611 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:12.006657  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:12.075623  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.009091  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:12.076534  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 67512us
I20260709 12:59:11.993849  5509 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.946775  5584 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.069679  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:12.016047  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 181393us
I20260709 12:59:11.976320  5331 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
W20260709 12:59:12.086246  1647 leader_election.cc:336] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.548s (SENT)
I20260709 12:59:11.844538  5577 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:12.073397  5506 consensus_meta.cc:287] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.000s
I20260709 12:59:12.094648  1647 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:12.079768  5611 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:12.016798  5573 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:12.087906  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:12.107555  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.111673  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.112066  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:12.107138  1575 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.013468  5609 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:12.093277  1675 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:12.112319  1678 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
W20260709 12:59:12.081365  5626 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:59:12.113420  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.117935  1675 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:12.081099  5403 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:12.087359  5592 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:12.081143  5638 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:12.155043  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.156503  1609 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:12.161006  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 46828.8us
I20260709 12:59:12.166286  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.166989  1674 raft_consensus.cc:2376] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9. Re-sending same reply.
I20260709 12:59:12.167698  5436 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.167889  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.168330  2461 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:12.169124  2428 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:12.171060  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.171613  1679 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:12.172070  1530 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:12.157262  1498 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:12.185345  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.119824  5595 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:12.186897  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 180300us
I20260709 12:59:12.187687  1675 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:12.188479  2342 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:12.188998  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.189831  1675 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:12.190464  1609 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:12.150460  5582 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:12.107167  5059 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:59:12.186031  1678 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:12.179138  5580 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:12.192557  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.201916  1674 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:12.173718  5616 log.cc:927] Time spent T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.075s	user 0.000s	sys 0.006s
W20260709 12:59:12.180238  5608 consensus_meta.cc:287] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.002s
I20260709 12:59:12.111357  5506 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.206116  1675 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:12.203209  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:12.211993  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.212431  1680 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:12.217953  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 131750us
W20260709 12:59:12.218798  1647 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.740s (SENT)
I20260709 12:59:12.219301  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:12.220129  1679 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:12.175153  5573 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:12.222617  1679 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:59:12.192642  5595 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:12.221263  5592 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:12.202929  5580 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:12.234104  1683 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:12.207585  5634 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:12.204963  5633 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:12.240089  1497 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:12.242405  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:12.247555  5613 consensus_meta.cc:287] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.000s
W20260709 12:59:12.249136  5558 consensus_meta.cc:287] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.782s	user 0.004s	sys 0.008s
I20260709 12:59:12.231485  5059 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:12.252569  5556 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.306931  5633 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:12.308974  5556 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:12.308660  5633 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.309705  5556 consensus_queue.cc:1059] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:12.310745  5556 raft_consensus.cc:3055] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:12.311100  5556 raft_consensus.cc:740] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:12.311822  5556 consensus_queue.cc:260] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.230931  5592 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:12.241187  5580 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:12.254144  5599 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.002s
W20260709 12:59:12.254619  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 259397us
I20260709 12:59:12.327065  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:12.243784  5519 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:12.258080  5506 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:12.259729  5601 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:12.221614  5642 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.269161  5577 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:12.230255  5629 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:12.275868  5587 consensus_meta.cc:287] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.932s	user 0.006s	sys 0.006s
I20260709 12:59:12.244632  5634 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:12.280066  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:12.366142  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 86177.4us
I20260709 12:59:12.280889  5643 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:12.203738  5617 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.231334  5595 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:12.191866  5622 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.213119  5507 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.214756  5608 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.244771  5609 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:12.300592  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:12.306150  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 91859.7us
I20260709 12:59:12.306908  5627 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:12.313515  1680 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:12.325661  1674 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
W20260709 12:59:12.359516  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 252460us
W20260709 12:59:12.325647  5616 log.cc:927] Time spent T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:59:12.324658  5558 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.372733  1647 leader_election.cc:400] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8.
I20260709 12:59:12.423766  1647 leader_election.cc:403] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:12.361433  5556 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:12.367898  5644 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:12.423390  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 335516us
I20260709 12:59:12.428188  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:12.431399  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.429198  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:12.432497  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.267063  5403 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:12.436522  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 109566us
I20260709 12:59:12.434083  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:12.437688  2421 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:12.437412  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:12.371201  5506 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:12.440506  2339 leader_election.cc:400] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13.
I20260709 12:59:12.440869  2339 leader_election.cc:403] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:59:12.368027  5634 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:12.443686  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.443765  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:12.444223  1606 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:12.369966  5629 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:12.442565  5506 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:12.443456  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:12.424676  5610 consensus_meta.cc:287] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.088s	user 0.013s	sys 0.001s
I20260709 12:59:12.426146  5576 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:12.334678  5599 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.418591  5605 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:12.446998  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.365568  5642 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.466840  1572 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:12.454448  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:12.436980  5059 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8.
I20260709 12:59:12.444516  5577 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:12.459553  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 87006.6us
I20260709 12:59:12.453018  5601 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:12.447366  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:12.443104  5584 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:12.464607  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:12.467789  5637 log.cc:927] Time spent T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:59:12.443382  5573 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.452697  5506 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:12.418008  5592 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.456892  5644 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.369860  5643 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:12.482218  1601 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:12.497035  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.486421  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:12.465297  5609 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:12.484249  5613 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:12.507386  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:12.483212  5577 raft_consensus.cc:697] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:12.523300  5577 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.512617  5649 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:12.508231  5627 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:12.525648  5576 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.518328  5608 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:12.497965  5653 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.535792  1572 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:12.531885  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.486871  5654 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:12.534611  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 60781.2us
I20260709 12:59:12.541339  1647 leader_election.cc:400] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:12.499461  5643 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:12.532210  5641 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 12:59:12.550657  1498 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:12.551487  2421 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:12.544147  1572 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.542766  1647 leader_election.cc:403] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:59:12.530434  5606 consensus_meta.cc:287] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.000s
I20260709 12:59:12.503055  5629 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.557276  1572 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.492276  5573 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:12.562197  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 97717.2us
I20260709 12:59:12.558951  2339 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:12.563571  1649 leader_election.cc:400] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:12.564060  2339 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:12.548821  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.533210  5609 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:12.541172  5644 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:12.535000  5649 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:12.568740  5589 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:12.554064  5605 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:12.576609  2339 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:12.579233  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71957.6us
I20260709 12:59:12.582901  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:12.583906  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.587505  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.588212  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.588351  1526 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:12.557749  5608 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.589329  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.590137  1531 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:12.577920  5613 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:12.598084  1531 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:12.621868  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.624976  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.602856  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.573519  5519 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:12.573123  5644 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:12.636087  2339 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:12.640046  5660 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:59:12.573313  5657 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:12.577144  5589 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:12.646209  1526 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:12.585752  5605 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:12.658404  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 93880.6us
I20260709 12:59:12.658569  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:12.666244  2421 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:12.551918  5654 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.682550  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.625867  5507 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.634528  5612 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:59:12.686949  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 129770us
I20260709 12:59:12.666040  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:12.640784  5436 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:12.634065  5613 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:12.698663  1572 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.697844  1533 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:12.700001  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.693221  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.647341  5558 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:12.662415  5589 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:12.682521  5605 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:12.701237  1526 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:12.647214  5644 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:12.663328  5599 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:12.654788  5657 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:12.704505  5509 consensus_meta.cc:287] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.002s
W20260709 12:59:12.708947  5625 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.950s	user 0.005s	sys 0.000s
W20260709 12:59:12.709055  5656 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:59:12.574451  5611 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.719830  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:12.729810  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 63882us
I20260709 12:59:12.718592  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.723384  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.711120  5608 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:12.739786  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:12.726078  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 90112.9us
I20260709 12:59:12.711330  5606 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:12.719777  5507 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:12.741883  2339 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:12.719610  5659 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:12.754280  1534 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:12.749166  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:12.751142  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.752390  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.755656  1675 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:12.755908  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.756781  2339 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:12.740027  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7c3ea752cffa4a138dd2984b56316ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3cabc5110903443ba3beb5cbb14afa91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:12.719875  5657 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:12.755548  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.758785  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.759282  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.759945  1675 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 6.
I20260709 12:59:12.760671  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.723584  5519 raft_consensus.cc:697] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:12.771145  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.771981  1675 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:12.766108  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.772989  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.766541  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.773804  1526 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:12.746735  5665 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.786240  1533 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:12.722628  5509 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.756681  5651 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.790777  1526 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:12.763290  5582 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:12.802302  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.803872  1678 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:12.828924  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.756850  5580 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.757712  5606 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.838546  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:12.841017  1533 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:12.841949  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 882) took 1148 ms. Trace:
I20260709 12:59:12.717689  5609 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.842499  1679 rpcz_store.cc:276] 0709 12:59:11.693423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.224024 (+530601us) service_pool.cc:224] Handling call
0709 12:59:12.242322 (+ 18298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:12.242533 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:59:12.425735 (+183202us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.841188 (+415453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:12.841253 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:12.841303 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.841380 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.841793 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5509,"prepare.queue_time_us":218149,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":175410,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":26973,"thread_start_us":592946,"threads_started":3,"wal-append.queue_time_us":109357}
I20260709 12:59:12.838092  5582 raft_consensus.cc:697] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:12.808506  5660 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:12.857366  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 100645us
I20260709 12:59:12.866283  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:12.869354  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.870267  1679 raft_consensus.cc:2393] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:12.853725  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.728395  5649 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.882166  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:12.882902  5580 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:12.846809  5573 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:12.873281  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:12.883126  1533 raft_consensus.cc:606] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:12.844437  5661 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:12.909849  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:12.913838  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.914551  1679 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:12.807978  5613 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.848325  5506 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.916735  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:12.911646  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 338695us
I20260709 12:59:12.789273  5665 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.805349  5651 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.908824  5659 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:12.932907  1528 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:12.932770  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.939570  1674 raft_consensus.cc:2368] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12.
I20260709 12:59:12.941828  1572 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:12.931070  5580 raft_consensus.cc:2764] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:59:12.943192  5654 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:12.944036  5673 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:12.944499  5606 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:12.944943  5671 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:12.871117  5660 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:12.922194  5677 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:12.931206  5601 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13.
I20260709 12:59:12.953872  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.954811  1682 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:12.955938  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.956877  1682 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:12.920944  5669 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.945091  5606 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:12.961999  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:12.962927  2451 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:12.963627  1679 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:12.887338  5519 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.964820  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:12.963493  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:12.971402  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:12.931270  5558 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.965288  5611 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:12.958689  1533 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:12.959555  1528 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:59:12.940780  5661 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.958454  5677 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:12.973843  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.914227  5507 raft_consensus.cc:697] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:12.991030  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.993640  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2136) took 1322 ms. Trace:
I20260709 12:59:12.940516  5436 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:12.979332  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:12.994282  1607 rpcz_store.cc:276] 0709 12:59:11.655430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.657860 (+  2430us) service_pool.cc:224] Handling call
0709 12:59:12.971235 (+1313375us) spinlock_profiling.cc:243] Waited 891 us on lock 0x7b58000dfe98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:59:12.978015 (+  6780us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048384}
I20260709 12:59:12.962188  5606 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:12.932318  5582 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:12.973898  5681 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.973805  5558 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.018177  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.019296  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:13.056514  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.068529  1572 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:13.118237  2475 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
W20260709 12:59:13.117911  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.981952  5677 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:13.014603  5662 log.cc:927] Time spent T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:59:13.130131  1677 raft_consensus.cc:2410] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:13.131369  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:13.131683  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63246.1us
I20260709 12:59:13.013927  5606 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:13.005290  5601 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.018373  5624 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:13.135016  1497 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:13.025161  5509 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:13.120694  5556 consensus_meta.cc:287] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.005s
I20260709 12:59:13.066882  5673 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:13.132266  1607 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:12.965271  5669 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.153604  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.124248  5671 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:13.138933  5577 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:13.158403  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.163434  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:13.158483  5585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.400s	user 0.019s	sys 0.027s
I20260709 12:59:13.182634  1682 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
W20260709 12:59:13.186599  5676 log.cc:927] Time spent T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.183s	user 0.006s	sys 0.000s
I20260709 12:59:13.187948  5635 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:13.155400  5556 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:13.186662  5507 consensus_queue.cc:237] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.181772  5506 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:13.190623  5643 consensus_meta.cc:287] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.619s	user 0.015s	sys 0.000s
W20260709 12:59:13.191205  5687 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:13.145923  5601 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.192905  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.193591  5669 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.198913  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:13.207005  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2137) took 1546 ms (client timeout 2032 ms). Trace:
W20260709 12:59:13.207270  5627 consensus_meta.cc:287] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.681s	user 0.015s	sys 0.002s
W20260709 12:59:13.208686  5691 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:59:13.134908  5681 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:13.210016  1600 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:13.215751  1678 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:13.216485  5605 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.281821  5059 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.151964  5624 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:13.221622  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:13.225353  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.229967  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.231431  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2412) took 1683 ms. Trace:
I20260709 12:59:13.234926  1525 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:13.239374  1676 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:59:13.236761  5585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.476s	user 0.019s	sys 0.027s
I20260709 12:59:13.238314  5635 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:59:13.261257  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 126324us
I20260709 12:59:13.183322  5608 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:13.310068  5634 consensus_meta.cc:287] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.857s	user 0.013s	sys 0.006s
I20260709 12:59:13.228482  5660 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:13.321759  1605 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:13.322330  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:13.322099  1609 rpcz_store.cc:269] 0709 12:59:11.660480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.661921 (+  1441us) service_pool.cc:224] Handling call
0709 12:59:13.206802 (+1544881us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b540035f054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:13.206934 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752726400}
I20260709 12:59:13.217392  5436 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.327311  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2046) took 1345 ms. Trace:
I20260709 12:59:13.358635  1534 rpcz_store.cc:276] 0709 12:59:11.981784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.981914 (+   130us) service_pool.cc:224] Handling call
0709 12:59:11.982218 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:12.754767 (+772549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.327125 (+572358us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b540028f354. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:13.327261 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775040896}
I20260709 12:59:13.332335  1607 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:13.332020  2451 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:13.332458  1602 rpcz_store.cc:276] 0709 12:59:11.547964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.549959 (+  1995us) service_pool.cc:224] Handling call
0709 12:59:11.786782 (+236823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.787494 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.231234 (+1443740us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001563d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:13.231370 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509423872}
W20260709 12:59:13.325065  5589 consensus_meta.cc:287] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.606s	user 0.030s	sys 0.017s
I20260709 12:59:13.324579  5627 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:13.363202  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.354797  1526 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:13.336349  5671 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:13.337021  5657 consensus_meta.cc:287] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.004s
I20260709 12:59:13.368554  5558 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.368758  5657 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:13.369540  5635 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.370769  5635 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:13.371775  1674 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:13.330966  5651 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:13.344269  5685 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 12:59:13.375144  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.321748  5643 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:13.382436  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.385102  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.387681  1609 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
W20260709 12:59:13.367887  5595 consensus_meta.cc:287] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.944s	user 0.015s	sys 0.002s
I20260709 12:59:13.390319  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.390599  1526 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:13.394927  1602 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:13.334858  5059 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.397009  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:13.385293  5689 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:59:13.397960  1534 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:13.399154  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.401002  1526 raft_consensus.cc:2393] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:13.346968  5684 consensus_queue.cc:1059] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:13.405507  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.403159  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.403355  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.383249  5657 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:13.407060  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:13.426692  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.325325  5673 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:13.409631  5655 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:13.367317  5589 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.365895  5634 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.442162  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.443876  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.428819  5617 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.448256  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2142) took 1028 ms. Trace:
I20260709 12:59:13.397761  5595 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.432981  5577 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:13.430526  5649 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.456938  2476 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:13.451836  1604 rpcz_store.cc:276] 0709 12:59:12.419544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.434402 (+1014858us) service_pool.cc:224] Handling call
0709 12:59:13.448165 (+ 13763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.430717  5608 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:13.465233  5693 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:59:13.474694  1607 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:13.429188  5624 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:13.478933  5680 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.360s	user 0.000s	sys 0.002s
I20260709 12:59:13.480156  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2424) took 1382 ms. Trace:
I20260709 12:59:13.480640  1607 rpcz_store.cc:276] 0709 12:59:12.097836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.476130 (+1378294us) service_pool.cc:224] Handling call
0709 12:59:13.479679 (+  3549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.479859 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.479883 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.479921 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:13.479949 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.479999 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.480097 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.482494  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2425) took 1374 ms. Trace:
I20260709 12:59:13.483897  1607 rpcz_store.cc:276] 0709 12:59:12.114731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.481743 (+1367012us) service_pool.cc:224] Handling call
0709 12:59:13.482034 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.482204 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.482229 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.482270 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:13.482300 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.482348 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.482443 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.474382  5677 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.506135  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.506778  1531 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:13.510188  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.467938  5059 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:13.489632  5696 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260709 12:59:13.468372  5649 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.468251  5608 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.518548  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.489454  5643 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:13.504055  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 692) took 1076 ms. Trace:
W20260709 12:59:13.515514  5644 consensus_meta.cc:287] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.786s	user 0.012s	sys 0.000s
I20260709 12:59:13.523195  1607 rpcz_store.cc:276] 0709 12:59:12.427910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.486538 (+1058628us) service_pool.cc:224] Handling call
0709 12:59:13.503223 (+ 16685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.503666 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.503697 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.503756 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:13.503791 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.503858 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.503987 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.511179  5601 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:13.455750  5617 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:13.513185  5681 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:13.468488  5577 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.539143  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.541657  1531 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:13.530308  5605 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.531679  5644 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:13.552898  1605 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:13.553344  5644 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:13.557875  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50106.9us
I20260709 12:59:13.564427  5677 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:13.589500  5577 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.591398  5617 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:13.593396  5649 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:13.600970  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2135) took 1946 ms (client timeout 2246 ms). Trace:
W20260709 12:59:13.601498  1601 rpcz_store.cc:269] 0709 12:59:11.655022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.655221 (+   199us) service_pool.cc:224] Handling call
0709 12:59:13.600759 (+1945538us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54002ab2d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:13.600903 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586296064}
I20260709 12:59:13.605463  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 892) took 1170 ms. Trace:
I20260709 12:59:13.610405  2475 rpcz_store.cc:276] 0709 12:59:12.435406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.435532 (+   126us) service_pool.cc:224] Handling call
0709 12:59:13.605095 (+1169563us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54006ed7d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:13.605226 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207290240}
I20260709 12:59:13.613015  5608 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.613899  5590 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:13.613309  5694 raft_consensus.cc:993] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:13.624464  5677 raft_consensus.cc:1081] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:13.616277  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 693) took 1188 ms. Trace:
W20260709 12:59:13.622584  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 63982.3us
I20260709 12:59:13.630353  1601 rpcz_store.cc:276] 0709 12:59:12.428269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.602343 (+1174074us) service_pool.cc:224] Handling call
0709 12:59:13.602707 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.602903 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.602936 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.602978 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:13.603010 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.603073 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.616218 (+ 13145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.609550  5606 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:13.623627  5592 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:13.634618  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 694) took 1206 ms. Trace:
I20260709 12:59:13.635142  1601 rpcz_store.cc:276] 0709 12:59:12.428553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.633475 (+1204922us) service_pool.cc:224] Handling call
0709 12:59:13.633914 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.634099 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.634173 (+    74us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.634216 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:13.634252 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.634337 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.634547 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.636613  1601 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:13.637326  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 696) took 1106 ms. Trace:
I20260709 12:59:13.637717  1601 rpcz_store.cc:276] 0709 12:59:12.531058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.636236 (+1105178us) service_pool.cc:224] Handling call
0709 12:59:13.636498 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.637084 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.637271 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.639427  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2426) took 1073 ms. Trace:
I20260709 12:59:13.639814  1601 rpcz_store.cc:276] 0709 12:59:12.565800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.638474 (+1072674us) service_pool.cc:224] Handling call
0709 12:59:13.638936 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.639091 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.639116 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.639153 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:13.639206 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.639263 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.639374 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.634093  5651 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.641417  1601 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:13.641146  5651 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.645123  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:13.645804  1532 raft_consensus.cc:606] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:13.646147  1532 raft_consensus.cc:614] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:13.634616  5436 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.647691  5589 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:13.648331  5436 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.651422  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1000) took 1857 ms. Trace:
I20260709 12:59:13.651854  5651 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:13.652863  5436 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:13.654842  2475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:13.655611  2475 raft_consensus.cc:606] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:13.655932  2475 raft_consensus.cc:614] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:13.659147  2475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:13.659503  2451 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:13.661221  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.661969  1532 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:13.662155  5634 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:13.662386  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.664080  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:13.651858  2428 rpcz_store.cc:276] 0709 12:59:11.793898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.794037 (+   139us) service_pool.cc:224] Handling call
0709 12:59:12.168943 (+374906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:12.174119 (+  5176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.651183 (+1477064us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54005235d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:13.651320 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824893184}
I20260709 12:59:13.665500  1647 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:13.666561  1602 raft_consensus.cc:2393] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 6: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:13.677026  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:13.674722  2342 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:13.679014  2344 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:13.680089  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:13.679997  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:13.681077  2451 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 4.
I20260709 12:59:13.683444  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:13.684195  2451 raft_consensus.cc:2410] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:13.642997  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2428) took 1074 ms. Trace:
I20260709 12:59:13.686694  1601 rpcz_store.cc:276] 0709 12:59:12.568124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.640747 (+1072623us) service_pool.cc:224] Handling call
0709 12:59:13.641099 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.642007 (+   908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.642894 (+   887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.687646  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.672384  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:13.686278  5595 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:13.672410  5690 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.347s	user 0.000s	sys 0.003s
I20260709 12:59:13.696388  1532 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:13.697763  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:13.698843  2451 raft_consensus.cc:2393] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:13.694809  5331 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:13.702010  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.708123  1532 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:13.700131  5608 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:13.711522  5607 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:13.711740  2475 raft_consensus.cc:606] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:13.711814  5608 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.712232  5607 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.714814  5607 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.705286  5331 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:13.715206  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.715732  5331 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:13.716179  5509 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:13.716589  5509 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:13.717080  5509 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:13.665689  5661 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:13.723670  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.717244  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.727309  1608 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:13.655630  5642 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:13.730321  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.731436  1608 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:13.700686  5666 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:13.700553  5634 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:13.667517  5606 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:13.705531  5576 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.700928  5651 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:13.714836  5608 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.738107  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.738737  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.747694  1601 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:13.748209  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:13.732288  5666 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:13.752540  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.753548  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.754766  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:13.741896  5629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.019s	sys 0.022s
I20260709 12:59:13.736430  5651 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.755336  1608 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:13.757102  1532 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:13.768731  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.743022  5589 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:59:13.746543  5607 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:13.756979  5629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.019s	sys 0.023s
I20260709 12:59:13.749042  5634 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:13.742856  5682 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:59:13.756701  5666 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:13.754534  5661 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:13.774911  5607 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.771338  5436 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:59:13.778339  5634 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.790161  5436 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:13.777154  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:13.781021  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.784701  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.761250  5651 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:13.795542  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.761651  5595 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.797492  1607 raft_consensus.cc:2393] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:13.758172  5606 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:13.783751  5682 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:13.799475  5682 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:13.785708  5667 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.799973  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.800561  1607 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:13.800366  5682 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.800187  5667 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.801595  5682 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:13.778650  5675 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:13.802490  5675 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.803740  5667 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.804774  5675 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:13.808051  2344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.584s (SENT) [suppressed 53 similar messages]
I20260709 12:59:13.809032  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.814308  1526 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:13.758071  5608 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:59:13.814574  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.810501  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.744304  5576 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.809818  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.787065  5607 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.795631  5436 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:13.756935  5671 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:59:13.784660  5661 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:13.817022  1529 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:13.819628  1526 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:13.821314  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 817) took 1230 ms (client timeout 1584 ms). Trace:
I20260709 12:59:13.823804  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.824571  1526 raft_consensus.cc:2376] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12. Re-sending same reply.
I20260709 12:59:13.827111  5617 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.825127  1527 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:13.829355  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.830454  2344 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:13.832020  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:13.825695  1529 rpcz_store.cc:269] 0709 12:59:12.588564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.768421 (+1179857us) service_pool.cc:224] Handling call
0709 12:59:13.819333 (+ 50912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:13.833976  1607 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:13.835948  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:13.834148  5649 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.827701  5617 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.843055  5649 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.845562  5649 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.848904  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:13.849864  2421 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:13.811669  5595 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:13.866019  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.871206  1608 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:13.851606  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.873140  1607 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:13.853164  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:13.819741  5661 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:13.857928  2421 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:13.861878  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.878901  1529 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:13.863801  5667 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:13.885111  1681 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:13.887341  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:13.881917  2344 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:13.811470  5606 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.872356  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:13.842263  5629 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:13.881264  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:13.789639  5666 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:13.882983  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.883908  1604 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:13.888644  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.902715  1607 raft_consensus.cc:2376] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11. Re-sending same reply.
I20260709 12:59:13.788763  5509 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.864500  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2421) took 1772 ms. Trace:
I20260709 12:59:13.903604  1600 rpcz_store.cc:276] 0709 12:59:12.092319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.247214 (+154895us) service_pool.cc:224] Handling call
0709 12:59:13.209779 (+962565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.324673 (+114894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.864299 (+539626us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b540035f050. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:13.864437 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212287232}
I20260709 12:59:13.890125  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.894480  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:13.834586  5664 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.825537  5665 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:13.845436  5617 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:13.907707  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.910036  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:13.881083  1572 leader_election.cc:400] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12.
W20260709 12:59:13.918447  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47339.3us
I20260709 12:59:13.938277  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:13.940779  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 816) took 1352 ms (client timeout 1547 ms). Trace:
I20260709 12:59:13.941428  5665 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.941730  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:13.943892  2423 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:13.881440  5649 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:13.885756  5672 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:13.948275  1525 rpcz_store.cc:269] 0709 12:59:12.588226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.588359 (+   133us) service_pool.cc:224] Handling call
0709 12:59:13.940606 (+1352247us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400198f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:13.940720 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201193856}
I20260709 12:59:13.924659  2455 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:13.897315  5694 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:13.951647  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 69800.3us
I20260709 12:59:13.946497  1572 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:13.955989  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:13.931614  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:13.885010  5589 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:13.958930  1575 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:13.950361  5665 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.910600  5677 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:13.913689  5629 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.964730  2435 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:13.925879  5592 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:13.946877  5312 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.970392  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:13.967869  5605 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:13.897131  5507 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:59:13.983398  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:14.001981  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:13.911557  5590 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:59:14.006562  1600 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:14.011482  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:14.012959  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:13.938253  5577 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:14.000551  5312 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:14.014921  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:14.015587  5605 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:14.015725  5606 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:14.017207  5665 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:14.000490  5677 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:13.968619  5601 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:14.019889  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 61234.1us
I20260709 12:59:13.970988  5501 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:13.968452  5694 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:14.022644  5509 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:14.027406  1600 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:13.999424  5592 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.970712  5584 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:14.002272  5629 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:14.036682  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:14.002915  5595 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:14.040145  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:13.957173  5436 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:13.962970  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:14.047950  5601 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:14.054402  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:13.958529  5672 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:14.089869  5665 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:14.071532  5584 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.096262  5601 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.097400  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 893) took 1661 ms. Trace:
I20260709 12:59:14.097972  2476 rpcz_store.cc:276] 0709 12:59:12.435971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.436120 (+   149us) service_pool.cc:224] Handling call
0709 12:59:14.097070 (+1660950us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400551754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:14.097297 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254373760}
I20260709 12:59:14.098755  5584 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:14.100834  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:14.103363  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:14.104370  1608 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:14.058821  5592 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:14.073661  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 110808us
I20260709 12:59:14.115144  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:14.072475  1575 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:13.966477  5649 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.081795  5677 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.083086  5627 raft_consensus.cc:3055] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:14.084419  5331 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.085407  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:14.133699  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:14.117076  5607 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.134398  1602 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:14.134507  5331 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:14.134876  5607 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.135749  5666 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:13.921386  5664 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.117625  5665 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:14.086397  5606 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:14.106590  2461 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:14.071739  1601 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:14.106616  2421 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:14.107508  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:14.113148  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45362 (request call id 875) took 2551 ms (client timeout 1763 ms). Trace:
I20260709 12:59:14.146795  1608 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:14.116874  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:14.146848  1683 rpcz_store.cc:269] 0709 12:59:11.554458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.565875 (+ 11417us) service_pool.cc:224] Handling call
0709 12:59:14.105874 (+2539999us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540024a4d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:14.106104 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519009536}
I20260709 12:59:14.118460  1649 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:14.119699  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 47297.8us
I20260709 12:59:14.047478  5694 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.123564  2476 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:14.123114  5660 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:14.129282  5649 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:14.135879  1602 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:14.085856  5720 consensus_queue.cc:1059] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.148955  2435 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:14.143381  1600 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:14.146284  1601 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:59:14.150681  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:14.152410  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:14.148629  1575 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:14.125937  5627 raft_consensus.cc:740] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:14.137669  5584 raft_consensus.cc:2804] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:14.155447  2461 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:14.157977  1600 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:14.158847  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:14.160559  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:14.161911  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:14.162652  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:14.156502  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:14.175096  1601 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:14.177690  5649 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:14.178308  5649 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.178882  5649 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:14.179064  5660 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:14.179702  5660 raft_consensus.cc:697] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:14.180614  5660 consensus_queue.cc:237] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:14.171219  5617 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:14.153003  5666 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.186707  1608 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:14.187861  2476 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:59:14.188409  2476 pending_rounds.cc:85] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 7
I20260709 12:59:14.188691  2476 pending_rounds.cc:107] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:59:14.188995  2476 raft_consensus.cc:2889] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:14.190738  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:14.193881  2474 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:14.178383  1602 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:14.196446  1602 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:14.152745  5331 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:14.198685  5331 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:14.170719  5675 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:14.205516  1602 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:14.206540  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:14.210521  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2416) took 2119 ms. Trace:
W20260709 12:59:14.212232  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 811) took 1630 ms (client timeout 1735 ms). Trace:
W20260709 12:59:14.273847  1527 rpcz_store.cc:269] 0709 12:59:12.581888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.582558 (+   670us) service_pool.cc:224] Handling call
0709 12:59:14.212030 (+1629472us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400198054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:14.212161 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2619602176}
I20260709 12:59:14.203972  1601 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:14.211163  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45362 (request call id 897) took 1451 ms. Trace:
I20260709 12:59:14.277045  1682 rpcz_store.cc:276] 0709 12:59:12.759633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.979063 (+219430us) service_pool.cc:224] Handling call
0709 12:59:14.210966 (+1231903us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54001b9754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:14.211095 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407770368}
I20260709 12:59:14.273713  1606 rpcz_store.cc:276] 0709 12:59:12.090633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.092577 (+  1944us) service_pool.cc:224] Handling call
0709 12:59:12.092970 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:12.444620 (+351650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.210146 (+1765526us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54001c5554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:14.210404 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807381888}
I20260709 12:59:14.199368  5608 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:14.284950  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 122362us
W20260709 12:59:14.285200  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.199048  5331 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:14.295745  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 133898us
I20260709 12:59:14.211035  5576 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:14.241513  5584 raft_consensus.cc:697] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:14.212057  5675 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:14.327478  1602 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:14.327721  5697 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:14.419821  5682 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 12:59:14.289736  5608 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.211517  5627 consensus_queue.cc:260] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:14.199942  5665 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.421576  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:14.329777  5507 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.778192  5507 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.484308  5629 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.780242  2423 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 13: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:59:14.464540  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 308193us
I20260709 12:59:14.782807  1649 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:14.314672  5607 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:14.787971  5607 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.291635  5601 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:14.790620  5601 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.791069  5601 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:14.793717  5682 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:14.793996  1575 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:14.328505  5577 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.794946  5577 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.794591  5682 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:14.800966  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:14.490597  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 170478us
I20260709 12:59:14.312073  5669 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:14.788694  5607 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:14.841821  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 44930us
W20260709 12:59:14.445802  5717 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:59:14.496184  5666 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:14.318605  5331 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:14.873407  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.021s
I20260709 12:59:14.863410  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:14.723297  5592 consensus_meta.cc:287] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.597s	user 0.002s	sys 0.008s
W20260709 12:59:14.877200  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 94480.9us
W20260709 12:59:14.873929  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.000s	sys 0.022s
I20260709 12:59:14.591897  5606 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:14.822528  5608 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:14.881531  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 86044.8us
I20260709 12:59:14.878854  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:14.860311  5627 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:14.899741  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:14.498469  5312 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:14.915019  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:14.916519  1674 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:14.917245  5312 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:14.883219  5726 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.496840  5675 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:14.910190  5649 consensus_meta.cc:287] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.731s	user 0.014s	sys 0.000s
I20260709 12:59:14.900213  5725 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.914817  5666 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.879787  5592 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:14.861052  5669 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:14.561542  5584 consensus_queue.cc:237] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:14.928960  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:14.925639  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:14.925702  1678 raft_consensus.cc:1240] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:59:14.929759  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 80855us
I20260709 12:59:14.926695  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:14.933501  1676 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:14.934154  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:14.969331  1674 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:14.923353  5731 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.934877  5649 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:14.935532  1679 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:14.932886  1677 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:14.920161  5638 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:14.918892  5732 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:14.972056  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:14.986409  1602 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:14.973484  1676 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:14.936480  5735 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:14.929487  5651 consensus_meta.cc:287] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.118s	user 0.017s	sys 0.001s
I20260709 12:59:14.940348  5577 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:14.945099  5740 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:15.006644  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2417) took 2915 ms. Trace:
I20260709 12:59:15.007054  1603 rpcz_store.cc:276] 0709 12:59:12.091065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.106059 (+ 14994us) service_pool.cc:224] Handling call
0709 12:59:12.107327 (+  1268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.901362 (+2794035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.901408 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:14.901463 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:14.901507 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.006418 (+104911us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b54002684d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:15.006469 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.006587 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6425069440}
I20260709 12:59:15.008718  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:15.010982  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 807) took 1263 ms. Trace:
W20260709 12:59:15.011153  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 85664.7us
I20260709 12:59:15.011986  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:15.005545  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2144) took 2585 ms (client timeout 1924 ms). Trace:
I20260709 12:59:14.931377  5733 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:15.005700  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 812) took 1120 ms. Trace:
I20260709 12:59:15.011540  2428 rpcz_store.cc:276] 0709 12:59:13.747708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.748151 (+   443us) service_pool.cc:224] Handling call
0709 12:59:15.006861 (+1258710us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540005b754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:15.010901 (+  4040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894662912}
I20260709 12:59:15.016197  5742 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:15.016947  5742 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:15.015851  2421 rpcz_store.cc:276] 0709 12:59:13.885172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.885740 (+   568us) service_pool.cc:224] Handling call
0709 12:59:14.106336 (+220596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.146526 (+ 40190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.005506 (+858980us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400551750. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:15.005648 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506217344}
I20260709 12:59:15.016973  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.018086  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:15.014024  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 808) took 1167 ms. Trace:
I20260709 12:59:15.018115  2428 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:15.018795  2451 rpcz_store.cc:276] 0709 12:59:13.846954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.848168 (+  1214us) service_pool.cc:224] Handling call
0709 12:59:13.848527 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.886778 (+ 38251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.886807 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:13.887226 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.044552 (+157326us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:14.044611 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.009647 (+965036us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b54005235d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:15.009695 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.009750 (+    55us) raft_consensus.cc:1685] finished
0709 12:59:15.009762 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.013966 (+  4204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19935,"raft.queue_time_us":2993,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":11877,"spinlock_wait_cycles":86661504,"thread_start_us":73121,"threads_started":1,"wal-append.queue_time_us":100559}
I20260709 12:59:15.021973  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:15.022639  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.014581  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:14.982868  5638 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.021217  2428 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:59:15.012873  1605 rpcz_store.cc:269] 0709 12:59:12.420112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.354411 (+934299us) service_pool.cc:224] Handling call
0709 12:59:15.005323 (+1650912us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54001d0454. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:15.005479 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387406592}
I20260709 12:59:15.024149  2451 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:14.994751  5617 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.940871  5725 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.065603  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:14.938905  5734 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:59:14.997787  5606 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:15.070185  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 137150us
I20260709 12:59:15.073259  5741 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:15.073136  5606 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.025807  5673 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:15.073784  5741 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.072247  2435 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:15.064040  5577 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:15.069029  5617 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.089913  5617 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.090570  5617 consensus_queue.cc:1059] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:15.093006  5501 raft_consensus.cc:3055] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:15.093449  5501 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:15.094419  1607 raft_consensus.cc:2393] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:15.064949  5638 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.076376  1602 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:15.073618  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:14.929178  5726 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:15.080806  5661 consensus_meta.cc:287] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.180s	user 0.016s	sys 0.000s
I20260709 12:59:15.075112  5728 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.120946  5661 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.002938  5732 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.106460  5669 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:15.065996  5733 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.099545  5577 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.124992  5732 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.025187  5740 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.008919  5651 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:15.112248  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 92932.4us
I20260709 12:59:14.997071  5731 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.120144  5592 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:15.099710  5741 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:15.003242  5735 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.151772  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:15.154474  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:15.160439  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 148530us
I20260709 12:59:15.123363  5661 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:15.125995  5577 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.113925  5607 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:15.169755  2421 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:15.166643  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:15.175820  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.185909  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:15.194114  5606 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.195786  5672 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:15.196560  5726 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.171680  5732 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:15.197691  5725 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.189940  5592 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:15.178206  5501 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.165179  5743 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:15.125821  5733 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.212651  5734 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:15.227793  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.212124  5661 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:15.256668  1680 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:15.223289  5592 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:15.261461  5592 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.225262  5501 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.256206  5743 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:15.271119  5743 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.285491  5331 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.287949  5331 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.209789  5748 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:59:15.299620  5651 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:15.332229  5735 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.334527  5731 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.356204  5740 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.255977  5606 consensus_queue.cc:1059] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:59:15.358973  5606 raft_consensus.cc:3055] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:15.359603  5606 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:15.218955  5746 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 12:59:15.362905  5746 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:15.363389  5746 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:15.258229  5734 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.365574  5734 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.256886  5649 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:15.329773  5601 consensus_meta.cc:287] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
I20260709 12:59:15.401901  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:15.407539  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 221702us
W20260709 12:59:15.404982  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 331419us
I20260709 12:59:15.408001  2435 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:15.410000  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:15.412583  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2422) took 3317 ms. Trace:
I20260709 12:59:15.413038  1609 rpcz_store.cc:276] 0709 12:59:12.097070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.449108 (+1352038us) service_pool.cc:224] Handling call
0709 12:59:13.458554 (+  9446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.555039 (+ 96485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.555086 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.555146 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:13.555191 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.412169 (+1856978us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b54002aa8d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:15.412355 (+   186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.412509 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221393280}
I20260709 12:59:15.416724  1609 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:15.419224  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:15.418608  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:15.421707  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2211) took 2652 ms (client timeout 2128 ms). Trace:
W20260709 12:59:15.422420  1681 rpcz_store.cc:269] 0709 12:59:12.769707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.895784 (+126077us) service_pool.cc:224] Handling call
0709 12:59:15.421161 (+2525377us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b540015f754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:15.421641 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225122688}
I20260709 12:59:15.433815  1683 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:15.364638  5746 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.437237  5746 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:15.361066  5606 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.410760  5666 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:15.439672  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:15.465752  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:15.466552  1674 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:15.468577  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.468737  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:15.469259  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:15.470574  1678 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.469269  1676 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:15.470067  1679 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:15.472325  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.413304  5601 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.440174  5748 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:15.473903  1609 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:15.482299  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.483106  1677 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:15.472860  1676 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:15.446079  5733 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:15.471109  5608 consensus_meta.cc:287] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.002s
I20260709 12:59:15.480883  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.489857  1675 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:59:15.479843  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:15.493055  2451 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:15.453681  5606 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:15.493978  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.493984  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.494897  2428 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:15.495402  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2434) took 1591 ms. Trace:
I20260709 12:59:15.495864  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.494905  5605 raft_consensus.cc:3055] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:15.496696  5605 raft_consensus.cc:740] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:15.497771  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:15.497597  5605 consensus_queue.cc:260] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.498548  1600 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:15.498733  5605 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.495759  1608 rpcz_store.cc:276] 0709 12:59:13.903932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.172660 (+268728us) service_pool.cc:224] Handling call
0709 12:59:14.173076 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.187427 (+ 14351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.495215 (+1307788us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b54000ec754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:15.495358 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30623104}
I20260709 12:59:15.491961  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:15.502718  1609 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:15.503317  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:15.504281  2451 raft_consensus.cc:2393] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:15.499527  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:15.438102  5741 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.484236  5661 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:15.495880  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.531498  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.510453  1600 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:15.534675  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.470671  5735 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:15.529322  1674 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:15.763136  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:15.538252  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.530100  5748 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.558326  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:15.763839  1678 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:15.558795  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:15.530529  5754 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:59:15.501946  5733 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.558331  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:15.511230  5608 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.591301  5697 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.592305  5720 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:15.661728  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 449662us
W20260709 12:59:15.678050  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.694962  5644 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.780867  5644 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.710165  5719 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.711150  5606 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:15.762921  5735 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.782367  5606 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.782600  5697 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.736506  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.784449  2435 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:15.502429  5732 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.447510  5751 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:59:15.738719  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:15.737227  1647 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:15.759176  1609 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:15.621465  5519 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:15.478760  5675 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.829948  5675 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.831225  5642 raft_consensus.cc:3055] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:15.831693  5642 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:15.832518  5675 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.763420  1679 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:15.763737  1680 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.765007  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.833659  5749 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:15.833684  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47496 (request call id 20) took 2164 ms. Trace:
I20260709 12:59:15.834170  1678 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:15.834784  5601 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:15.834506  2475 rpcz_store.cc:276] 0709 12:59:13.658323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.658830 (+   507us) service_pool.cc:224] Handling call
0709 12:59:14.226620 (+567790us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4c004ff780. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25cfc64a20 00007f25cfc75a29 00007f25cfc3b644 00007f25cfc62f2d 00007f25cfc62b93 00007f25d1992c92 00007f25d199284a 00007f25d696060a 00007f25cfee67d4 00007f25cfee6762 00007f25cfee6691
0709 12:59:15.822778 (+1596158us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b5400580a54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1992853 00007f25d696060a 00007f25cfee67d4 00007f25cfee6762 00007f25cfee6691 00007f25cfee660c 00007f25cfee58c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:15.822902 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142171776}
I20260709 12:59:15.835505  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.836102  1678 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
W20260709 12:59:15.836768  5759 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:59:15.836992  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:15.837808  1678 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:15.838511  5669 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:15.839062  5669 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.839684  5669 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.771344  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:15.766505  5638 consensus_meta.cc:287] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.006s
I20260709 12:59:15.772725  5748 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.780211  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:15.795524  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.785645  1608 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:15.766952  5728 consensus_meta.cc:287] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.014s
I20260709 12:59:15.824003  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:15.824812  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 262373us
I20260709 12:59:15.819937  5720 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.828743  5519 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.763758  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:15.850745  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.851310  1677 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:15.852100  1678 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:15.947424  1674 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:15.833175  5642 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.834303  5749 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.949151  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 830) took 2163 ms. Trace:
I20260709 12:59:15.949352  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.950117  1674 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:15.950846  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:15.951298  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 1.99781e+06us
I20260709 12:59:15.837258  5734 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.951012  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.955552  1608 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:15.955906  1674 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:15.956722  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:15.957258  1674 raft_consensus.cc:2393] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:15.918525  2339 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:15.907827  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:15.958175  1682 raft_consensus.cc:3060] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:15.958737  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:15.930735  1680 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:15.959983  1674 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:15.906683  5757 log.cc:927] Time spent T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:59:15.826581  5719 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.961174  5585 consensus_queue.cc:1059] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:59:15.966755  5719 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:15.852941  5741 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:15.967396  5719 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:15.967831  5719 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:15.968433  5719 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.969029  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:15.941860  1609 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:15.972138  5590 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:15.972589  5590 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:15.972908  1609 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:15.973531  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 714) took 1069 ms. Trace:
I20260709 12:59:15.974011  1609 rpcz_store.cc:276] 0709 12:59:14.903858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.972383 (+1068525us) service_pool.cc:224] Handling call
0709 12:59:15.972726 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.973302 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.973482 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:15.949612  1528 rpcz_store.cc:276] 0709 12:59:13.777523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.777805 (+   282us) service_pool.cc:224] Handling call
0709 12:59:13.778123 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.778354 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:59:13.808869 (+ 30515us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.910664 (+101795us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.091673 (+1181009us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b1800233e00. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab522 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:59:15.940010 (+848337us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b1800233e00. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce825c0a 00007f25d7f65219 00007f25ce8ada40 00007f25ce8a84e4 00007f25ce8a8455 00007f25d1990060 00007f25d19a2716 00007f25d19b3287 00007f25d19b3208
0709 12:59:15.940170 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:15.940231 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:15.940280 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.940350 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.940470 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19566,"prepare.queue_time_us":42072,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":2049339,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":16625,"spinlock_wait_cycles":41136768,"thread_start_us":126340,"threads_started":2,"wal-append.queue_time_us":132734,"wal-append.run_cpu_time_us":1883,"wal-append.run_wall_time_us":1001892}
I20260709 12:59:15.917575  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:15.973937  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2423) took 3876 ms. Trace:
I20260709 12:59:15.975615  1679 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:15.816102  5584 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.948590  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:15.878427  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:15.922784  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.979295  5741 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:15.979671  5697 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:15.980561  5741 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:59:15.962810  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.970153  5509 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:15.971517  1682 raft_consensus.cc:2468] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:15.853307  5731 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.975811  1604 rpcz_store.cc:276] 0709 12:59:12.097494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.457658 (+1360164us) service_pool.cc:224] Handling call
0709 12:59:13.883696 (+426038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.902298 (+ 18602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.973767 (+2071469us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400406fd0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:15.973886 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978903424}
I20260709 12:59:15.840528  5644 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:15.991356  5731 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.933496  5651 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:15.992973  5651 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.995883  5651 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:15.888096  5728 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:15.986090  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 354759us
I20260709 12:59:16.001432  1602 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:59:16.002221  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.964705  1674 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:15.898797  5657 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.004303  5657 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.987030  1678 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:16.008409  1678 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:15.991871  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:16.009771  1604 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:15.915552  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:15.988185  5584 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.986397  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:45362
I20260709 12:59:15.973433  5590 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:15.842141  5732 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.981681  5608 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:15.855304  5638 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:15.988940  5733 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:16.016736  5741 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:16.117760  1420 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.302s	user 0.007s	sys 0.016s
I20260709 12:59:16.113399  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2160) took 1202 ms. Trace:
I20260709 12:59:16.112939  1606 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:16.111570  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 711) took 1215 ms. Trace:
I20260709 12:59:16.127619  1602 rpcz_store.cc:276] 0709 12:59:14.896374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.122723 (+226349us) service_pool.cc:224] Handling call
0709 12:59:15.123002 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:16.001982 (+878980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.111202 (+109220us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54001d0954. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:16.111438 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019153792}
I20260709 12:59:16.128105  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 712) took 1231 ms. Trace:
W20260709 12:59:16.112491  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2161) took 2409 ms (client timeout 2246 ms). Trace:
I20260709 12:59:16.128942  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:16.024360  1681 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:16.129136  1607 rpcz_store.cc:269] 0709 12:59:13.703281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.100450 (+397169us) service_pool.cc:224] Handling call
0709 12:59:16.112254 (+2011804us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54002ab2d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:16.112421 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2282060032}
I20260709 12:59:16.018177  1677 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.115794  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:16.130249  1677 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:16.130411  1601 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:59:16.129865  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:16.076614  1600 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:16.047140  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:16.131271  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 132734us
I20260709 12:59:16.015568  1674 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:59:16.060478  2474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 900) took 2101 ms (client timeout 1518 ms). Trace:
W20260709 12:59:16.132098  2474 rpcz_store.cc:269] 0709 12:59:13.959226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.959566 (+   340us) service_pool.cc:224] Handling call
0709 12:59:16.060209 (+2100643us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540059f954. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:16.060357 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436389632}
I20260709 12:59:16.124326  1678 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:16.128475  1603 rpcz_store.cc:276] 0709 12:59:14.896608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.413848 (+517240us) service_pool.cc:224] Handling call
0709 12:59:15.424335 (+ 10487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:15.439922 (+ 15587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:15.439954 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:15.441782 (+  1828us) log.cc:844] Serialized 26 byte log entry
0709 12:59:15.493263 (+ 51481us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:15.493314 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.493393 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:16.025635 (+532242us) raft_consensus.cc:1685] finished
0709 12:59:16.025658 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.128021 (+102363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15384,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":51030,"threads_started":1,"wal-append.queue_time_us":295867}
I20260709 12:59:16.026530  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:16.126521  1683 rpcz_store.cc:276] 0709 12:59:14.911118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.912682 (+  1564us) service_pool.cc:224] Handling call
0709 12:59:15.421274 (+508592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.434423 (+ 13149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.113194 (+678771us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b540015f750. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:16.113336 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168564480}
W20260709 12:59:16.137882  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 179214us
I20260709 12:59:16.135933  1607 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:16.138024  1679 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:16.139679  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:16.136803  1572 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:16.092587   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:16.147378  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:16.147787  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:16.148990  1678 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:16.154096  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:16.061758  5746 consensus_meta.cc:287] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.006s
I20260709 12:59:16.176831  1604 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:16.018419  5748 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:16.178581  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:16.179895  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:16.207261  2339 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:16.208186  1681 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:16.155826  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:16.177608  1603 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:16.024237  5732 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:16.185077  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 48355.8us
I20260709 12:59:16.178375  5590 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:16.185925  5664 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:16.059118  5507 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:16.187424  5584 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.149327  5606 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.220193  1602 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:16.178973  5754 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:59:16.188851  5729 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:16.221400  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:16.221779  5729 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.192128  5738 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:16.193342  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.222628  5729 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:16.223278  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.223426  1679 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:16.224629  1679 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:59:16.195591  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.195948  5611 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:16.017680  5519 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.197590  5632 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.198009  5667 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.198414  5612 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.198807  5684 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.178507  5595 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:16.199427  5622 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.200438  5627 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.200994  5633 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:16.201776  5432 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.201810  5695 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.202876  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:16.202446  5597 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:16.203904  5623 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:16.231060  5574 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.230640  5056 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:16.286315  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 83511.4us
I20260709 12:59:16.207340  1677 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.019826  5735 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:16.212112  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:16.217823  1572 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:16.109340  5720 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:16.209442  5608 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.296392  5608 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:16.297159  1677 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:16.221983  1602 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:16.191668  1678 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:16.194957  5585 raft_consensus.cc:3055] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:16.302386  5585 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:16.233969  5734 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:16.148519  5733 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.310125  5733 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.312662  5733 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:16.315757  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.317330  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.318044  1532 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
W20260709 12:59:16.322229  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 104501us
I20260709 12:59:16.323488  1572 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:16.145339  5629 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:16.017225  5697 consensus_queue.cc:1059] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.194s
I20260709 12:59:16.149878  5617 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.243561  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:16.400447  1601 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:16.178009  5669 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:16.284750  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.212477  5671 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:16.212333  5651 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:16.231216  5605 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:16.230700  5610 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.402045  5584 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:16.208630  2339 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:16.303313  5585 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:16.226614  1500 connection.cc:256] RPC call timeout handler was delayed by -1.4920749940000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 12:59:16.228083  5587 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:16.376019  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.371568  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:16.407294  1678 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:16.408043  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.326550  1602 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:16.380684  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:16.381778  1649 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:16.383261  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.388638  1530 raft_consensus.cc:3055] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:16.410925  1530 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:16.390092  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.412928  1531 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:16.414134  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.415583  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.242226  5595 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:59:16.398819  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 75354.7us
W20260709 12:59:16.403498  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.416708  5595 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:16.417109  1572 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:16.314982  5357 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:16.247681  5737 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.411284  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:16.411679  1530 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.428491  1683 raft_consensus.cc:2376] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6. Re-sending same reply.
I20260709 12:59:16.242748  5667 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:16.428500  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 219925us
W20260709 12:59:16.431967  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 204322us
I20260709 12:59:16.411523  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:16.433403  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:16.245049  5684 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:16.402401  5610 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.244969  5612 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.426680  1531 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:16.422744  1679 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:16.430724  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:16.245114  5611 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:16.432241  2339 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:16.421553  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:16.443723  1649 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:16.426618  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.444213  1678 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
W20260709 12:59:16.444314  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 151857us
I20260709 12:59:16.437386  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:16.268529  5627 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.406857  5734 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.440485  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:16.445202  1677 raft_consensus.cc:2376] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
I20260709 12:59:16.316741  5432 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:16.409994  5671 raft_consensus.cc:697] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:16.423108  5733 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:59:16.447688  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.426764  5357 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.402676  5584 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:16.410319  5617 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.242432  5632 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.283639  5633 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.268257  5622 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.452739  1534 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:16.458177  1533 raft_consensus.cc:2393] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:16.459457  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:16.459806  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:16.460018  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:16.429581  5597 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:16.316560  5695 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.435660  5767 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:16.461200  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.470291  1528 raft_consensus.cc:2393] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:16.431206  5651 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:16.468909  1678 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:16.382638  5056 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.421662  5668 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:59:16.439394  5592 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:16.382484  5574 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:16.449350  2423 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 1007) took 2333 ms (client timeout 2213 ms). Trace:
I20260709 12:59:16.426007  5587 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.465143  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:16.466619  1683 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:16.932334  1679 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:59:16.513859  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 172d54128ab740c980d9c27aa0ff1761 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3cabc5110903443ba3beb5cbb14afa91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:16.429757  5606 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:16.933486  1416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 422720us
I20260709 12:59:16.439134  5735 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:16.512068  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 54219.8us
I20260709 12:59:16.934506  2476 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:16.974099  2476 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:16.512315  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:16.935812  2428 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:16.975250  2476 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.971378   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:16.936604  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:16.448000  5585 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:16.990623  1572 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:16.575029  5719 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.005s
I20260709 12:59:17.003924  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2180) took 1535 ms. Trace:
I20260709 12:59:16.933858  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.516390  1531 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:16.935022  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:16.953313  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 152258us
W20260709 12:59:16.956794  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.933812  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:16.461992  5722 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.800904  5589 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.923171  5684 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.460811  5509 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:16.461812  5732 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:16.991413  5617 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:16.577518  5768 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 12:59:16.580873  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.470611  5697 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.540s
I20260709 12:59:16.484611  5754 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.526s
I20260709 12:59:16.514429  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.027796  2435 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:16.994590  1678 raft_consensus.cc:2376] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11. Re-sending same reply.
I20260709 12:59:17.029980  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:17.031260  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:17.032128  1678 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:16.997745  1532 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:16.934937  5667 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.035197  1531 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:16.575479  5682 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.973536  5597 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.966843  5728 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.987280  5644 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:59:17.044749  5574 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.045346  5644 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.045913  5644 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.048630  5644 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.050165  5617 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:16.853127  5595 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.051789  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:16.994607  5592 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.053056  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.053490  5595 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.708433  5623 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.291s
I20260709 12:59:17.056104  5592 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.058033  1534 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:16.999742  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.059418  1679 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:17.060346  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.060948  1679 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
W20260709 12:59:17.062150  5782 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:59:17.063697  5780 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:59:17.001670  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:17.064929  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 722) took 1081 ms. Trace:
W20260709 12:59:17.065405  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 63815.1us
I20260709 12:59:17.002043  5584 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.438772  5737 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.003094  1527 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:17.007150  1683 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:17.067574  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:16.576037  5675 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.068362  5737 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.068849  5675 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.069536  2475 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:16.939983  5767 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.070303  5767 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:17.071040  5675 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:16.968077  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.024s	sys 0.032s
W20260709 12:59:17.071722  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.024s	sys 0.032s
I20260709 12:59:17.072566  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 838) took 3117 ms. Trace:
W20260709 12:59:16.937160  2423 rpcz_store.cc:269] 0709 12:59:14.116430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.116568 (+   138us) service_pool.cc:224] Handling call
0709 12:59:16.449062 (+2332494us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b5400783554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:16.449246 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454053632}
I20260709 12:59:16.858078  5669 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:16.802428  5733 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.074494  5697 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:17.072933  1525 rpcz_store.cc:276] 0709 12:59:13.955366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.961771 (+  6405us) service_pool.cc:224] Handling call
0709 12:59:14.029123 (+ 67352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:16.137377 (+2108254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:16.137416 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:16.147483 (+ 10067us) log.cc:844] Serialized 52 byte log entry
0709 12:59:16.300193 (+152710us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:16.410932 (+110739us) log.cc:844] Serialized 14 byte log entry
0709 12:59:17.072148 (+661216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.072253 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.072307 (+    54us) raft_consensus.cc:1685] finished
0709 12:59:17.072324 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.072499 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2076314,"prepare.queue_time_us":212392,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":59,"raft.queue_time_us":2186011,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":42869,"thread_start_us":883289,"threads_started":3,"wal-append.queue_time_us":112391}
I20260709 12:59:16.484035  5746 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.075585  5509 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:17.075592  5746 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.076107  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.004333  1607 rpcz_store.cc:276] 0709 12:59:15.468463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.144485 (+676022us) service_pool.cc:224] Handling call
0709 12:59:16.148876 (+  4391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:16.193752 (+ 44876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:16.193782 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:16.194469 (+   687us) log.cc:844] Serialized 52 byte log entry
0709 12:59:16.440282 (+245813us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:16.460456 (+ 20174us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.490811 (+ 30355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.490934 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.003702 (+512768us) raft_consensus.cc:1685] finished
0709 12:59:17.003723 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.003865 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65411,"prepare.queue_time_us":20604,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":87545,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":6248,"thread_start_us":245445,"threads_started":1,"wal-append.queue_time_us":340291}
I20260709 12:59:17.077353  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.078794  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.080540  1525 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:17.081204  5667 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:17.081703  5667 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.082701  1525 raft_consensus.cc:1275] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:17.065407  1603 rpcz_store.cc:276] 0709 12:59:15.983457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.296388 (+312931us) service_pool.cc:224] Handling call
0709 12:59:16.296723 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:16.297046 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:16.297073 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:16.297550 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.423850 (+126300us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:16.423891 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.423955 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.064673 (+640718us) raft_consensus.cc:1685] finished
0709 12:59:17.064702 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.064869 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1378,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":125923,"threads_started":1,"wal-append.queue_time_us":459555}
I20260709 12:59:17.082103  5667 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:17.085026  5651 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.087558  5623 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:16.705739  5671 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.089013  5623 consensus_queue.cc:1059] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:16.858557  5611 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.531302  5612 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:16.571954  5432 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:16.449966  5664 consensus_queue.cc:1059] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.535s
I20260709 12:59:16.973917  5735 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.450261  5751 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:17.011438  5519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.006s
W20260709 12:59:16.984189  5745 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.011s	sys 0.014s
W20260709 12:59:16.856315  5729 consensus_meta.cc:287] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
I20260709 12:59:16.967363  5606 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:17.033656  5684 raft_consensus.cc:3055] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:17.003070  5734 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:16.512579  5720 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.036336  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.144284  1678 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
W20260709 12:59:17.139324  5768 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:16.530792  5577 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.488s
I20260709 12:59:17.038340  1572 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:17.043668  5728 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.066238  5642 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.143509  5606 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:17.074579  5733 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:16.967002  5357 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:17.075045  5697 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:17.178475  5697 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.180163  5697 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:17.076793  5509 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.143405  5729 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.089675  5574 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:16.853986  5610 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:17.194325  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2161) took 2283 ms (client timeout 1736 ms). Trace:
I20260709 12:59:17.194506  1682 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:17.194772  1675 rpcz_store.cc:269] 0709 12:59:14.911377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.913308 (+  1931us) service_pool.cc:224] Handling call
0709 12:59:17.194147 (+2280839us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54002800d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:17.194263 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276760320}
I20260709 12:59:17.195883  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2226) took 1718 ms. Trace:
W20260709 12:59:17.196285  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 721) took 1349 ms (client timeout 1621 ms). Trace:
W20260709 12:59:17.196841  1600 rpcz_store.cc:269] 0709 12:59:15.847140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.906943 (+ 59803us) service_pool.cc:224] Handling call
0709 12:59:17.196102 (+1289159us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b54000ec254. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:17.196228 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139436928}
I20260709 12:59:17.182468  5633 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.198334  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2167) took 2877 ms. Trace:
I20260709 12:59:17.198537  5657 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.198730  1606 rpcz_store.cc:276] 0709 12:59:14.321279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.072052 (+750773us) service_pool.cc:224] Handling call
0709 12:59:16.112439 (+1040387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:16.127343 (+ 14904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.198130 (+1070787us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002ab2d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:17.198282 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359258496}
I20260709 12:59:17.200421  5638 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:17.057286  5769 log.cc:927] Time spent T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.611s	user 0.002s	sys 0.016s
W20260709 12:59:17.093113  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.009s	sys 0.021s
I20260709 12:59:16.708597  5784 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.441s
I20260709 12:59:17.027310  5627 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.010527  5719 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.090678  5746 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.025238  5589 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.091706  5587 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.226437  2474 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:17.227671  5589 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.146569  5622 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.135360  5735 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:17.142877  5745 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.011s	sys 0.014s
I20260709 12:59:17.019872  5722 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.232046  5722 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:17.138125  5519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.009s	sys 0.006s
I20260709 12:59:17.154338  1526 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:17.158138  5734 raft_consensus.cc:697] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:17.227730  5719 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.234480  5734 consensus_queue.cc:237] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.061098  1420 maintenance_manager.cc:643] P d61986b01a0f484cbe47a3797e9dc27f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.611s	user 0.227s	sys 0.060s Metrics: {"bytes_written":30279,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":192060,"dirs.run_cpu_time_us":512,"dirs.run_wall_time_us":27751,"drs_written":1,"lbm_read_time_us":406,"lbm_reads_lt_1ms":4,"lbm_write_time_us":293916,"lbm_writes_10-100_ms":11,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":143665,"threads_started":2,"update_count":11,"wal-append.queue_time_us":254463}
I20260709 12:59:17.164144  5667 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:17.165722  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 127443us
I20260709 12:59:17.189602  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1011) took 3017 ms. Trace:
W20260709 12:59:17.238699  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 157905us
I20260709 12:59:17.238898  2421 rpcz_store.cc:276] 0709 12:59:14.172410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.018051 (+845641us) service_pool.cc:224] Handling call
0709 12:59:15.018322 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.181071 (+162749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.189347 (+2008276us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400475754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:17.189522 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347543808}
I20260709 12:59:17.181478  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.238308  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:17.165539  5577 consensus_queue.cc:1243] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 3cabc5110903443ba3beb5cbb14afa91 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:17.193310  5729 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.165882  5644 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:17.201182  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.009s	sys 0.021s
W20260709 12:59:17.247479  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 840334us
I20260709 12:59:17.143548  5684 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:17.242466  1572 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:17.196208  1682 rpcz_store.cc:276] 0709 12:59:15.477173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.990820 (+513647us) service_pool.cc:224] Handling call
0709 12:59:17.194312 (+1203492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:17.194939 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.195684 (+   745us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002800d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:17.195830 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2463313664}
I20260709 12:59:17.244498  2461 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:17.240854  2423 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
I20260709 12:59:17.185966  5436 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:17.265748  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.006s	sys 0.013s
W20260709 12:59:17.310111  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.006s	sys 0.013s
I20260709 12:59:17.183033  5695 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.181773  5632 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.316447  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 716) took 2165 ms. Trace:
I20260709 12:59:17.316916  5632 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:17.316865  1609 rpcz_store.cc:276] 0709 12:59:15.151419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.974801 (+823382us) service_pool.cc:224] Handling call
0709 12:59:15.975084 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:15.976656 (+  1572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:15.976684 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:16.123150 (+146466us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.228351 (+105201us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:16.228392 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.228471 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.056508 (+828037us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:17.291851 (+235343us) raft_consensus.cc:1685] finished
0709 12:59:17.291872 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.316369 (+ 24497us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1216,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8601,"spinlock_wait_cycles":9611136,"thread_start_us":104713,"threads_started":1,"wal-append.queue_time_us":259129}
I20260709 12:59:17.318923  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.319181  5632 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:17.319583  1609 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:17.319767  5632 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:17.320636  4932 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:17.273850  5633 consensus_queue.cc:1059] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 12:59:17.244354  5768 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:59:17.273180  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.006s	sys 0.014s
W20260709 12:59:17.327332  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.006s	sys 0.014s
W20260709 12:59:17.327690  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 880931us
I20260709 12:59:17.329250  1498 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:17.334622  1603 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:17.282725  1421 maintenance_manager.cc:419] P d61986b01a0f484cbe47a3797e9dc27f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10840 bytes on disk
I20260709 12:59:17.339151  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.187445  5733 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.305877  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.340554  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.342418  1602 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:17.307919  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.343166  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.223918  5657 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.271929  5644 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:17.309127  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 104103us
I20260709 12:59:17.249449  5627 consensus_queue.cc:1059] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:59:17.314706  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.285207  5574 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:17.315732  5587 consensus_queue.cc:1059] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:17.330216  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.370438  1527 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:17.371501  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.330585  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.330940  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.249192  5746 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:17.331900  5767 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.329908  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.329908  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 912) took 1591 ms. Trace:
I20260709 12:59:17.276117  5577 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:17.334628  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 92329.8us
I20260709 12:59:17.341238  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.341251  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.341684  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.384990  1572 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:17.344772  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.374951  2451 rpcz_store.cc:276] 0709 12:59:15.738676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.738793 (+   117us) service_pool.cc:224] Handling call
0709 12:59:15.739124 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:15.821907 (+ 82783us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:15.939619 (+117712us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.087796 (+148177us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.088268 (+   472us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:16.088754 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.089096 (+   342us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:16.089141 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.193669 (+1104528us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b5400720e54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:17.193720 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.329694 (+135974us) raft_consensus.cc:1685] finished
0709 12:59:17.329715 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.329846 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32824,"prepare.queue_time_us":138728,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":33157,"raft.run_cpu_time_us":587,"raft.run_wall_time_us":20272,"spinlock_wait_cycles":108546432,"thread_start_us":175107,"threads_started":2,"wal-append.queue_time_us":287247}
I20260709 12:59:17.386468  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.274021  5610 consensus_queue.cc:1059] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:59:17.387763  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.346012  1606 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:17.388365  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.285200  5585 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.361657  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.361168  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.393966  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.394070  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.394546  1609 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:17.394676  2451 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:17.361753  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.363972  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.272202  5622 consensus_queue.cc:1059] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:59:17.364230  1420 maintenance_manager.cc:643] P d61986b01a0f484cbe47a3797e9dc27f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.027s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":333,"lbm_reads_lt_1ms":4}
I20260709 12:59:17.368633  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.369184  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.358879  5638 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.394773  1532 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:17.392148  1572 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:17.307224  5623 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:59:17.395684  1603 raft_consensus.cc:2393] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:17.396126  5797 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.415741  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.397677  1602 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:17.398731  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.417207  1528 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:17.395675  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.402341  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.404860  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.426577  1532 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:17.401947  5795 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.320696  5632 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.410853  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:17.414320  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 118227us
I20260709 12:59:17.307570  5790 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:59:17.488250  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.417603  1609 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:17.428587  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.405267  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.464424  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:17.464849  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 72794.9us
W20260709 12:59:17.490965  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 46114.9us
I20260709 12:59:17.491091  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:17.491772  2423 raft_consensus.cc:2368] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11.
I20260709 12:59:17.397817  5745 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:17.361402  5657 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.487021  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:17.489662  1532 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:17.397320  5746 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:17.343936  5684 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:17.518565  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.403719  5651 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:17.522290  1532 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:17.528023  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.529315  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.529901  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.530092  1675 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:17.530543  1678 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:17.528731  1676 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:17.535440  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.390214  5357 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.541637  1525 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:59:17.543547  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.390197  5577 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.402843  5585 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.512933  5734 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:17.550014  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.418655  5638 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.552515  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.517453  5728 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.524029  5622 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:17.573093  1682 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:17.540800  5745 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:17.595357  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.587546  5722 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:59:17.596848  5792 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:59:17.597630  5612 raft_consensus.cc:3055] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:17.587808  5589 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:59:17.598286  5796 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:17.598800  5796 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.599165  5796 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.598163  5612 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:17.608214  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.612093  1532 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:17.536978  1572 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:17.614266  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 77369.4us
I20260709 12:59:17.616277  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.579128  5734 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.576556  5767 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.589111  5622 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.625538  1572 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:17.626168  5612 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.630561  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.632062  1678 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:17.630870  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.576574  5694 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:59:17.631989  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.630971  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.633708  1533 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:17.633805  1532 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:17.634888  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.635521  1675 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 4.
I20260709 12:59:17.635360  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:17.636467  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.636533  5752 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:17.637115  5752 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:17.637542  5752 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.641009  5804 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
W20260709 12:59:17.641598  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45362 (request call id 919) took 2159 ms (client timeout 1823 ms). Trace:
I20260709 12:59:17.491464  5795 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:17.642087  1681 rpcz_store.cc:269] 0709 12:59:15.482486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.771062 (+288576us) service_pool.cc:224] Handling call
0709 12:59:17.641311 (+1870249us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000f9e54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:17.641498 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403276032}
I20260709 12:59:17.643463  1680 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:17.644789  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.523422  5644 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.645692  1681 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:17.539878  5651 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:17.647938  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.648054  1527 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:17.615550  5675 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.648568  1527 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:17.648938  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.651641  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:17.652137  1675 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:17.650249  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.576625  5719 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:59:17.625000  5734 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:17.656708  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.672964  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:17.634196  5622 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:17.678261  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:17.679400  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:17.683907  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:17.684311  1527 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.684633  1681 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:17.661366  5675 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.685847  1527 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:17.686990  5675 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.689486  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:17.690375  1675 raft_consensus.cc:2376] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10. Re-sending same reply.
I20260709 12:59:17.699544  1675 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:17.652503  5728 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:17.606508  5745 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:17.706027  5803 log.cc:927] Time spent T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 12:59:17.660117  5576 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:17.719388  1527 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:17.718011  1681 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:17.628515  5574 consensus_queue.cc:1059] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:59:17.721139  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:17.726996  1681 raft_consensus.cc:2376] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9. Re-sending same reply.
I20260709 12:59:17.730829  2339 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:17.707643  5728 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.736552  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.628146  5746 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:17.741065  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:17.745379  2339 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:17.750188  5577 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.743714  5728 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:17.755669  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.756757  1528 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:17.756994  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.761525  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.762543  1532 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:17.763509  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.768349  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.769726  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.770668  1528 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:17.771497  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.771528  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.776684  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:17.777045  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:17.778923  2339 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:17.777514  1527 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 12:59:17.784454  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 441384us
I20260709 12:59:17.753953  5574 consensus_queue.cc:1243] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:59:17.787489  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:17.788538  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.755048  5509 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:17.790557  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 298338us
I20260709 12:59:17.794937  5721 raft_consensus.cc:2804] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:17.795500  5721 raft_consensus.cc:697] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:17.793292  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:17.796558  5589 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:17.796402  5721 consensus_queue.cc:237] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.797086  5589 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:17.798134  5589 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.768292  5729 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:17.735489  5767 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:59:17.787493  5657 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:17.803220  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:17.805869  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:17.769944  5682 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:17.728472  5576 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:17.809235  1609 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 13: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:17.807313  1498 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:17.813719  1603 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: [6.5-8.6]
W20260709 12:59:17.811017  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 185547us
I20260709 12:59:17.811321  5818 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:17.802253  5509 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:17.850226  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 58799.6us
W20260709 12:59:17.934235  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 136162us
I20260709 12:59:17.825850  1533 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:17.805886  5736 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.807081  5729 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:17.943737  5735 consensus_meta.cc:287] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.001s
I20260709 12:59:17.816905  5585 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:18.407297  1500 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:18.430785  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:18.432152  1533 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 13: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:17.853036  5800 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
W20260709 12:59:18.437266  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.015s	sys 0.012s
W20260709 12:59:18.438438  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.015s	sys 0.012s
W20260709 12:59:18.051903  5606 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.002s
W20260709 12:59:18.067585  5808 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.403s	user 0.001s	sys 0.001s
W20260709 12:59:18.452867  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 45638.9us
W20260709 12:59:18.468604  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.005s	sys 0.011s
I20260709 12:59:17.821065  5357 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:18.472663  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.006s	sys 0.011s
W20260709 12:59:18.473140  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 665821us
I20260709 12:59:18.286394  5745 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:18.136703  5797 consensus_meta.cc:287] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.000s
W20260709 12:59:17.850348  5811 log.cc:927] Time spent T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:59:18.022431  5642 consensus_meta.cc:287] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.857s	user 0.005s	sys 0.005s
W20260709 12:59:18.428726  5817 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:59:18.026691  5795 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:17.943214  5638 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.826186  5682 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:18.528666  1500 leader_election.cc:400] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11.
I20260709 12:59:18.492197  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:18.538403  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2176) took 3034 ms (client timeout 1798 ms). Trace:
I20260709 12:59:18.342191  5509 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.068977  5749 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:18.051030  5814 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:17.823802  5694 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.654s
I20260709 12:59:18.567025  1609 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 10. Ops: []
I20260709 12:59:18.438786  5729 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:18.471556  5585 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:18.572129  2435 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
W20260709 12:59:18.580875  1608 rpcz_store.cc:269] 0709 12:59:15.448538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.558483 (+109945us) service_pool.cc:224] Handling call
0709 12:59:18.482784 (+2924301us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b540020eed4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:18.482915 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47954304}
I20260709 12:59:18.580534  1500 leader_election.cc:403] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:18.474398  5576 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:17.914990  5818 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:18.569111  5752 consensus_meta.cc:287] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.931s	user 0.005s	sys 0.006s
W20260709 12:59:18.623746  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 182685us
I20260709 12:59:18.435745  5735 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:18.567212  5797 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:18.563977  5651 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:18.615718  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 87303.9us
I20260709 12:59:18.616382  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:18.483069  5623 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:18.583976  5814 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.467849  5736 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:18.474699  5606 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:18.636848  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.014s	sys 0.033s
W20260709 12:59:18.637224  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.014s	sys 0.033s
I20260709 12:59:18.619639  5585 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.638669  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:18.639711  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:18.615626  5671 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.648403  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:18.649200  2451 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 13: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:59:18.655897  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 175576us
I20260709 12:59:18.623876  5813 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11.
I20260709 12:59:18.658215  1679 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:18.659096  2428 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:18.664146  2421 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:59:18.669634  1681 raft_consensus.cc:1217] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Deduplicated request from leader. Original: 9.5->[10.6-11.7]   Dedup: 10.6->[11.7-11.7]
I20260709 12:59:18.670162  1681 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:59:18.672151  1600 raft_consensus.cc:1240] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:18.672276  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:18.672899  1602 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:18.673075  1606 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:18.651117  5585 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:18.641970  5814 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:18.663143  5728 consensus_meta.cc:287] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.908s	user 0.004s	sys 0.008s
W20260709 12:59:18.686502  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 199069us
I20260709 12:59:18.687417  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:18.626739  5752 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:18.692364  1602 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:18.694447  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:18.697880  1601 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:18.667541  5638 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:18.641131  5682 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:18.698582  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:18.695466  5825 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.877s	user 0.002s	sys 0.003s
I20260709 12:59:18.701356  1602 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:18.703349  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:18.704274  1681 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:18.716172  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:18.718618  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 943) took 1006 ms. Trace:
I20260709 12:59:18.657248  5623 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:18.719033  1683 rpcz_store.cc:276] 0709 12:59:17.711853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.711990 (+   137us) service_pool.cc:224] Handling call
0709 12:59:17.712390 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:17.793984 (+ 81594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:17.794003 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:17.794323 (+   320us) log.cc:844] Serialized 26 byte log entry
0709 12:59:17.824822 (+ 30499us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:17.824896 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.824981 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:18.718390 (+893409us) raft_consensus.cc:1685] finished
0709 12:59:18.718412 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.718563 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1923,"raft.queue_time_us":21115,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":18123,"thread_start_us":109541,"threads_started":2,"wal-append.queue_time_us":23192}
I20260709 12:59:18.724287  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:18.717406  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:18.721585  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 935) took 1074 ms. Trace:
I20260709 12:59:18.725703  1682 rpcz_store.cc:276] 0709 12:59:17.647411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.649119 (+  1708us) service_pool.cc:224] Handling call
0709 12:59:17.649423 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:17.819436 (+170013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:17.819480 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:17.820034 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:59:18.439045 (+619011us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:18.439090 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.439164 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:18.721298 (+282134us) raft_consensus.cc:1685] finished
0709 12:59:18.721324 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.721491 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58330,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10072,"thread_start_us":674534,"threads_started":2,"wal-append.queue_time_us":752775}
I20260709 12:59:18.727844  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:18.728509  1682 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:59:18.666962  5671 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:18.748665  5796 consensus_meta.cc:287] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.149s	user 0.010s	sys 0.002s
I20260709 12:59:18.760270  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1010) took 4603 ms. Trace:
I20260709 12:59:18.827629  2461 rpcz_store.cc:276] 0709 12:59:14.156948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.157083 (+   135us) service_pool.cc:224] Handling call
0709 12:59:14.177870 (+ 20787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:17.307250 (+3129380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.759973 (+1452723us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b5400441bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:18.760182 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7051951488}
I20260709 12:59:18.876283  5651 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.876940  5735 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:18.877256  5651 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:18.694366  5728 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:18.880286  5828 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:59:18.880952  5728 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:18.883281  5813 consensus_queue.cc:1059] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:18.886710  5752 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:18.748054  5815 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.713610  5638 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:18.888557  5815 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:18.857301  5796 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:18.896442  5796 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:18.898049  5827 log.cc:927] Time spent T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.247s	user 0.002s	sys 0.005s
I20260709 12:59:18.900497  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 945) took 1103 ms. Trace:
I20260709 12:59:18.900990  1678 rpcz_store.cc:276] 0709 12:59:17.797291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.797800 (+   509us) service_pool.cc:224] Handling call
0709 12:59:17.798111 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:17.798415 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:17.798442 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:17.798868 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:59:18.023504 (+224636us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:18.023560 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.023655 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:18.900209 (+876554us) raft_consensus.cc:1685] finished
0709 12:59:18.900238 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.900407 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1243,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":224209,"threads_started":1,"wal-append.queue_time_us":816511}
I20260709 12:59:18.906214  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 942) took 1198 ms. Trace:
I20260709 12:59:18.926230  5667 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:18.928936  5597 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:18.974720  5611 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:18.975502  5611 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:59:18.966157  5775 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:59:18.966990  5731 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:18.976722  5611 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:18.997257  2344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.914s (SENT) [suppressed 48 similar messages]
W20260709 12:59:18.999099  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.000171  5790 raft_consensus.cc:3055] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:19.000597  5790 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:19.001340  5790 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:19.005227  2475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 918) took 2545 ms (client timeout 1518 ms). Trace:
W20260709 12:59:19.008872  2475 rpcz_store.cc:269] 0709 12:59:16.459478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.459581 (+   103us) service_pool.cc:224] Handling call
0709 12:59:19.004978 (+2545397us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540059f954. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.005144 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309897088}
I20260709 12:59:19.010439  5790 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:19.010926  5802 log.cc:927] Time spent T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 1.409s	user 0.015s	sys 0.002s
I20260709 12:59:19.020893  5810 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:19.021544  5810 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:19.022590  5810 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.024087  5810 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.029955  5793 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:19.030649  5793 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:19.031754  5793 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.037984  5605 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:19.038902  5605 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:19.039013  2435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 1017) took 1699 ms (client timeout 1715 ms). Trace:
I20260709 12:59:19.011932  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 921) took 2551 ms. Trace:
W20260709 12:59:19.039635  2435 rpcz_store.cc:269] 0709 12:59:17.339571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.340949 (+  1378us) service_pool.cc:224] Handling call
0709 12:59:19.038775 (+1697826us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54004cd454. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.038936 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729851264}
I20260709 12:59:19.039721  2474 rpcz_store.cc:276] 0709 12:59:16.460208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.000542 (+540334us) service_pool.cc:224] Handling call
0709 12:59:17.000849 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:17.227080 (+226231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.011567 (+1784487us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54006ed7d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:19.011852 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517823360}
I20260709 12:59:19.046571  5056 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.055044  5837 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.055920  5837 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.058499  5665 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:19.062719  5608 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:19.064216  5610 raft_consensus.cc:3055] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:19.064749  5610 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:19.066087  5610 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.067421  5610 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.070760  5612 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.072955  5629 raft_consensus.cc:3055] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:19.076901  5629 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:19.077986  5629 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.079275  5629 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.074661  5432 raft_consensus.cc:3055] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:19.080646  5432 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:19.081643  5432 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.076375  5684 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:19.159006  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 496291us
W20260709 12:59:19.163043  1531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2078) took 2739 ms (client timeout 2766 ms). Trace:
W20260709 12:59:19.163427  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.164424  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.163707  1531 rpcz_store.cc:269] 0709 12:59:16.423943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.440252 (+ 16309us) service_pool.cc:224] Handling call
0709 12:59:19.162397 (+2722145us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b54002d9bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.162769 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150073088}
I20260709 12:59:19.164577  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 841) took 1411 ms. Trace:
I20260709 12:59:19.166292  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.168027  1531 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
W20260709 12:59:19.164878  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.169530  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:19.171219  1526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2077) took 2758 ms (client timeout 3032 ms). Trace:
I20260709 12:59:19.171314  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:19.171828  1526 rpcz_store.cc:269] 0709 12:59:16.412381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.444920 (+ 32539us) service_pool.cc:224] Handling call
0709 12:59:19.170792 (+2725872us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400318dd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.171024 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343472000}
I20260709 12:59:19.173045  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.173964  1531 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:19.175282  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:19.175678  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.176548  1531 raft_consensus.cc:2393] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:59:19.177191  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.690327  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.178505  1532 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:19.178720  1533 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
W20260709 12:59:19.171454  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.180244  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.180404  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:18.023895   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:19.181834  1533 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:19.182099  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:19.183595  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.185413  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:19.187031  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:19.188861  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2073) took 2798 ms (client timeout 2151 ms). Trace:
I20260709 12:59:19.196408  1601 raft_consensus.cc:1240] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:59:19.196247  1534 rpcz_store.cc:269] 0709 12:59:16.389904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.390695 (+   791us) service_pool.cc:224] Handling call
0709 12:59:19.188390 (+2797695us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b540010ac54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.188638 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19694976}
I20260709 12:59:19.197479  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.197815  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.198417  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2458) took 1875 ms. Trace:
I20260709 12:59:19.198706  1603 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:19.198915  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:19.189836  1575 connection.cc:256] RPC call timeout handler was delayed by -2.1972062680000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25880000000000003s for a response
I20260709 12:59:19.200451  1605 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:19.201215  1575 connection.cc:256] RPC call timeout handler was delayed by -2.0597068469999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:59:19.201696  1575 connection.cc:256] RPC call timeout handler was delayed by -1.6920161810000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:59:19.202056  1575 connection.cc:256] RPC call timeout handler was delayed by -1.601758048000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 12:59:19.202422  1575 connection.cc:256] RPC call timeout handler was delayed by -1.525258048000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 12:59:19.202630  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 2463) took 1401 ms. Trace:
W20260709 12:59:19.203015  1575 connection.cc:256] RPC call timeout handler was delayed by -1.3331819539999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260709 12:59:19.203541  1575 connection.cc:256] RPC call timeout handler was delayed by -1.059332214000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:59:19.203981  1575 connection.cc:256] RPC call timeout handler was delayed by -1.059332214000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:59:19.204322  1575 connection.cc:256] RPC call timeout handler was delayed by -1.0350322140000685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 12:59:19.194319  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 496865us
I20260709 12:59:19.203070  1605 rpcz_store.cc:276] 0709 12:59:17.802825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.802986 (+   161us) service_pool.cc:224] Handling call
0709 12:59:19.202343 (+1399357us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001c5554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.202545 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3199284608}
I20260709 12:59:19.207064  1607 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:19.208828  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.209043  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2445) took 1906 ms. Trace:
I20260709 12:59:19.200477  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:19.209535  1600 rpcz_store.cc:276] 0709 12:59:17.302749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.309697 (+  6948us) service_pool.cc:224] Handling call
0709 12:59:17.361204 (+ 51507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.672564 (+1311360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.208562 (+535998us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001568d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:19.208867 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014549376}
I20260709 12:59:19.210516  1534 raft_consensus.cc:2393] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:19.210587  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.211741  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 843) took 1458 ms. Trace:
I20260709 12:59:19.173484  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.261698  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:19.262619  2475 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:19.273732  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.275303  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.165257  1527 rpcz_store.cc:276] 0709 12:59:17.752980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.781164 (+ 28184us) service_pool.cc:224] Handling call
0709 12:59:17.803862 (+ 22698us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:17.939925 (+136063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:17.939956 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:18.396022 (+456066us) log.cc:844] Serialized 52 byte log entry
0709 12:59:18.662011 (+265989us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:19.162909 (+500898us) log.cc:844] Serialized 14 byte log entry
0709 12:59:19.163653 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.163842 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:19.163950 (+   108us) raft_consensus.cc:1685] finished
0709 12:59:19.163997 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.164277 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135646,"prepare.queue_time_us":281090,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":233364,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":65874,"thread_start_us":681150,"threads_started":2,"wal-append.queue_time_us":333532}
I20260709 12:59:19.214738  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.215268  1601 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:59:19.216171  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.216230  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:19.198880  1606 rpcz_store.cc:276] 0709 12:59:17.323320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.391497 (+ 68177us) service_pool.cc:224] Handling call
0709 12:59:17.410178 (+ 18681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:18.673446 (+1263268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.197678 (+524232us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54004079d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:19.198217 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2903824768}
I20260709 12:59:18.906773  1675 rpcz_store.cc:276] 0709 12:59:17.707831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.708047 (+   216us) service_pool.cc:224] Handling call
0709 12:59:17.708428 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:17.708831 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:17.940992 (+232161us) log.cc:844] Serialized 14 byte log entry
0709 12:59:18.643146 (+702154us) log.cc:844] Serialized 14 byte log entry
0709 12:59:18.643299 (+   153us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:18.643729 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:59:18.643852 (+   123us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:18.643904 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.643970 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:18.905907 (+261937us) raft_consensus.cc:1685] finished
0709 12:59:18.905936 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.906139 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3317,"prepare.queue_time_us":336353,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":20370,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":21545,"spinlock_wait_cycles":43206656,"thread_start_us":910572,"threads_started":2,"wal-append.queue_time_us":950117}
W20260709 12:59:19.219472  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45362 (request call id 936) took 1569 ms (client timeout 1734 ms). Trace:
I20260709 12:59:19.221666  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2218) took 3746 ms. Trace:
W20260709 12:59:19.223443  1649 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): Timed out: RequestConsensusVote RPC to 127.0.107.196:46719 timed out after 1.518s (SENT)
W20260709 12:59:19.234941  2342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.030s
W20260709 12:59:19.246977  2344 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.717s (SENT)
I20260709 12:59:19.248322  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.248709  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:19.249320  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.248283  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.248241  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.254732  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.258379  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.260550  2474 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:19.261726  1532 rpcz_store.cc:276] 0709 12:59:17.753485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.795284 (+ 41799us) service_pool.cc:224] Handling call
0709 12:59:19.177833 (+1382549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.179074 (+  1241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.211501 (+ 32427us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002d9bd0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.211678 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3178572160}
I20260709 12:59:19.211784  1607 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:19.280054  5357 consensus_queue.cc:1059] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:19.284976  2475 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:19.317766  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:19.312165  1679 rpcz_store.cc:269] 0709 12:59:17.650231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.650356 (+   125us) service_pool.cc:224] Handling call
0709 12:59:19.218804 (+1568448us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b540039ec54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.219108 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242121600}
W20260709 12:59:19.321906  2342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.015s	sys 0.031s
I20260709 12:59:19.312263  1680 rpcz_store.cc:276] 0709 12:59:15.475304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.960827 (+485523us) service_pool.cc:224] Handling call
0709 12:59:16.201549 (+240722us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b58000e6a98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:59:17.643267 (+1441718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:17.643887 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.221023 (+1577136us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000f9e50. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.221353 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3314539776}
I20260709 12:59:19.330869  5732 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:19.332038  5732 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.324337  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:19.329366  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 82635.3us
W20260709 12:59:19.335726  5627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.940s	user 0.009s	sys 0.025s
I20260709 12:59:19.312938  5577 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:19.342228  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.336532  5627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.953s	user 0.009s	sys 0.026s
I20260709 12:59:19.346876  1600 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:19.349891  1605 raft_consensus.cc:2410] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:19.353080  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:19.353701  5751 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.354099  1609 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.354622  5577 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.357645  5671 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:19.358403  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.359995  5837 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:19.360107  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.310568  5574 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.361307  2423 raft_consensus.cc:2410] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:19.361799  5748 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.362782  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.363332  5623 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.363837  2474 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
W20260709 12:59:19.364611  2455 consensus_meta.cc:287] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.022s
I20260709 12:59:19.365129  2455 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:19.358575  1607 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:59:19.368044  5741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.006s	sys 0.014s
W20260709 12:59:19.368530  5741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.006s	sys 0.014s
I20260709 12:59:19.370740  5638 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.371439  1677 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:19.374434  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.375442  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.353144  5608 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:19.377727  5608 consensus_queue.cc:1243] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Peer 3cabc5110903443ba3beb5cbb14afa91 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:19.379380  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.380203  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.380924  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:19.381202  1606 raft_consensus.cc:2410] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:19.382433  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.383409  5606 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.384858  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.385864  1600 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 4.
W20260709 12:59:19.387169  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 164007us
W20260709 12:59:19.388367  2344 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.058s (SENT)
I20260709 12:59:19.390472  5733 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:19.394585  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:19.380278  1601 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:19.395669  1531 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 13: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:19.396704  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.354626  5751 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.402535  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.405320  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.405483  5644 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:19.407614  5734 consensus_meta.cc:287] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.625s	user 0.017s	sys 0.013s
I20260709 12:59:19.407945  5644 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.408310  5734 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.408759  5357 raft_consensus.cc:3055] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:19.409155  5357 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:19.410806  5644 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:19.410962  5734 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:19.411350  5784 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.336510  5822 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:19.412060  5784 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.412490  5822 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.415524  5815 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:19.416901  5611 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:19.418181  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.405937  2428 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:19.410740  5627 consensus_queue.cc:1243] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:59:19.419174  2342 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:19.425011  1675 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:19.420979  1604 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:59:19.425251  5849 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:19.428393  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:19.430652  5671 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:19.435361  1607 raft_consensus.cc:2393] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 14: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:19.403079  5736 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:19.456341  1531 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:59:19.457095  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 845) took 1633 ms. Trace:
I20260709 12:59:19.457198  5751 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.457785  1601 raft_consensus.cc:2376] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11. Re-sending same reply.
I20260709 12:59:19.415598  5822 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:19.457477  1531 rpcz_store.cc:276] 0709 12:59:17.823644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.453605 (+1629961us) service_pool.cc:224] Handling call
0709 12:59:19.455888 (+  2283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.456804 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.457024 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:19.463830  1606 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:19.435554  5849 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:19.463914  5818 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.468093  1601 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:19.469518  5651 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:19.362803  5748 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.449275  5627 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:19.453769  5732 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.476029  1528 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
W20260709 12:59:19.486369  2455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 1003) took 5435 ms (client timeout 1973 ms). Trace:
I20260709 12:59:19.492746  1600 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:19.486135  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:19.494230  2455 rpcz_store.cc:269] 0709 12:59:14.050653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.054020 (+  3367us) service_pool.cc:224] Handling call
0709 12:59:19.486082 (+5432062us) spinlock_profiling.cc:243] Waited 4.59 s on lock 0x7b54005f2b54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:19.486249 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10564613888}
W20260709 12:59:19.490675  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 47217.4us
W20260709 12:59:19.451426  5509 consensus_meta.cc:287] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.758s	user 0.013s	sys 0.017s
I20260709 12:59:19.496747  5509 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.499912  5509 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:19.501137  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:19.501766  5668 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.496610  1531 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:19.489220  5748 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.467067  5849 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.518368  2451 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:19.520750  5651 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:19.524070  1649 leader_election.cc:336] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.733s (SENT)
I20260709 12:59:19.516816  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 846) took 1682 ms. Trace:
I20260709 12:59:19.526333  1531 rpcz_store.cc:276] 0709 12:59:17.826656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.462692 (+1636036us) service_pool.cc:224] Handling call
0709 12:59:19.496093 (+ 33401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.504396 (+  8303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.508641 (+  4245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:19.502413  5668 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.538630  5357 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.540832  5357 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.542194  5818 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.542824  5818 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:19.544482  5585 consensus_meta.cc:287] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.847s	user 0.013s	sys 0.007s
I20260709 12:59:19.545177  5818 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:19.547536  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 159233us
I20260709 12:59:19.545023  5585 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.550168  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:19.563743  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:19.564761  2451 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:19.557739  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:19.578302  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.579380  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.585785  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 187412us
I20260709 12:59:19.586728  1534 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 13: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:19.549242  5651 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:19.562021  5697 consensus_meta.cc:287] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 2.253s	user 0.018s	sys 0.016s
W20260709 12:59:19.591377  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.589332  1609 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:19.524865  5627 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.593140  1605 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:19.592502  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.596873  1679 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:19.598778  5810 consensus_meta.cc:287] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.015s
W20260709 12:59:19.599100  5814 consensus_meta.cc:287] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.899s	user 0.023s	sys 0.016s
W20260709 12:59:19.599906  5622 consensus_meta.cc:287] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 1.892s	user 0.018s	sys 0.022s
I20260709 12:59:19.599675  5814 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.600373  5622 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.602234  5651 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.608794  1526 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:19.611919  1608 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:19.617743  5748 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:19.619094  5627 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.620760  5432 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.623499  2476 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.624706  5826 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.625484  5826 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.630564  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:19.635825  1533 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
W20260709 12:59:19.637531  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.610385  5784 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:19.647433  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 123432us
I20260709 12:59:19.648337  1606 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:19.638504  1531 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:19.644343  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:19.648569  1675 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:19.646507  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.666368  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 847) took 1637 ms. Trace:
I20260709 12:59:19.669343  1531 rpcz_store.cc:276] 0709 12:59:18.020783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.548356 (+1527573us) service_pool.cc:224] Handling call
0709 12:59:19.587370 (+ 39014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.649333 (+ 61963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.657732 (+  8399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:19.669988  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:19.670729  1605 raft_consensus.cc:2376] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10. Re-sending same reply.
W20260709 12:59:19.676298  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.693519  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2067) took 3358 ms. Trace:
W20260709 12:59:19.693747  5605 consensus_meta.cc:287] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.005s
I20260709 12:59:19.694370  5605 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.694109  1529 rpcz_store.cc:276] 0709 12:59:16.317263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.318969 (+  1706us) service_pool.cc:224] Handling call
0709 12:59:16.319315 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:16.485332 (+166017us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:16.969681 (+484349us) log.cc:844] Serialized 14 byte log entry
0709 12:59:17.360266 (+390585us) log.cc:844] Serialized 14 byte log entry
0709 12:59:19.169918 (+1809652us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b1800386980. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8a8455 00007f25d1990060 00007f25d19a2716 00007f25d19b3287 00007f25d19b3208
0709 12:59:19.357618 (+187700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:19.357726 (+   108us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:19.357879 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.663294 (+305415us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002d8cd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:19.663354 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.675653 (+ 12299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39705,"prepare.queue_time_us":109331,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":80,"raft.queue_time_us":249907,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":16845,"spinlock_wait_cycles":387515520,"thread_start_us":893139,"threads_started":4,"wal-append.queue_time_us":176016,"wal-append.run_cpu_time_us":2608,"wal-append.run_wall_time_us":1464661}
I20260709 12:59:19.697165  5605 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.700058  1531 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:19.700743  1608 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:19.700807  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.704051  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.704698  1605 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:19.702277  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 848) took 1640 ms. Trace:
I20260709 12:59:19.706399  1531 rpcz_store.cc:276] 0709 12:59:18.062154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.670366 (+1608212us) service_pool.cc:224] Handling call
0709 12:59:19.685462 (+ 15096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.702014 (+ 16552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.702219 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:19.685541  5784 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:19.713162  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 73021.9us
I20260709 12:59:19.722272  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.723443  1604 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:19.725049  5732 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.729984  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:19.730361  1604 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:19.730970  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2090) took 1251 ms. Trace:
I20260709 12:59:19.731417  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:19.732384  5790 consensus_meta.cc:287] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.720s	user 0.002s	sys 0.011s
I20260709 12:59:19.732298  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:19.732985  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.733388  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.733717  1604 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:19.734728  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.735078  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:19.735594  1604 raft_consensus.cc:2410] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:59:19.731330  1532 rpcz_store.cc:276] 0709 12:59:18.480024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.334182 (+854158us) service_pool.cc:224] Handling call
0709 12:59:19.729817 (+395635us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:59:19.730910 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3215104}
I20260709 12:59:19.740489  1532 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 11. Ops: []
I20260709 12:59:19.741914  5585 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.713963  5622 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:19.747428  5857 log.cc:927] Time spent T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:59:19.771204  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 97626.5us
I20260709 12:59:19.710685  5814 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:19.773504  2476 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 12:59:19.782856  1647 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.592s (SENT)
I20260709 12:59:19.787760  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:19.788110  1606 raft_consensus.cc:2410] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:59:19.784094  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 55128.6us
I20260709 12:59:19.785650  5719 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.791999  5732 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:19.792694  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 157833us
I20260709 12:59:19.792109  5719 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:19.788759  2344 leader_election.cc:336] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.937s (SENT)
W20260709 12:59:19.798636  2476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 919) took 3334 ms (client timeout 1878 ms). Trace:
W20260709 12:59:19.799122  2476 rpcz_store.cc:269] 0709 12:59:16.459670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.459802 (+   132us) service_pool.cc:224] Handling call
0709 12:59:18.936124 (+2476322us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b1800081180. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19d3646 00007f25d190d58e 00007f25d198ef9e 00007f25d19907de 00007f25d199c27c 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c
0709 12:59:19.622553 (+686429us) spinlock_profiling.cc:243] Waited 9.41 ms on lock 0x7b5800328dd0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d18f40aa 00007f25d1976447 00007f25d198efe7 00007f25d19907de 00007f25d199c27c 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c
0709 12:59:19.794000 (+171447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471868416}
I20260709 12:59:19.789055  5605 raft_consensus.cc:2764] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:59:19.806527  5822 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:19.801257  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:19.809108  5610 consensus_meta.cc:287] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.741s	user 0.004s	sys 0.014s
I20260709 12:59:19.809430  5732 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:19.810062  5684 consensus_meta.cc:287] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.727s	user 0.013s	sys 0.006s
I20260709 12:59:19.816743  5751 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.818168  5733 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:19.818521  5751 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.817589  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:19.838446  5056 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.839339  5056 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:19.841236  5629 consensus_meta.cc:287] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.009s
W20260709 12:59:19.847426  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 78008.3us
W20260709 12:59:19.848225  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.850029  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:19.851569  5745 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.853683  5605 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:19.854328  5605 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:19.854851  5605 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:19.858716  5729 consensus_meta.cc:287] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 1.223s	user 0.013s	sys 0.020s
I20260709 12:59:19.859594  5729 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:19.863571  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.863751  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:19.864241  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.826161  5751 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:19.870168  5822 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:19.865839  5733 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.870793  5722 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:19.875473  5733 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:19.805800  5849 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.883340  1575 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:19.888347  5731 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:19.889274  5731 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.888461  5751 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:19.889660  5731 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.893265  5751 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:19.894155  5751 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:19.895882  5745 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.896113  5751 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:19.897909  5751 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:19.887985  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.902298  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64155us
I20260709 12:59:19.905117  5798 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:19.903131  5729 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:19.906893  5745 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.916245  5741 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:59:19.918437  5849 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:19.921301  5793 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:19.932500  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 66235.7us
I20260709 12:59:19.934273  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:19.939028  5741 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:19.940968  1525 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:19.932507  5822 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:59:19.943625  5732 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:19.944628  5729 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:19.937750  5738 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:19.935859  5849 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:59:19.947199  5745 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:19.963271  2435 raft_consensus.cc:1240] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:59:19.968516  1647 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.730s (SENT)
I20260709 12:59:19.970119  1532 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:19.972030  1532 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:19.954373  5733 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:19.975414  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:19.988010  1647 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.798s (SENT)
I20260709 12:59:19.992218  5632 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:19.995266  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:19.998684  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:19.997396  1647 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.807s (SENT)
I20260709 12:59:20.001230  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:20.006625  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:20.007558  1675 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.004421  1680 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:20.008488  5577 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:20.011266  1682 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:20.022733  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:20.023518  1681 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:20.005481  5745 consensus_queue.cc:1048] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:20.028026  5731 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:20.030018  1675 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
I20260709 12:59:20.031122  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:20.032702  1603 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:59:20.032891  1533 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:20.033156  1603 pending_rounds.cc:85] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 6
I20260709 12:59:20.033497  1603 pending_rounds.cc:107] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:59:20.033795  1603 raft_consensus.cc:2889] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:20.035127  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:20.037171  5745 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:20.038960  5856 log.cc:927] Time spent T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.221s	user 0.003s	sys 0.000s
I20260709 12:59:20.045279  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 947) took 1703 ms. Trace:
W20260709 12:59:20.047184  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 69397.5us
I20260709 12:59:20.172535  1681 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:20.046808  1674 rpcz_store.cc:276] 0709 12:59:18.341663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.341813 (+   150us) service_pool.cc:224] Handling call
0709 12:59:18.342148 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:18.564408 (+222260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:18.564436 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:18.564910 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:59:19.246159 (+681249us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b18003f76c0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d15380d1 00007f25d1953a0f
0709 12:59:19.451021 (+204862us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:19.451121 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.463445 (+ 12324us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:20.037822 (+574377us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:20.044919 (+  7097us) raft_consensus.cc:1685] finished
0709 12:59:20.044940 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:20.045073 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19309,"raft.queue_time_us":237700,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":30578,"spinlock_wait_cycles":27400320,"thread_start_us":326334,"threads_started":2,"wal-append.queue_time_us":1233608}
I20260709 12:59:20.170511  5793 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:20.177971  5793 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:20.178706  5731 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:20.180169  5793 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:20.182862  5605 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:20.184767  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 166414us
I20260709 12:59:20.188902  5804 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.190685  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:20.192198  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:20.193783  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:20.195756  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 2143) took 2443 ms (client timeout 1985 ms). Trace:
I20260709 12:59:20.196003  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:20.196259  1528 rpcz_store.cc:269] 0709 12:59:17.752458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.771227 (+ 18769us) service_pool.cc:224] Handling call
0709 12:59:20.195524 (+2424297us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54000c9754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:20.195659 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3917771392}
I20260709 12:59:20.196673  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:20.196764  1679 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:20.197737  5733 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:20.198102  5629 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:20.198211  1647 leader_election.cc:336] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 1.878s (SENT)
I20260709 12:59:20.198671  5629 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.198609  5697 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:20.199318  5629 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:20.199764  5605 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:20.202765  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:20.203712  5605 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:20.204309  5605 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:20.204908  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:20.190729  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2171) took 3725 ms. Trace:
I20260709 12:59:20.205397  5605 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:20.206355  5694 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:20.206293  1677 rpcz_store.cc:276] 0709 12:59:16.465094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.465278 (+   184us) service_pool.cc:224] Handling call
0709 12:59:16.522638 (+ 57360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.372042 (+2849404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.190030 (+817988us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b540045bad4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:20.190666 (+   636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6550251264}
I20260709 12:59:20.207574  1575 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:20.208545  5793 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:20.208968  5793 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.206972  5694 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.209769  5694 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:20.211733  5697 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:20.212549  5697 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:20.215550  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:20.189495  5804 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:20.209340  5793 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:20.216926  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.230276  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:20.223062  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.231070  2451 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:20.231642  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:20.232147  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:20.232604  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.223615  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:20.229282  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:20.216852  5745 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:20.235142  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:20.215301  5697 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:20.227602  5731 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:20.262977  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.276302  2435 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:20.287469  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.277460  5731 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:20.288764  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 73325.9us
I20260709 12:59:20.282258  5751 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:20.295080  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 101491us
I20260709 12:59:20.285310  5733 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:20.292038  5731 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:20.309129  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:59:20.318928  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:20.321650  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.321087  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:20.326965  1498 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:20.304092  5632 consensus_queue.cc:1059] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:59:20.319437  5732 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:20.331904  5732 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:20.328295  5733 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:20.330619  5605 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.333309  5732 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:20.333343  5870 log.cc:927] Time spent T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:59:20.349870  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 46435.8us
I20260709 12:59:20.342507  5632 consensus_queue.cc:1243] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:20.354327  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2188) took 1140 ms. Trace:
I20260709 12:59:20.345271  5801 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:20.358176  5741 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:20.363543  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 2125) took 2795 ms (client timeout 2357 ms). Trace:
I20260709 12:59:20.338248  5733 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:20.368484  1603 rpcz_store.cc:276] 0709 12:59:19.213592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.213725 (+   133us) service_pool.cc:224] Handling call
0709 12:59:19.214094 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.034239 (+820145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.354025 (+319786us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54004065d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:20.354255 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881761024}
W20260709 12:59:20.370905  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.367400  2451 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
W20260709 12:59:20.370893  1525 rpcz_store.cc:269] 0709 12:59:17.568055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.568254 (+   199us) service_pool.cc:224] Handling call
0709 12:59:20.363276 (+2795022us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b54000c71d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:20.363409 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5392191232}
I20260709 12:59:20.373440  2435 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:20.379637  5741 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:20.346078  5605 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:20.381798  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:20.382637  5741 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:20.383360  5745 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:20.383842  5745 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.384135  5605 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:20.384248  5745 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:20.389371  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 62511.8us
I20260709 12:59:20.373528  5733 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:20.398098  5729 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:20.404219  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:20.405146  1602 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 12:59:20.408192  1526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2087) took 1929 ms (client timeout 1968 ms). Trace:
I20260709 12:59:20.408447  1532 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:59:20.408617  1526 rpcz_store.cc:269] 0709 12:59:18.479126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.173037 (+693911us) service_pool.cc:224] Handling call
0709 12:59:20.407987 (+1234950us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b540004cc54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:20.408112 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797060864}
I20260709 12:59:20.411139  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 866) took 1250 ms. Trace:
I20260709 12:59:20.411527  1532 rpcz_store.cc:276] 0709 12:59:19.160824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.972709 (+811885us) service_pool.cc:224] Handling call
0709 12:59:20.408119 (+435410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.408871 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.410912 (+  2041us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b540004cc50. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:20.411066 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000527104}
W20260709 12:59:20.420642  1647 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.066s (SENT)
I20260709 12:59:20.424316  5668 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:20.425800  1647 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.228s (SENT)
I20260709 12:59:20.426301  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:20.427078  5822 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:20.381109  5629 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:20.427423  5751 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:20.427933  5751 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:20.429284  5629 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:20.430231  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:20.434687  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 665670us
I20260709 12:59:20.435772  5793 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:20.436179  5694 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:20.437839  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 105098us
I20260709 12:59:20.438603  5732 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:20.442379  1525 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:20.446344  1532 raft_consensus.cc:3055] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:20.446604  5822 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:20.447966  5741 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:20.448593  5694 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:20.444854  5732 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:20.449262  5801 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:20.445066  1681 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:20.446913  1532 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:20.451561  1532 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:20.446401  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.458086  1532 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.459007  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:20.460145  1525 raft_consensus.cc:2410] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:59:20.460924  5731 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:20.461431  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:20.462246  2435 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:20.462252  5668 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:20.468421  5731 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:20.470060  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:20.468449  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.474826  1533 raft_consensus.cc:2376] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11. Re-sending same reply.
I20260709 12:59:20.490475  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.492784  1526 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:59:20.508042  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.514211  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.515914  1528 raft_consensus.cc:2410] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:59:20.516942  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.517994  1533 raft_consensus.cc:2393] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:20.518945  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.519706  1533 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:20.522078  1528 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:20.537371  5889 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:20.537599  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:20.551472  5889 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:20.554227  5890 consensus_queue.cc:1059] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:20.558633  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.562685  5801 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:20.563016  1528 raft_consensus.cc:2393] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:20.563079  5801 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:20.563979  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.564040  5801 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:20.564689  1528 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:20.565629  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:20.566442  1528 raft_consensus.cc:2410] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:59:20.567211  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.568305  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:20.568949  1528 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:20.560079  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:20.570772  1533 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:20.572196  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:20.597064  5804 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:20.602051  5804 raft_consensus.cc:3055] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:20.565392  5801 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:20.561342  5432 raft_consensus.cc:3055] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:20.636874  2344 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.741s (SENT)
W20260709 12:59:21.110518  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 473667us
W20260709 12:59:21.112353  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.113795  5432 raft_consensus.cc:740] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:21.115394  5432 consensus_queue.cc:260] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:20.756120  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.118382  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.118956  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:20.704257  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.121351  5432 raft_consensus.cc:3060] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:21.117060  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.142851  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.105249  5804 raft_consensus.cc:740] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:21.167510  5804 consensus_queue.cc:260] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:21.184751  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 456781us
W20260709 12:59:21.200459  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.353734  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.473582  5801 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:21.488065  1532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.009s	sys 0.033s
W20260709 12:59:21.488695  1532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.009s	sys 0.033s
I20260709 12:59:21.489753  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 2144) took 1053 ms. Trace:
I20260709 12:59:21.490100  1532 rpcz_store.cc:276] 0709 12:59:20.436473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.445791 (+  9318us) service_pool.cc:224] Handling call
0709 12:59:20.446198 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.491283 (+ 45085us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:20.536222 (+ 44939us) log.cc:844] Serialized 14 byte log entry
0709 12:59:21.489075 (+952853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:21.489157 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:21.489226 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.489479 (+   253us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:21.489675 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47511,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":52212,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":276,"thread_start_us":993470,"threads_started":3,"wal-append.queue_time_us":7985}
I20260709 12:59:21.492357  5892 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.493156  5892 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:21.496225  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 256917us
I20260709 12:59:21.497458  5892 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:21.498330  5892 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.498991  5892 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:21.512284  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.047s	sys 0.063s
I20260709 12:59:21.512166  5892 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:21.512873  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.047s	sys 0.063s
I20260709 12:59:21.513054  5892 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:21.530022  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002bf1a0 after lost signal to thread 434
W20260709 12:59:21.530722  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6300 after lost signal to thread 436
I20260709 12:59:21.530827  1533 raft_consensus.cc:1275] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:59:21.531379  1533 pending_rounds.cc:85] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 7
I20260709 12:59:21.531607  1533 pending_rounds.cc:107] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:59:21.531841  1533 raft_consensus.cc:2889] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:21.532011  5862 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 1.721s	user 0.014s	sys 0.000s
I20260709 12:59:21.534809  5898 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.535514  5898 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:21.540927  5897 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:21.542672  5897 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:21.544802  5897 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:21.485956  5801 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:21.545367  5898 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:21.547679  5898 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.548166  5898 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:21.551123  1528 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:21.549340  5801 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:21.513729  5892 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:21.566751  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 921129us
W20260709 12:59:21.575847  1575 connection.cc:256] RPC call timeout handler was delayed by -1.2088444770000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3274s for a response
W20260709 12:59:21.576534  1575 connection.cc:256] RPC call timeout handler was delayed by -1.2088444770000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3274s for a response
I20260709 12:59:21.578181  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:21.579238  1603 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:21.580868  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:21.581735  1603 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:21.583245  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 882) took 1009 ms. Trace:
I20260709 12:59:21.583683  1532 rpcz_store.cc:276] 0709 12:59:20.573747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.508604 (+934857us) service_pool.cc:224] Handling call
0709 12:59:21.515758 (+  7154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:21.527905 (+ 12147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:21.527963 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:21.534064 (+  6101us) log.cc:844] Serialized 26 byte log entry
0709 12:59:21.569321 (+ 35257us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:21.569382 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.569487 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:21.583032 (+ 13545us) raft_consensus.cc:1685] finished
0709 12:59:21.583050 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:21.583189 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30783,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":34644,"threads_started":1,"wal-append.queue_time_us":41750}
W20260709 12:59:21.584565  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 863) took 2425 ms (client timeout 1957 ms). Trace:
W20260709 12:59:21.585391  1534 rpcz_store.cc:269] 0709 12:59:19.159367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.215847 (+ 56480us) service_pool.cc:224] Handling call
0709 12:59:21.584382 (+2368535us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400198f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:21.584503 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597539712}
I20260709 12:59:21.570279  5898 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:21.587544  5905 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:21.587675  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:21.588589  2421 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:21.589372  1607 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:21.589810  1603 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:21.590703  2344 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:21.592034  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:21.592721  1601 raft_consensus.cc:2410] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:59:21.593762  1608 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:21.594175  1601 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:21.594398  5892 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:21.595150  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:21.595615  5904 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.595721  1607 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.596213  5904 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:21.602809  5904 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:21.603117  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:21.604003  1606 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:21.604576  5904 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.605036  5904 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:21.606734  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:21.607312  1601 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:59:21.607672  1601 pending_rounds.cc:85] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 7
I20260709 12:59:21.607959  1601 pending_rounds.cc:107] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:59:21.608202  1601 raft_consensus.cc:2889] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:21.608652  5904 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:21.607504  1606 raft_consensus.cc:2376] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9. Re-sending same reply.
I20260709 12:59:21.612227  1608 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:21.614326  1607 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 5.
W20260709 12:59:21.615387  5722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.321s	user 0.006s	sys 0.019s
W20260709 12:59:21.616149  5722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.321s	user 0.006s	sys 0.019s
I20260709 12:59:21.617141  5722 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:21.617579  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:21.618148  2435 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:21.618014  5722 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:21.628582  1527 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
W20260709 12:59:21.630656  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 868) took 2468 ms (client timeout 2938 ms). Trace:
I20260709 12:59:21.632565  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:21.633639  1683 raft_consensus.cc:2410] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:59:21.634629  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:21.635262  1683 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:21.636109  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:21.638470  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.638958  2435 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
W20260709 12:59:21.631058  1527 rpcz_store.cc:269] 0709 12:59:19.161809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.343770 (+181961us) service_pool.cc:224] Handling call
0709 12:59:21.630457 (+2286687us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b54003af554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:21.630588 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5182009088}
I20260709 12:59:21.640003  5903 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:21.640766  1607 raft_consensus.cc:1240] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:21.641467  5903 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:59:21.642135  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 51476.7us
I20260709 12:59:21.642892  2344 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:21.643522  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.644465  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.637368  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:21.645517  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:21.646206  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:21.645532  1683 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:21.647768  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:21.649165  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.648209  1683 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:21.650741  5864 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:21.650867  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:21.651000  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:21.651175  5864 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:21.651677  1608 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:21.652288  5864 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:21.652420  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:21.653373  5864 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:21.653807  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:21.647817  5897 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:21.656236  5897 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:21.656574  5897 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.656908  5897 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.659969  1608 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:21.663514  5905 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:21.663998  5905 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.664811  1607 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:21.664371  5905 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:21.669853  1572 connection.cc:256] RPC call timeout handler was delayed by -1.1091483350000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:59:21.670329  1572 connection.cc:256] RPC call timeout handler was delayed by -1.0965483350000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 12:59:21.672372  5864 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:21.673156  2344 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:21.649492  5906 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:21.674314  1607 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:21.674516  5864 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:21.676437  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:21.674511  5906 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:21.677031  1601 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.677495  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:21.677675  5906 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:21.678941  1575 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:21.679729  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:21.672400  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:21.680622  1607 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:21.694710  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:21.678968  5906 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.695526  1607 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:21.683362  5864 raft_consensus.cc:2764] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:21.690120  5904 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:21.702498  1608 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:21.693607  5605 consensus_queue.cc:1059] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:59:21.714144  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:21.712600  5605 raft_consensus.cc:3055] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:21.716686  5605 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:21.717792  5605 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:21.723529  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.726490  1531 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:21.727692  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2093) took 3039 ms. Trace:
I20260709 12:59:21.728253  1531 rpcz_store.cc:276] 0709 12:59:18.688719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.709960 (+1021241us) service_pool.cc:224] Handling call
0709 12:59:21.721854 (+2011894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.727229 (+  5375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.727608 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:21.741513  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.750847  1607 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:21.778728  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:21.719213  5605 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:21.793143  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:21.806056  2421 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:59:21.781912  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 50425.9us
I20260709 12:59:21.807155  1601 raft_consensus.cc:2410] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:59:21.807610  1497 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:59:21.789222  1649 connection.cc:256] RPC call timeout handler was delayed by -2.2845388850000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 12:59:21.782191  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:21.818228  2435 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:21.781869  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:21.819888  2475 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:21.794761  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:21.820988  1649 connection.cc:256] RPC call timeout handler was delayed by -1.310878597999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 12:59:21.807679  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:21.778184  5904 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:21.848856  5898 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:21.848990  5904 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:21.849727  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.830237  5748 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:21.778368  5897 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:21.850255  5748 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:21.852417  5897 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:21.843015  5892 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:59:21.854668  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:21.856091  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:21.856380  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 48845.7us
I20260709 12:59:21.856704  2421 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:21.857125  1497 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:21.858628  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:21.859177  5893 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:21.861931  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:21.863021  1531 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:21.864356  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:21.865067  1531 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.870777  5904 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:21.769690  5908 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:21.985762  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:21.986972  1532 raft_consensus.cc:2410] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:59:21.993453  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.859206  1527 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
W20260709 12:59:21.983000  5910 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:59:21.983886  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 103974us
I20260709 12:59:21.994257  2421 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:22.004374  5795 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:22.005224  5795 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.002847  5899 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:22.006878  5899 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:22.008041  5795 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:21.852416  5748 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.026052  5894 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:22.027009  5894 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.029387  1531 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 12:59:22.030925  1649 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38994 dropped due to backpressure: service queue is full with 50 items
I20260709 12:59:21.849433  5898 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:21.869195  5905 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.037747  5898 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:22.051028  1678 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:22.056437  5905 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:22.061149  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.031323  1649 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38994 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2196)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2197)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2270)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2277)
W20260709 12:59:22.088109  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 280521us
I20260709 12:59:22.072559  5904 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.097673  5923 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:22.098448  5923 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:22.098977  5923 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.102339  5904 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.103363  5904 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.104059  5904 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:22.082345  5924 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.106657  5924 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:22.110388  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.117524  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.124504  5904 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.128000  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.128754  2428 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:22.132301  1676 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:59:22.134488  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.135555  1605 raft_consensus.cc:2410] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:22.130991  1649 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38982 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2196)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2197)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2270)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2277)
W20260709 12:59:22.144115  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.148154  5924 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.148524  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.149721  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.150585  1606 raft_consensus.cc:2393] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:22.152606  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.152249  5923 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.153501  1604 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:22.153548  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.155740  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.158095  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 880) took 1595 ms. Trace:
I20260709 12:59:22.158555  1533 rpcz_store.cc:276] 0709 12:59:20.562447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.571465 (+  9018us) service_pool.cc:224] Handling call
0709 12:59:20.571714 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.532261 (+960547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.157854 (+625593us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54003f57d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:22.158035 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204937600}
I20260709 12:59:22.160332  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:22.160991  2474 raft_consensus.cc:2376] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
I20260709 12:59:22.161096  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.151533  1649 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38982 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2196)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2197)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2270)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2277)
I20260709 12:59:22.162577  1681 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:22.163674  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.163497  1649 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38982 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2196)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2197)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2270)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2277)
I20260709 12:59:22.177889  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.179770  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.178828  2428 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:22.183822  1681 raft_consensus.cc:2376] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6. Re-sending same reply.
I20260709 12:59:22.185372  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.186182  1681 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:22.190589  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.191772  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:22.192749  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.193354  2461 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:22.194900  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:22.195283  5751 consensus_meta.cc:287] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.767s	user 0.017s	sys 0.007s
I20260709 12:59:22.195992  5751 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.165788  5898 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.195712  2474 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 13: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:22.202061  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:22.196724  5894 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.204435  5923 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.205865  1500 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:22.197755  1683 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:22.205780  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.196785  2461 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:59:22.201292  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 852) took 3587 ms. Trace:
I20260709 12:59:22.215602  2461 pending_rounds.cc:85] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 7
I20260709 12:59:22.218576  2461 pending_rounds.cc:107] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:59:22.219388  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:22.221021  2461 raft_consensus.cc:2889] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:22.200806  1649 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38994 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38994 (request call id 2185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2196)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2270)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2277)
I20260709 12:59:22.215605  1529 rpcz_store.cc:276] 0709 12:59:18.613614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.696454 (+1082840us) service_pool.cc:224] Handling call
0709 12:59:19.696901 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:22.025152 (+2328251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.025201 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:22.025260 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:22.025315 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.201061 (+175746us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b5400211bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:22.201106 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:22.201227 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":78,"spinlock_wait_cycles":164734720}
W20260709 12:59:22.200192  5729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.755s	user 0.015s	sys 0.026s
I20260709 12:59:22.222723  2474 raft_consensus.cc:1240] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.224182  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.210172  5904 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.230127  1680 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:22.231367  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.232681  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.233217  1680 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:22.233636  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.230324  5904 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.236184  5904 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:22.236830  5729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.796s	user 0.019s	sys 0.026s
I20260709 12:59:22.237543  5893 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:22.238143  5893 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:22.239153  5893 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.239596  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.240298  1678 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:22.240602  5801 consensus_queue.cc:1059] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:22.241187  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.241719  5801 raft_consensus.cc:3055] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:22.222138  5908 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:22.242282  5801 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:22.241808  1678 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.239602  1575 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.244519  1681 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:22.198920  5898 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.249300  1575 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:22.246592  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.199288  5751 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.245443  5908 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.256275  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:22.256702  5908 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:22.258762  5733 consensus_meta.cc:287] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 1.867s	user 0.014s	sys 0.008s
I20260709 12:59:22.223742  5894 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:22.249801  5904 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:22.216252  5605 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:22.259239  5733 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.255051  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.255239  5923 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:22.243242  5801 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.257151  5924 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:22.255478  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:22.245790  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:22.259523  1575 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:22.303171  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.311772  5577 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:22.311654  1676 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
W20260709 12:59:22.311975  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 52515.4us
I20260709 12:59:22.300344  5793 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.294865  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.314617  5924 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:22.315493  1609 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:22.290234  5899 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.316046  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:22.316630  5904 raft_consensus.cc:697] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:22.316685  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.317764  1676 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 6.
I20260709 12:59:22.317881  5904 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.318960  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.319938  5733 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.317662  5577 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:22.321504  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 77711.1us
I20260709 12:59:22.321772  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 969) took 2110 ms. Trace:
I20260709 12:59:22.320029  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.323876  5733 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:22.315627  5924 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.328374  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.383531  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.384218  2475 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:22.317279  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.385967  2476 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:22.322293  1677 rpcz_store.cc:276] 0709 12:59:20.211856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.214235 (+  2379us) service_pool.cc:224] Handling call
0709 12:59:20.214603 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:20.215009 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:20.215044 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:20.215612 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:59:20.373708 (+158096us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:20.373751 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.386838 (+ 13087us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:22.321551 (+1934713us) raft_consensus.cc:1685] finished
0709 12:59:22.321593 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:22.321719 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":157727,"threads_started":1,"wal-append.queue_time_us":231718,"wal-append.run_cpu_time_us":2461,"wal-append.run_wall_time_us":1049799}
I20260709 12:59:22.389043  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.389956  1677 raft_consensus.cc:2410] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:59:22.390781  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.391417  1677 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:22.392247  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:22.306152  5682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.885s	user 0.019s	sys 0.026s
W20260709 12:59:22.393589  5682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.973s	user 0.019s	sys 0.030s
I20260709 12:59:22.393307  5694 consensus_queue.cc:1048] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:22.330797  5751 raft_consensus.cc:2764] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:22.259315  5908 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.332567  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:22.322978  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.300891  1678 raft_consensus.cc:2410] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:22.331396  5605 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:22.333492  5801 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.348232  5849 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:22.348491  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.332837  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.264890  1680 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
W20260709 12:59:22.351423  5931 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:59:22.333714  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.414778  1681 raft_consensus.cc:2410] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:59:22.416075  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.333741  5894 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:22.418044  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:22.418124  5894 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.405146  5605 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.422607  5056 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.338840  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.423480  1675 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:22.417038  1681 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:22.344525  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.346530  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.425108  2451 raft_consensus.cc:2393] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 12:59:22.347455  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.344635  1575 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.957s (SENT)
W20260709 12:59:22.343729  5745 consensus_meta.cc:287] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.959s	user 0.026s	sys 0.013s
I20260709 12:59:22.352365  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.358084  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:22.430570  1525 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:22.364537  1497 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.736s (SENT)
I20260709 12:59:22.367152  5719 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.404801  5751 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:22.369334  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:22.396687  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.403420  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:22.403688  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:22.404695  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 81783us
W20260709 12:59:22.408054  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.436827  2342 connection.cc:256] RPC call timeout handler was delayed by -1.4660835349999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 12:59:22.409070  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.425882  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.427320  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.430796  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.368551  1533 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:22.433274  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 840) took 1964 ms. Trace:
I20260709 12:59:22.433988  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.438772  2451 rpcz_store.cc:276] 0709 12:59:20.462076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.346260 (+1884184us) service_pool.cc:224] Handling call
0709 12:59:22.426711 (+ 80451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:22.439468  5899 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:22.434191  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:22.439558  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 75031.8us
I20260709 12:59:22.436070  1678 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:22.440991  1675 raft_consensus.cc:2410] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:59:22.441591  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.441943  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.442425  1678 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:22.442584  1675 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:22.443629  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.446511  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.447279  2423 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 12:59:22.447532  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 102940us
I20260709 12:59:22.448644  5908 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:22.449057  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.002s	user 0.013s	sys 0.005s
I20260709 12:59:22.443783  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.449990  1678 raft_consensus.cc:2393] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:59:22.437228  2342 connection.cc:256] RPC call timeout handler was delayed by -1.3796835349999697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 12:59:22.450531  2342 connection.cc:256] RPC call timeout handler was delayed by -1.3076835350000238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 12:59:22.450902  2342 connection.cc:256] RPC call timeout handler was delayed by -1.2406598860000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:59:22.451223  2342 connection.cc:256] RPC call timeout handler was delayed by -1.0025835349999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 12:59:22.451699  1677 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:22.447356  1679 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:22.452613  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:22.444600  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.449113  1575 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:22.456804  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.010s	user 0.013s	sys 0.006s
W20260709 12:59:22.457234  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 2.0101e+06us
I20260709 12:59:22.457284  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.458370  1678 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:22.459051  1647 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.459415  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.460291  1678 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.460809  5748 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:22.460345  5908 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:22.414018  5849 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.434726  5892 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.465003  5849 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:22.468030  5892 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.461905  5733 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:22.470619  5733 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:22.471621  5733 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:22.464021  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.474004  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:22.474675  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.475728  1649 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:22.476250  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.476562  5795 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:22.476738  1649 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.465667  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.478400  1679 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:22.478801  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.931s	user 0.054s	sys 0.059s
W20260709 12:59:22.479344  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.932s	user 0.054s	sys 0.059s
I20260709 12:59:22.479508  1678 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
W20260709 12:59:22.479674  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 1.93185e+06us
I20260709 12:59:22.467374  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.486116  1681 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.477313  5795 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:22.480731  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.487159  1678 raft_consensus.cc:2393] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:22.487258  1600 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:22.487398  5795 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.487969  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.432310  5745 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:22.488560  1678 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:22.463305  5908 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.489935  5908 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.490291  5745 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:22.490921  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.491712  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.492349  1680 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:22.466440  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.485941  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:22.477474  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.494230  1682 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.494164  1602 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.497056  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:22.498521  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.502628  2461 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
W20260709 12:59:22.510519  1575 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.960s (SENT)
I20260709 12:59:22.511510  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.512110  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:22.518216  1675 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:22.518080  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.519063  1609 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:22.513356  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:22.525887  1680 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:22.523793  1683 raft_consensus.cc:2376] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
I20260709 12:59:22.511045  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.529357  2342 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:22.531623  1681 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:22.481387  5748 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:22.535526  1678 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
I20260709 12:59:22.461181  5924 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.553804  1602 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:22.543865  5605 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:22.566982  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 49245.3us
I20260709 12:59:22.575101  5924 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.576232  5798 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:22.535321  5748 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.577162  5748 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.577312  5719 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:22.534806  5745 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:22.556563  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800313a20 after lost signal to thread 1466
I20260709 12:59:22.577164  5798 consensus_queue.cc:1059] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:59:22.579609  5605 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.558710  1677 raft_consensus.cc:1240] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.533953  5751 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:22.538511  5933 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:59:22.582211  1677 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:22.538782  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 72419.6us
I20260709 12:59:22.583555  1677 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:22.585110  1677 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:22.560232  1683 raft_consensus.cc:1217] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-8.8]   Dedup: 6.7->[8.8-8.8]
I20260709 12:59:22.585886  1683 raft_consensus.cc:1240] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:59:22.586585  5908 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.589579  1677 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:59:22.590727  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 80247.7us
I20260709 12:59:22.593238  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:22.589777  5795 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.594980  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.595724  1609 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:22.596215  5605 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:22.597134  1679 raft_consensus.cc:2410] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:22.556636  1682 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:22.598606  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:22.534687  5801 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:59:22.605203  5733 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:22.605525  5798 raft_consensus.cc:3055] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:22.606091  5798 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.603406  5719 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:59:22.606565  5894 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:22.606958  5894 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:22.607147  5798 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.607834  5894 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:22.602119  5694 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:22.609133  5694 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.610954  5694 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.612311  5694 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:22.612210  5908 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.609505  5894 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.565598  5905 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:22.614569  5905 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:22.615027  5905 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.617789  5605 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:22.618902  5605 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.620263  5748 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:22.622008  5795 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.622524  5795 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.608628  5798 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.624543  5795 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.625065  5795 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.625519  5795 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:22.626405  5940 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:59:22.627624  5795 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:22.627769  5826 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.622841  5748 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:22.630748  5826 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:22.631330  5826 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.632319  5826 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:22.649179  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 50662.6us
I20260709 12:59:22.650583  2342 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.651768  5905 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.652307  5719 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:22.651185  5694 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:22.653018  5719 raft_consensus.cc:697] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.654925  5905 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.655905  5905 consensus_queue.cc:1059] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:22.656142  2342 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:22.657371  5849 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:22.657953  5849 raft_consensus.cc:697] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.659266  5738 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:22.658969  5849 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.660898  5719 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.557823  1525 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:22.666900  2342 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:22.669826  5826 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:22.670372  5826 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.671170  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.671326  5826 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.672410  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.673441  5905 raft_consensus.cc:2764] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:59:22.673729  5798 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:22.674681  2342 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.674820  5738 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:22.676229  5897 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:22.741147  1676 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 10. Ops: []
I20260709 12:59:22.742871  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2191) took 1107 ms. Trace:
I20260709 12:59:22.743206  1676 rpcz_store.cc:276] 0709 12:59:21.635137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.532289 (+897152us) service_pool.cc:224] Handling call
0709 12:59:22.604050 (+ 71761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:22.741669 (+137619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.742694 (+  1025us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b54001f7a50. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:22.742814 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161020800}
W20260709 12:59:22.780318  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.826666  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 350007us
I20260709 12:59:22.827543  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.828456  5849 consensus_queue.cc:1059] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:22.829602  5719 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:22.830062  5719 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.831337  5849 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.831121  5719 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.832616  5719 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.832769  5751 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:22.834254  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.836189  1649 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:22.837420  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:22.838476  5748 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:22.838923  5748 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:22.839380  5748 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.839453  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.831988  5849 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.848477  5849 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:22.851573  5748 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.853720  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:22.870065  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:22.873659  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.874104  1602 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:22.876710  5748 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:22.878103  1575 leader_election.cc:336] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.154s (SENT)
I20260709 12:59:22.878664  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:22.877327  5748 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:22.879695  2342 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:22.880789  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.881650  5605 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:22.884369  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:22.886106  5849 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:22.886868  5722 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:22.887701  5849 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.888968  5849 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.892647  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:22.894845  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 292052us
I20260709 12:59:22.895581  1647 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:22.896363  5949 raft_consensus.cc:2764] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:22.901110  2342 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:22.904702  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 65117.9us
I20260709 12:59:22.905354  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.906277  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:22.906993  1606 raft_consensus.cc:2393] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:22.907815  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:22.909554  5719 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:22.910847  1649 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:22.924718  2476 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:22.926590  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:22.926693  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:22.930824  5950 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:22.931330  5950 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.931691  5950 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.923465  5733 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:22.933903  5733 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:22.934329  5733 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:22.928395  1647 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:22.946832  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 45787us
I20260709 12:59:22.950091  2476 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:22.910375  5719 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.955202  1647 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:22.955727  5748 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:22.959381  5748 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:22.940212  5795 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:22.961721  5748 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:22.962920  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.963429  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.964195  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.955965  5924 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:22.965637  5668 consensus_queue.cc:1059] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.966137  5924 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:22.967324  5668 raft_consensus.cc:3055] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:22.967056  5924 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.967689  5668 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:22.968561  5668 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:22.970366  5668 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:22.970557  5745 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:22.960431  5741 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:22.972662  5741 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.973050  5741 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:22.985903  5694 raft_consensus.cc:3055] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:22.986747  5694 raft_consensus.cc:740] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:22.987617  5694 consensus_queue.cc:260] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:22.989866  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.990617  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.991132  5890 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.991652  5890 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:22.972134  5804 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.988955  5694 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:23.001942  5795 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:23.002316  5890 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:23.003252  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48160.9us
I20260709 12:59:23.005332  1647 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:23.005640  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:23.006448  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.005723  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.008105  1534 raft_consensus.cc:3060] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:23.014339  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.022063  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.025219  1533 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:22.958707  5719 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:23.013012  5795 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:23.044281  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.047221  1681 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:23.045231  1531 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:23.045123  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.055023  1525 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:23.058832  1681 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:23.061467  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.011607  5605 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:59:23.064684  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 138184us
I20260709 12:59:23.035109  5949 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:23.067227  1525 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:59:23.084142  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.084743  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.084146  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.086597  1526 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:23.089388  1679 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:23.096526  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.097930  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:23.115736  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.117210  1526 raft_consensus.cc:2410] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:23.130538  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:23.130883  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:23.131235  1679 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:23.139345  5733 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:23.117962  5892 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:23.142187  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.143035  1525 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:23.143792  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.144769  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.145313  1525 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:23.146103  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.146018  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:23.150684  1606 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:23.155109  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.156734  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.157490  1532 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.158728  5733 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:23.159704  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.157371  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.273640  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.274549  1528 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:23.275776  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.279983  1528 raft_consensus.cc:2410] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:23.088703  5949 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:23.298097  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.298431  1680 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:23.304121  1532 raft_consensus.cc:2468] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:23.317742  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:23.321121  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.174494  1534 raft_consensus.cc:2468] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:23.175729  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.175827  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.177220  1682 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:23.332566  1532 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:23.334578  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.337250  1606 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:23.338164  1679 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:23.339125  1528 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:23.340030  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2264) took 1336 ms. Trace:
I20260709 12:59:23.347160  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.347795  1606 raft_consensus.cc:2393] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:23.353741  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.353736  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:23.340967  1683 rpcz_store.cc:276] 0709 12:59:21.998199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.586656 (+588457us) service_pool.cc:224] Handling call
0709 12:59:22.586914 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:22.587182 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:22.976782 (+389600us) log.cc:844] Serialized 14 byte log entry
0709 12:59:23.333977 (+357195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:23.334030 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:23.334078 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.334148 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.334255 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62943,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":223147,"thread_start_us":745900,"threads_started":3,"wal-append.queue_time_us":118039}
I20260709 12:59:23.256484  5741 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:23.363488  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.337798  5751 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:23.370750  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.369693  1525 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:23.373867  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.374795  1606 raft_consensus.cc:2376] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7. Re-sending same reply.
I20260709 12:59:23.378504  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.380962  1525 raft_consensus.cc:2410] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:23.384549  1676 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:59:23.382997  5959 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:59:23.388886  5953 log.cc:927] Time spent T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 12:59:23.389324  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 363) took 30151 ms (client timeout 15000 ms). Trace:
W20260709 12:59:23.393676  5962 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.258s	user 0.001s	sys 0.002s
I20260709 12:59:23.395450  5949 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:23.397696  5954 log.cc:927] Time spent T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260709 12:59:23.401129  5955 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 12:59:23.448082  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:23.448464  1607 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:23.448856  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:23.449297  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:23.449875  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:23.451114  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:23.451799  2435 raft_consensus.cc:2368] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:23.452632  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:23.406252  5741 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:23.406492  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2277) took 1384 ms. Trace:
W20260709 12:59:23.409154  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080032d560 after lost signal to thread 1558
W20260709 12:59:23.454851  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080028bf80 after lost signal to thread 1559
W20260709 12:59:23.456159  1555 debug-util.cc:398] Leaking SignalData structure 0x7b080026aaa0 after lost signal to thread 1633
W20260709 12:59:23.456429  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08003f6320 after lost signal to thread 1634
I20260709 12:59:23.411055  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2221) took 1263 ms. Trace:
I20260709 12:59:23.411736  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:23.412027  1679 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:23.413462  1675 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: []
W20260709 12:59:23.457463  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08004105a0 after lost signal to thread 1707
I20260709 12:59:23.413877  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:23.414606  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.415416  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.416071  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:23.416733  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.458148  1682 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:23.417855  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.385538  5950 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:23.426005  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:23.468063  2428 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:23.427539  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:23.433533  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.478771  1525 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:23.480792  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:23.481768  1532 raft_consensus.cc:2376] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
W20260709 12:59:23.484385  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.490468  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:23.436329  1427 rpcz_store.cc:269] 0709 12:58:53.181393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.195288 (+ 13895us) service_pool.cc:224] Handling call
0709 12:59:23.314552 (+30119264us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:11.170574 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:11.306030 (+135456us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:11.306113 (+    83us) write_op.cc:435] Acquired schema lock
0709 12:59:11.306134 (+    21us) tablet.cc:662] Decoding operations
0709 12:59:11.522389 (+216255us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:11.522496 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:11.522531 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:59:11.706524 (+183993us) tablet.cc:701] Row locks acquired
0709 12:59:11.743176 (+ 36652us) write_op.cc:260] PREPARE: finished
0709 12:59:11.767448 (+ 24272us) write_op.cc:270] Start()
0709 12:59:11.783304 (+ 15856us) write_op.cc:276] Timestamp: P: 1783601951756764 usec, L: 0
0709 12:59:11.784679 (+  1375us) op_driver.cc:348] REPLICATION: starting
0709 12:59:11.901001 (+116322us) log.cc:844] Serialized 4446 byte log entry
0709 12:59:12.219096 (+318095us) op_driver.cc:464] REPLICATION: finished
0709 12:59:12.446818 (+227722us) write_op.cc:301] APPLY: starting
0709 12:59:12.458378 (+ 11560us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:12.647042 (+188664us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:12.698700 (+ 51658us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:12.827593 (+128893us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:12.938087 (+110494us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:59:12.946686 (+  8599us) write_op.cc:312] APPLY: finished
0709 12:59:13.006412 (+ 59726us) log.cc:844] Serialized 83 byte log entry
0709 12:59:13.073245 (+ 66833us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:13.130076 (+ 56831us) write_op.cc:454] Released schema lock
0709 12:59:13.140921 (+ 10845us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:13.231219 (+ 90298us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:13.235858 (+  4639us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4115873,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":198057,"apply.run_cpu_time_us":8707,"apply.run_wall_time_us":739046,"num_ops":11,"prepare.queue_time_us":229124,"prepare.run_cpu_time_us":11170,"prepare.run_wall_time_us":795533,"raft.queue_time_us":20318,"raft.run_cpu_time_us":102307,"raft.run_wall_time_us":145804,"replication_time_us":434222,"thread_start_us":270732,"threads_started":4,"wal-append.queue_time_us":92171,"wal-append.run_cpu_time_us":15444,"wal-append.run_wall_time_us":2151234}]]}
W20260709 12:59:23.439169  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.454440  1607 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:59:23.454172  1678 rpcz_store.cc:276] 0709 12:59:22.022153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.603607 (+581454us) service_pool.cc:224] Handling call
0709 12:59:22.603884 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:22.609602 (+  5718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.609636 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:22.609680 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:22.609718 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.406313 (+796595us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.406437 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.456900  1604 rpcz_store.cc:276] 0709 12:59:22.148006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.148154 (+   148us) service_pool.cc:224] Handling call
0709 12:59:23.410901 (+1262747us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b54000ed154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:23.411003 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9066240}
I20260709 12:59:23.461371  1526 raft_consensus.cc:2376] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6. Re-sending same reply.
W20260709 12:59:23.466526  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08004107c0 after lost signal to thread 1708
I20260709 12:59:23.466969  1529 raft_consensus.cc:2393] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:23.499245  1555 debug-util.cc:398] Leaking SignalData structure 0x7b0800300b20 after lost signal to thread 2510
W20260709 12:59:23.500797  1555 debug-util.cc:398] Leaking SignalData structure 0x7b08003eede0 after lost signal to thread 5839
I20260709 12:59:23.508066  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:23.521862  1606 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:59:23.524770  1683 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:23.532377  1604 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:23.514052  5949 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:23.542308  1606 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:23.518471  5924 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:23.546106  5804 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.001s
I20260709 12:59:23.537724  5748 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:59:23.552502  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.515185  5973 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:59:23.932826  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.564157  5960 log.cc:927] Time spent T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.428s	user 0.002s	sys 0.000s
W20260709 12:59:23.933468  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.565928  5949 raft_consensus.cc:697] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:23.934664  5949 consensus_queue.cc:237] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:23.523274  5798 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.939675  5798 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:23.548616  1525 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:23.595490  5924 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:23.944737  5924 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:23.945690  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.637832  5892 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:23.947288  5892 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:23.950964  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:23.952157  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:23.653523  1530 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:23.954767  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.955696  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 769) took 1360 ms. Trace:
I20260709 12:59:23.956043  1600 rpcz_store.cc:276] 0709 12:59:22.594921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.597962 (+  3041us) service_pool.cc:224] Handling call
0709 12:59:23.955626 (+1357664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.957103  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.957947  1600 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:23.649052  5968 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.959112  5968 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:23.961548  5968 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:23.961687  1607 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:23.664104  1649 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:23.962862  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 298844us
I20260709 12:59:23.963717  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:23.965026  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:23.732402  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.653903  5972 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:23.967128  5972 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:23.969866  5924 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.970438  5924 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:23.761615  5980 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:59:23.792104  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.806049  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 150889us
I20260709 12:59:23.836472  1428 catalog_manager.cc:5697] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:23.859820  1572 leader_election.cc:336] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38982 dropped due to backpressure: service queue is full with 50 items
I20260709 12:59:23.698329  1674 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:59:23.700745  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:23.653815  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:23.573911  1683 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:23.568210  1679 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:59:23.656358  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:23.697458  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:23.874372  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 159354us
I20260709 12:59:23.874861  5950 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:23.849231  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 342623us
W20260709 12:59:23.882720  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 52667.9us
I20260709 12:59:24.223910  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:24.225083  1575 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:23.890933  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.892148  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.893244  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:23.894690  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.895740  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.896375  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:24.226490  5996 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:23.898276  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:24.227641  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:24.227986  1602 raft_consensus.cc:2393] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:24.228381  1606 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:24.228096  5996 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:24.228960  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:24.229115  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.899610  1604 raft_consensus.cc:1240] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:59:24.230165  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:24.231388  1604 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:24.231737  1606 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:24.235285  5988 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:24.235801  5988 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.236167  5988 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.975327  5968 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:23.978193  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 118412us
W20260709 12:59:24.238099  1572 leader_election.cc:336] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38982 dropped due to backpressure: service queue is full with 50 items
W20260709 12:59:24.238988  1572 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38982 dropped due to backpressure: service queue is full with 50 items
I20260709 12:59:24.239362  1572 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:24.240128  5951 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.241252  1572 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:24.241994  5951 raft_consensus.cc:2764] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:59:24.243264  1572 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:24.244182  1572 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:24.244714  5951 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:23.969386  5972 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.245200  5951 raft_consensus.cc:697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:23.980103  1428 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 6 to 7, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.246137  5951 consensus_queue.cc:237] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:24.247905  1428 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 7, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.248793  1575 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:23.985473  1498 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:24.250134  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 264739us
I20260709 12:59:23.987013  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:24.251060  5668 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.251677  5668 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:24.251906  5804 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.252177  5668 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.252447  5804 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.254343  5804 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:23.990226  1530 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:24.254830  5668 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.255187  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2070) took 7867 ms. Trace:
I20260709 12:59:24.255514  1530 rpcz_store.cc:276] 0709 12:59:16.388170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.388281 (+   111us) service_pool.cc:224] Handling call
0709 12:59:16.388528 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.161406 (+2772878us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b58005066d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d18f40aa 00007f25d1976447 00007f25d198efe7 00007f25d19907de 00007f25d199ab49 00007f25d199b416 00007f25d1997d8f 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4
0709 12:59:23.517216 (+4355810us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400262b20. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d190da1d 00007f25d18f41a4 00007f25d1976447 00007f25d198efe7 00007f25d19907de 00007f25d199ab49 00007f25d199b416 00007f25d1997d8f 00007f25d199783e 00007f25d695c419
0709 12:59:24.254861 (+737645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.255114 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465986176}
I20260709 12:59:23.994094  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.973335  5751 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:24.258225  5751 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.258634  5751 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:24.259034  1428 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 5 to 8, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.983462  5798 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:23.998749  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.012215  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.016602  5967 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 12:59:23.972023  5892 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.266763  5731 raft_consensus.cc:2804] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:23.976008  5924 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.267818  5998 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:59:24.023190  2339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.007s	sys 0.007s
W20260709 12:59:24.268751  2339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.008s	sys 0.008s
W20260709 12:59:24.269043  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 760303us
W20260709 12:59:24.024152  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.269487  5605 raft_consensus.cc:2764] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:59:24.270114  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.270522  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.053130  5733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.006s	sys 0.011s
W20260709 12:59:24.273784  5733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.007s	sys 0.011s
I20260709 12:59:22.609176  1677 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:24.274956  5941 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:24.276333  5941 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.276697  5941 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:24.109790  5979 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.366s	user 0.002s	sys 0.000s
I20260709 12:59:24.152539  6000 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.278220  6000 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:24.280926  1497 leader_election.cc:336] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.686s (SENT)
I20260709 12:59:24.186857  5964 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:24.281725  5964 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:24.282593  5964 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:24.283511  5964 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:24.196769  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:24.210271  1678 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 9: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:24.285843  1527 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:24.226055  1603 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:24.226544  1608 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:24.232538  1604 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:23.913105  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.230173  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:24.290552  1676 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:24.233459  1609 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 11: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:24.226089  1605 raft_consensus.cc:2393] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:24.229550  5996 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.235116  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:23.965070  1649 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.257083  5889 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:24.293221  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 328206us
I20260709 12:59:24.275023  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2276) took 2253 ms. Trace:
W20260709 12:59:24.096232  5965 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.457s	user 0.002s	sys 0.000s
I20260709 12:59:24.294190  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.267345  5731 raft_consensus.cc:697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:24.295174  5733 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:24.295549  5731 consensus_queue.cc:237] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:24.296417  5741 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:24.296559  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.293897  1677 rpcz_store.cc:276] 0709 12:59:22.021833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.592512 (+570679us) service_pool.cc:224] Handling call
0709 12:59:22.592770 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.274730 (+1681960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.274970 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:24.297272  5741 consensus_queue.cc:1059] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:24.292980  5889 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.297756  5950 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:24.298272  5741 raft_consensus.cc:3055] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:24.298506  5972 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:24.298732  5741 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:24.298776  5950 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:24.299623  5950 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:24.300478  5950 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.316756  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.317191  5889 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.317780  5972 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:24.319324  1649 leader_election.cc:400] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:24.319862  1649 leader_election.cc:403] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:59:24.320475  5972 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:24.281378  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:24.321656  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.321807  5950 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:24.322109  5741 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.323643  5741 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:24.323727  5941 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:24.325935  5972 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:24.328219  1533 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:24.294231  6000 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.330159  6000 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:24.330855  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 82130.8us
W20260709 12:59:24.330989  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 50099.3us
W20260709 12:59:24.331521  1497 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.713s (SENT)
I20260709 12:59:24.331617  1575 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:24.331902  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:24.332532  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.332587  5924 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:24.333405  5972 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:24.333772  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64132.7us
I20260709 12:59:24.334837  2339 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.334932  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:24.336089  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:24.336736  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:24.336954  5736 consensus_queue.cc:1059] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:24.337709  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.338143  5741 raft_consensus.cc:2764] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:59:24.338410  1682 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:24.338546  5736 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:24.339251  5736 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:24.339493  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:24.340679  5682 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:24.341092  5694 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.341481  5682 raft_consensus.cc:3055] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:24.341642  5694 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.343910  5694 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:24.344827  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.345604  5924 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:24.345954  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:24.346764  1678 raft_consensus.cc:2410] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:24.342026  5682 raft_consensus.cc:740] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:24.347147  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:24.348099  5924 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:24.347896  5682 consensus_queue.cc:260] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.349699  1676 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
W20260709 12:59:24.350826  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.350867  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:24.351645  2344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.520s (SENT) [suppressed 70 similar messages]
I20260709 12:59:24.352051  1679 raft_consensus.cc:2376] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
I20260709 12:59:24.352828  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.353102  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.354095  1681 raft_consensus.cc:2393] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 5: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:24.353984  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:24.354925  1678 raft_consensus.cc:2410] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:24.354802  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.355021  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:24.355365  1680 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:24.355679  1682 raft_consensus.cc:2376] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14. Re-sending same reply.
I20260709 12:59:24.357517  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.357669  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.358274  1674 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:24.358690  5941 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:24.359115  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:24.359532  5798 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.353107  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:24.360713  5722 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.361436  1527 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:24.353374  1676 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:24.361176  5722 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.340209  5736 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.362567  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.363727  5722 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:24.349349  5682 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:24.364377  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:24.366376  1681 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:24.360009  5798 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.353200  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:24.332897  1497 leader_election.cc:336] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.864s (SENT)
I20260709 12:59:24.377648  1679 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:24.380120  1608 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
W20260709 12:59:24.399189  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 47573.5us
W20260709 12:59:24.383571  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.402493  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.384393  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:24.385259  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 49235.8us
I20260709 12:59:24.404590  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.405756  1683 raft_consensus.cc:2410] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:24.406417  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.407438  1679 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:24.409461  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.386206  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.390476  2476 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:24.411856  1680 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:24.385771  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:24.389592  2428 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:59:24.413374  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 80484.2us
I20260709 12:59:24.372845  1572 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:24.376622  1575 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:24.384120  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.416950  1674 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:24.388720  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2098) took 1374 ms. Trace:
I20260709 12:59:24.418649  1527 rpcz_store.cc:276] 0709 12:59:23.014427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.193358 (+1178931us) service_pool.cc:224] Handling call
0709 12:59:24.388647 (+195289us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:24.388068  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2101) took 1294 ms (client timeout 1518 ms). Trace:
W20260709 12:59:24.420171  1533 rpcz_store.cc:269] 0709 12:59:23.035588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.044903 (+  9315us) service_pool.cc:224] Handling call
0709 12:59:24.329421 (+1284518us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000c7bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:24.329529 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822950272}
I20260709 12:59:24.391896  5722 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.376236  5798 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:24.377754  6000 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:24.414258  1497 leader_election.cc:336] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.901s (SENT)
I20260709 12:59:24.435020  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:24.428543  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 51987.5us
W20260709 12:59:24.432699  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 59922us
I20260709 12:59:24.437541  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:24.439234  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:24.380899  5741 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.425381  5892 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.422111  5722 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.440826  5996 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:24.433920  5668 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:24.441337  5736 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.425585  5694 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.443791  2339 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.416152  5889 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.369526  5988 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:24.378368  5731 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:24.474404  5719 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.489754  1572 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:24.491039  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47329us
I20260709 12:59:24.441687  5972 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:59:24.443226  5951 raft_consensus.cc:2804] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:24.471637  5996 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.492024  5804 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:24.442545  5605 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:24.490101  5668 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:24.497684  6008 log.cc:927] Time spent T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
I20260709 12:59:24.430505  5973 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
W20260709 12:59:24.503401  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.503984  5722 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:24.505054  5733 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.372571  5924 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:59:24.442890  5987 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:24.508944  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.422960  1498 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.513120  5996 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:24.494772  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 58112.4us
W20260709 12:59:24.511091  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64831us
I20260709 12:59:24.510888  5719 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.514289  5908 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:24.493877  5798 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:24.520889  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 106696us
I20260709 12:59:24.475328  5892 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.494006  5694 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.448494  5849 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:59:24.509411  5826 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:24.426112  5941 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:59:24.529635  1572 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:24.512092  5998 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:24.492367  5736 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:24.554905  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.450007  5741 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:24.557302  5733 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:24.558544  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 135673us
I20260709 12:59:24.562124  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:24.564976  5849 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:24.564699  5733 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.565351  5849 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:24.566195  5849 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.566560  5988 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:24.566931  5733 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.556336  5908 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:24.567358  5849 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:24.568361  5987 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:24.568195  5908 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:24.571125  1498 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.574249  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.574553  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:24.575475  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.560393  5722 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:24.584482  1572 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:24.585783  1572 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:24.587198  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:24.587307  2342 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Timed out: RequestConsensusVote RPC to 127.0.107.194:35057 timed out after 2.027s (SENT)
I20260709 12:59:24.588564  6012 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:24.541963  5605 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:59:24.571849  6002 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:59:24.603852  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800108220 after lost signal to thread 434
I20260709 12:59:24.591243  1572 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:24.572913  5889 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.600116  5924 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:24.606307  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001cfca0 after lost signal to thread 1427
W20260709 12:59:24.616571  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001aace0 after lost signal to thread 1428
W20260709 12:59:24.617129  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001aaaa0 after lost signal to thread 1439
W20260709 12:59:24.617805  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8680 after lost signal to thread 1463
W20260709 12:59:24.618098  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001c84c0 after lost signal to thread 1466
W20260709 12:59:24.618463  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca0a0 after lost signal to thread 1486
I20260709 12:59:24.580307  5987 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:24.600855  5668 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:24.619099  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa8a0 after lost signal to thread 1511
I20260709 12:59:24.603163  5988 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:24.559590  5826 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.590271  5731 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:24.563402  5998 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.571637  5798 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:59:24.583420  5722 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.582870  6000 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:24.623845  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7620 after lost signal to thread 1558
I20260709 12:59:24.564726  5719 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:24.633342  1704 debug-util.cc:398] Leaking SignalData structure 0x7b080017b1a0 after lost signal to thread 1559
W20260709 12:59:24.633824  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800156a60 after lost signal to thread 1568
W20260709 12:59:24.634160  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6b60 after lost signal to thread 1573
W20260709 12:59:24.634806  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800291c20 after lost signal to thread 1600
W20260709 12:59:24.635174  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800342860 after lost signal to thread 1604
W20260709 12:59:24.635522  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002be7c0 after lost signal to thread 1610
W20260709 12:59:24.635941  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb600 after lost signal to thread 1622
W20260709 12:59:24.636271  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002be720 after lost signal to thread 1625
W20260709 12:59:24.636582  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae5c0 after lost signal to thread 1626
W20260709 12:59:24.636906  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3820 after lost signal to thread 1630
W20260709 12:59:24.637216  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3d00 after lost signal to thread 1632
W20260709 12:59:24.637511  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae820 after lost signal to thread 1633
W20260709 12:59:24.637923  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002bea00 after lost signal to thread 1634
I20260709 12:59:24.580106  5804 consensus_queue.cc:1059] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:59:24.638476  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003d37e0 after lost signal to thread 1647
W20260709 12:59:24.641266  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800286cc0 after lost signal to thread 1648
W20260709 12:59:24.641669  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002be960 after lost signal to thread 1649
W20260709 12:59:24.642027  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3c40 after lost signal to thread 1650
W20260709 12:59:24.643321  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae420 after lost signal to thread 1707
I20260709 12:59:24.622701  5987 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.631618  5951 raft_consensus.cc:697] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:24.643942  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2fe0 after lost signal to thread 1708
I20260709 12:59:24.627874  5988 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:24.710101  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 118969us
W20260709 12:59:24.689749  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.645049  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.712054  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800198e80 after lost signal to thread 2510
I20260709 12:59:24.714311  1681 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:59:24.714747  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 137249us
I20260709 12:59:24.640025  5731 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:24.629690  5668 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:59:24.640511  5924 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:24.640167  5722 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:24.716176  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 158224us
I20260709 12:59:24.712499  5987 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:24.726438  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:24.761672  1678 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:24.726998  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.687983  6002 raft_consensus.cc:3055] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:59:24.731216  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.735164  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 206205us
I20260709 12:59:24.766423  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:24.735924  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 201645us
W20260709 12:59:24.768414  1497 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.032s (SENT)
I20260709 12:59:24.769013  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.770350  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.751433  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.774446  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.775378  1679 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:24.683168  5998 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.679352  5741 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:24.713109  5988 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:24.718984  1498 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.712632  5950 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:24.763012  1681 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:24.725879  5694 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:24.716581  5719 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:24.771347  1676 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:24.798614  1676 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:24.759269  5924 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.783304  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:24.806511  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 87634.3us
I20260709 12:59:24.808096  1498 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.808213  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:24.758708  5751 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:24.812011  1497 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.075s (SENT)
I20260709 12:59:24.813230  1683 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:24.813282  1497 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.808863  1681 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
W20260709 12:59:24.826062  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.754972  6000 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:59:24.829155  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.829442  1678 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:24.764460  6002 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:24.833492  2461 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:24.842912  2435 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:59:24.842209  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.844571  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:24.844842  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 67951.2us
I20260709 12:59:24.845427  2435 raft_consensus.cc:2410] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:24.782675  6019 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:59:24.848639  1649 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.730s (SENT)
W20260709 12:59:24.848826  1497 leader_election.cc:336] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.096s (SENT)
I20260709 12:59:24.797525  5719 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:24.811460  5668 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:24.812804  5924 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:24.851634  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.849910  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.883450  2421 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:24.813112  6018 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:24.849516  1497 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:24.849872  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.872872  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.849354  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.886844  2435 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:24.829099  5908 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:24.851986  1677 raft_consensus.cc:2368] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12.
I20260709 12:59:24.779898  6013 consensus_queue.cc:1059] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:59:24.832653  5849 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:24.893122  5741 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:24.893236  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 45115.6us
I20260709 12:59:24.907559  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.847597  5972 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:24.826663  5889 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 12:59:24.908499  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.908571  1649 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.807s (SENT)
I20260709 12:59:24.908370  2421 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:24.893666  6023 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:24.827855  5950 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.917052  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:24.812209  6016 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:59:24.917788  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.909016  6014 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:24.830435  5951 consensus_queue.cc:237] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:25.022325  2507 debug-util.cc:398] Leaking SignalData structure 0x7b0800222ca0 after lost signal to thread 434
I20260709 12:59:24.917338  5668 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:25.030414  2507 debug-util.cc:398] Leaking SignalData structure 0x7b08003123e0 after lost signal to thread 1466
W20260709 12:59:25.031632  2507 debug-util.cc:398] Leaking SignalData structure 0x7b0800319260 after lost signal to thread 1525
W20260709 12:59:25.032009  2507 debug-util.cc:398] Leaking SignalData structure 0x7b0800312580 after lost signal to thread 1530
W20260709 12:59:25.032323  2507 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0720 after lost signal to thread 1534
W20260709 12:59:25.032593  2507 debug-util.cc:398] Leaking SignalData structure 0x7b08003120e0 after lost signal to thread 1536
W20260709 12:59:25.033095  2507 debug-util.cc:398] Leaking SignalData structure 0x7b08003121e0 after lost signal to thread 1555
W20260709 12:59:25.033419  2507 debug-util.cc:398] Leaking SignalData structure 0x7b0800312120 after lost signal to thread 1558
W20260709 12:59:25.033720  2507 debug-util.cc:398] Leaking SignalData structure 0x7b0800312080 after lost signal to thread 1559
W20260709 12:59:25.035125  2507 debug-util.cc:398] Leaking SignalData structure 0x7b0800163900 after lost signal to thread 1633
W20260709 12:59:25.035678  2507 debug-util.cc:398] Leaking SignalData structure 0x7b080036ae40 after lost signal to thread 1634
W20260709 12:59:25.039112  2507 debug-util.cc:398] Leaking SignalData structure 0x7b0800307480 after lost signal to thread 1707
W20260709 12:59:25.040215  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 232165us
I20260709 12:59:24.921729  5998 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.043881  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 135331us
I20260709 12:59:25.058645  1498 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:25.068347  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:25.068768  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:25.059644  2507 debug-util.cc:398] Leaking SignalData structure 0x7b080030b080 after lost signal to thread 1708
I20260709 12:59:25.070009  2475 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:25.071837  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:25.074831  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 226008us
W20260709 12:59:25.076305  1497 leader_election.cc:336] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.096s (SENT)
I20260709 12:59:24.912094  5849 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:25.079905  2507 debug-util.cc:398] Leaking SignalData structure 0x7b080039ae20 after lost signal to thread 2510
I20260709 12:59:25.083906  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:24.976416  5751 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:24.976656  5950 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:25.132721  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.133715  2423 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:25.077500  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:25.066717  6021 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
I20260709 12:59:25.029033  5889 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:25.097368  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.146905  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 318851us
W20260709 12:59:25.147405  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.148005  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.148355  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.977737  5941 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:24.978561  5968 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:25.107546  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 341238us
I20260709 12:59:25.113307  1675 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:24.888926  5731 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:24.911566  5908 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:24.920293  5972 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.149813  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:25.152578  2461 raft_consensus.cc:2410] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:59:25.152850  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 76634us
W20260709 12:59:25.155485  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 86771.2us
I20260709 12:59:24.975709  6014 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
W20260709 12:59:25.140323  6022 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 12:59:25.245278  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.103101  5668 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:25.104550  6000 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:59:25.249066  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 99351.7us
I20260709 12:59:24.974931  6023 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.114456  5733 consensus_queue.cc:1059] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:59:24.975307  5719 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.177209  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.139779  5826 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:25.237409  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.163686  6040 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:25.244413  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 75616.5us
W20260709 12:59:25.157141  6011 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 12:59:25.081238  5998 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.245662  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.250979  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.251068  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:25.252059  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.310186  1604 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:25.157217  6019 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:25.313037  5998 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:25.313911  6019 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.253175  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.081462  6002 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:25.157004  5892 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:25.239297  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.180225  5889 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:25.157780  5941 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:25.269579  6026 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:59:25.351061  6023 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:25.351696  6023 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:25.352031  6023 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:25.249684  6000 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:25.247428  6037 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:25.310315  1605 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:25.251657  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:25.253937  1609 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:25.318261  6028 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.318825  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 46093.2us
I20260709 12:59:25.352939  6023 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:25.330844  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.350160  6045 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:25.356535  6039 raft_consensus.cc:3055] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:25.401309  6039 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:25.402725  6039 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:25.358301  6034 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.360963  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 91249.8us
W20260709 12:59:25.389971  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.251952  5736 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:25.353466  5849 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:25.400465  5972 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:25.351109  5941 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:25.409312  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 158579us
I20260709 12:59:25.411760  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:25.354048  5892 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:59:25.341702  6040 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:59:25.417618  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:25.417796  6013 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:25.407728  6034 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:25.421824  6051 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:25.423274  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.405997  6028 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:25.427738  5722 consensus_meta.cc:287] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.003s
I20260709 12:59:25.428189  5722 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.428853  6028 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:25.429419  2474 raft_consensus.cc:2393] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:25.414176  6024 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:25.431471  6024 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.434250  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2306) took 1080 ms. Trace:
I20260709 12:59:25.434688  1675 rpcz_store.cc:276] 0709 12:59:24.353851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.359052 (+  5201us) service_pool.cc:224] Handling call
0709 12:59:25.113038 (+753986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.154441 (+ 41403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.434059 (+279618us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54001121d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:25.434192 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733248384}
W20260709 12:59:25.437000  5996 consensus_meta.cc:287] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.883s	user 0.002s	sys 0.006s
I20260709 12:59:25.439847  5719 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:25.441676  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.413302  6014 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:25.415525  6039 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:25.448340  5988 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 12:59:25.450690  6049 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:25.456107  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:25.456633  1608 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:25.458873  6050 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:25.459535  6024 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:25.442981  6034 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:25.437450  5996 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:25.462515  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.463605  5996 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:25.465204  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:25.465510  5987 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260709 12:59:25.463490  1608 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:25.466066  5987 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.466718  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:25.467583  1605 raft_consensus.cc:2368] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13.
I20260709 12:59:25.449039  5988 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.416507  6023 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:25.471873  1605 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 11. Ops: []
I20260709 12:59:25.475569  1500 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:25.476747  5889 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.477676  6034 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:25.478092  5722 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:25.478531  6052 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:25.386618  5924 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:25.492362  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 77558.2us
I20260709 12:59:25.497386  1500 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:25.495615  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:25.499369  1500 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:25.503881  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.502272  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:25.512527  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:25.490144  5941 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.513176  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.517336  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:25.518013  1608 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:25.518311  1602 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 14. Ops: []
I20260709 12:59:25.515195  5719 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:59:25.515951  6052 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:25.509223  6012 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:25.550954  6052 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.551092  6012 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.551414  6052 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:25.551630  6012 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:25.529953  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.554245  5924 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:25.550014  5682 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:25.502964  5892 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:25.576388  1500 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:25.582617  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.583305  1608 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:25.513988  5826 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:25.585772  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:25.587731  5968 raft_consensus.cc:3055] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:25.588162  5968 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:25.589061  5968 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.590209  5951 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:25.590580  5968 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:25.590745  5951 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.593163  5951 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:25.589720  5731 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:25.593791  5731 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.595876  5731 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:25.596393  5731 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:25.597133  5731 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:25.597815   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:25.598050  5731 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:25.594185  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.498198  5889 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:25.603772  1649 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.066s (SENT)
I20260709 12:59:25.604208  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:25.518446  5987 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:25.516127  6035 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:25.579356  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.509941  6016 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:59:25.577833  5682 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.612946  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.582321  5892 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:25.517108  5722 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
W20260709 12:59:25.650233  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.586207  5826 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:25.682382  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 78629.3us
W20260709 12:59:25.682849  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 164062us
I20260709 12:59:25.685237  1497 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:25.585062  5924 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:25.687615  1676 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:25.688053  1609 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:25.691814  1679 raft_consensus.cc:1240] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:59:25.692423  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.689131  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:25.611413  5798 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.677867  5682 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:25.679714  5892 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:25.613166  6047 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:59:25.720261  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:25.694212  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:25.746030  1676 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:25.746551  1683 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 9: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:25.707958  1607 raft_consensus.cc:1275] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:25.701707  1677 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:25.722419  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:25.748181  1674 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:25.719604  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:25.724946  1601 raft_consensus.cc:2410] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:25.697415  1675 raft_consensus.cc:2368] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12.
I20260709 12:59:25.710809  1608 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:25.696592  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:25.707986  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:25.558036  5941 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:25.749204  1682 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
W20260709 12:59:25.758256  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 73084us
I20260709 12:59:25.759330  1497 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:25.707226  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:25.768819  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.761067  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:25.788061  1603 raft_consensus.cc:2410] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:59:25.699496  6054 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:59:25.790764  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:25.683234  5968 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:25.693835  6035 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:25.797281  1681 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:25.793285  1609 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:25.695465  5826 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:25.705955  5804 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:25.805531  5804 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:25.806877  5804 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:25.808569  5804 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:25.796063  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.711498  6034 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:25.713928  5964 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.800205  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 62410.9us
I20260709 12:59:25.719389  5889 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:25.826242  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:25.827142  1677 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:25.816603  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:25.818267  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.819736  1679 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:25.710585  2451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:25.832410  2451 raft_consensus.cc:606] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:25.710969  5694 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:59:25.832834  2476 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:25.709554  6025 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:59:25.832890  2451 raft_consensus.cc:614] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:25.843732  2421 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:25.713939  5924 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.838554  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.711768  5798 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.861053  5798 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:25.851078  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.835678  5968 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:59:25.853298  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.861640  6037 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:25.797739  5719 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:59:25.819049  6034 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.794452  6039 consensus_queue.cc:1059] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:59:25.866689  5733 consensus_queue.cc:1059] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:25.837548  6035 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:25.872632  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.840909  5889 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.878806  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.879024  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.883692  2476 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:25.892242  1679 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
I20260709 12:59:25.875268  1676 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:25.905375  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:25.907171  5951 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:25.907629  5951 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:25.908548  5951 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:25.910857  6000 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:25.911950  6000 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:25.836195  6012 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.872773  6058 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.836699  5964 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.913806  1677 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
W20260709 12:59:25.919669  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.878443  6034 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:25.904520  6037 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:25.936841  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.937533  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:25.940791  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:25.963001  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.896173  5889 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:25.934551  5951 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:25.914436  6062 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 12:59:25.975025  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 169670us
W20260709 12:59:25.968129  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 208918us
I20260709 12:59:25.977593  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:25.979326  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:25.921352  6058 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:25.984936  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 159705us
I20260709 12:59:25.993803  1498 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:25.997187  1530 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:25.984550  6037 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:26.008947  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 1056) took 1101 ms. Trace:
I20260709 12:59:26.009552  2461 rpcz_store.cc:276] 0709 12:59:24.917167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.917468 (+   301us) service_pool.cc:224] Handling call
0709 12:59:26.008689 (+1091221us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54005235d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:26.008874 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536122240}
W20260709 12:59:26.018146  1649 leader_election.cc:336] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 2.357s (SENT)
I20260709 12:59:26.018769  1649 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:26.022055  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:25.991914  5941 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:26.028522  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:26.040025  1572 leader_election.cc:400] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12.
I20260709 12:59:26.040283  1534 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:26.041440  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.042850  1572 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:26.053699  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 509370us
I20260709 12:59:26.078779  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.079911  1531 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:26.083205  6071 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:26.083720  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 255345us
I20260709 12:59:26.083178  6063 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:26.084033  6071 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:26.045053  1530 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:26.085446  1674 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:26.085460  6070 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.084517  6063 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:26.091903  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.093204  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.077970  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.086670  5968 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.987298  5741 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.094008  1528 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
W20260709 12:59:26.102138  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 55223us
I20260709 12:59:26.109478  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:26.112200  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.112884  1530 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:26.088472  6079 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:26.090801  6047 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:26.115325  1534 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:26.092054  5941 raft_consensus.cc:3055] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:26.092478  6039 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:59:26.120064  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 180764us
I20260709 12:59:26.092257  6037 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:26.098381  6063 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:26.030064  5682 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.110762  6023 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:26.092283  5892 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:26.149497  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.153409  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.111660  6062 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:26.181646  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.169581  6021 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:26.182619  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:26.183737  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.186061  2344 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.520s (SENT)
I20260709 12:59:26.109234  5924 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.283927  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:26.284101  2344 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:26.190758  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.190981  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.112843  6071 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:26.218763  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.219022  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.113026  6083 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.256594  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:26.257615  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:26.260252  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.261298  1606 raft_consensus.cc:1275] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:26.265885  6037 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.038283  5731 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:59:26.275169  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:26.278712  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.122758  6047 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.331825  6047 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:26.332274  6088 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.332844  6088 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:26.187747  6026 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:59:26.283177  1532 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:26.334970  1532 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:26.335023  6088 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.128225  5908 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.346740  6023 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:26.348193  6023 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:26.225521  6052 consensus_meta.cc:287] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.005s
I20260709 12:59:26.288354  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.109265  5968 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:26.361687  1600 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:26.361505  6052 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.362879  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.363230  5968 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:26.282763  1500 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:26.363596  1600 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
W20260709 12:59:26.295884  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.364512  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:26.288848  1609 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:26.366034  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.367183  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.368299  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:26.368873  1609 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:26.371255  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.373179  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.297456  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.316028  1530 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
W20260709 12:59:26.379274  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.184128  5941 raft_consensus.cc:740] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:59:26.311090  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 125061us
W20260709 12:59:26.316852  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 231765us
I20260709 12:59:26.381338  1647 leader_election.cc:400] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13.
I20260709 12:59:26.381716  1647 leader_election.cc:403] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:59:26.382690  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.383625  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:26.384238  1607 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:26.385177  6088 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13.
I20260709 12:59:26.385773  5968 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:26.385890  6081 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.386232  5968 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.386624  5968 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:26.387938  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:26.111794  5741 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.389717  6088 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:26.391250  5741 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.380702  5941 consensus_queue.cc:260] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:26.392448  5941 raft_consensus.cc:3060] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:26.392501  6052 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.394094  1607 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:59:26.394793  1607 pending_rounds.cc:85] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 9
I20260709 12:59:26.395197  1607 pending_rounds.cc:107] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:59:26.397233  5741 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:26.397543  6075 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.398267  6075 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.400159  1674 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:59:26.401105  6075 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:26.402428  1674 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:59:26.404160  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:26.404781  1674 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:26.374260  1600 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:26.406558  1678 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:26.106302  6070 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.418249  1675 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:59:26.395648  1607 raft_consensus.cc:2889] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:26.415096  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:26.418426  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:26.304339  6073 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.217s	user 0.005s	sys 0.000s
W20260709 12:59:26.308393  6086 log.cc:927] Time spent T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.219s	user 0.001s	sys 0.005s
W20260709 12:59:26.416973  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 134321us
I20260709 12:59:26.413733  1609 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:26.419011  1681 raft_consensus.cc:2393] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:26.417088  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.286890  5964 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.436784  1674 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:26.420903  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.416245  6040 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:26.309906  5987 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:59:26.433032  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.328289  6064 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:26.440145  1606 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:26.432951  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:26.445096  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 422985us
W20260709 12:59:26.446743  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.447016  1497 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:26.445459  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:26.450922  1681 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
W20260709 12:59:26.451116  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 432965us
W20260709 12:59:26.452098  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.457623  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:26.458439  1681 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:26.444834  6040 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.431600  5988 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.466984  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:26.433702  6052 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.465740  1497 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:26.467307  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:26.413419  6037 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.460383  6076 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.472666  6018 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:26.476449  2423 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:26.478204  1572 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.444293  5889 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.479267  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:26.477201  6035 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:26.439911  6012 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:26.475123  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:26.494509  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.480115  6097 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.443092  5987 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:26.481208  6040 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:26.507411  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:26.497303  2421 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:26.509620  1675 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:26.416646  6083 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.520064  1602 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:26.495595  6018 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.486749  6058 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:26.523770  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 45738.4us
I20260709 12:59:26.485926  6052 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.534890  6019 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:26.521265  6076 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.536185  6018 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:26.543388  6059 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
I20260709 12:59:26.555315  6083 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.530400  5908 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:26.546823  6002 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:26.547056  5889 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:26.562096  5892 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.549953  6023 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.570528  6019 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:26.596712  2344 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.948s (SENT)
I20260709 12:59:26.527001  6097 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.590950  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.583482  6062 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:26.617835  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 110531us
I20260709 12:59:26.619134  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:26.620031  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:26.598979  5804 consensus_meta.cc:287] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.003s
I20260709 12:59:26.623023  6109 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.632157  6109 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.633695  6099 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:59:26.634785  6109 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.637718  1526 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:26.623998  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1059) took 1015 ms. Trace:
I20260709 12:59:26.550809  5987 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:26.629308  6069 log.cc:927] Time spent T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 12:59:26.598404  6012 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.629035  6085 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:26.642887  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 52074.4us
I20260709 12:59:26.623522  5889 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:26.642198  2428 rpcz_store.cc:276] 0709 12:59:25.608554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.608708 (+   154us) service_pool.cc:224] Handling call
0709 12:59:25.609014 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.612603 (+  3589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.612633 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.613101 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.873096 (+259995us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:25.873132 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.873195 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.623808 (+750613us) raft_consensus.cc:1685] finished
0709 12:59:26.623828 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.623942 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2970,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3968,"thread_start_us":259622,"threads_started":1,"wal-append.queue_time_us":379935}
I20260709 12:59:26.616232  6039 raft_consensus.cc:697] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:26.596509  5731 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:26.661465  6039 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.663115  6019 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:26.665869  6105 log.cc:927] Time spent T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:59:26.648660  6111 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.667093  6111 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:26.656038  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.620836  1497 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:26.670461  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 49726.4us
I20260709 12:59:26.672174  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:26.672681  5987 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:26.672778  5731 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:26.673085  5804 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:26.673303  5731 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.673839  5731 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:26.674016  5908 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:26.675237  6085 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:26.656785  6082 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:59:26.677153  6076 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.677443  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.678202  1530 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:26.678386  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.679205  1533 raft_consensus.cc:2393] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:26.614331  6023 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.679733  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:26.680397  1530 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:26.681592  6023 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.657948  6012 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.682902  6037 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.682782  5731 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.684041  6012 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:26.686102  6000 consensus_meta.cc:287] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
W20260709 12:59:26.666702  6106 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:59:26.686743  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:26.647513  5951 consensus_meta.cc:287] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.001s
I20260709 12:59:26.572546  6047 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.673430  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.688512  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.700562  1533 raft_consensus.cc:2368] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10.
W20260709 12:59:26.700803  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 77920.5us
I20260709 12:59:26.695271  1530 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
W20260709 12:59:26.695921  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 227547us
I20260709 12:59:26.702284  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.702987  1603 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:26.693827  6070 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.705406  5682 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:26.705803  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:26.706487  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.707087  1533 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:26.707129  1532 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:59:26.708078  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.709110  1533 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:26.704075  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:26.710875  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.712364  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.669384  6111 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:26.651391  6099 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:26.713649  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:26.722571  1679 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:26.722666  1530 raft_consensus.cc:1240] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:59:26.714484  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:26.726157  1676 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:26.726634  1681 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:26.714618  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:26.727931  1678 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:26.716578  1534 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:26.722594  6109 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:26.730078  6109 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.730489  6109 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:26.734469  1683 raft_consensus.cc:1275] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:59:26.734915  1683 pending_rounds.cc:85] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 6
I20260709 12:59:26.735154  1683 pending_rounds.cc:107] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:59:26.735384  1683 raft_consensus.cc:2889] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:26.738607  1534 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
I20260709 12:59:26.739748  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:26.740489  1530 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:26.751771  1683 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:26.716951  1498 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.753085  1681 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:26.753242  6037 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:26.753816  6037 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.754251  6037 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:26.755710  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:26.756529  1681 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:26.764977  1679 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:26.766801  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:26.792946  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:26.793865  1676 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
W20260709 12:59:26.779673  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.782122  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.775224  6080 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:59:26.788661  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 62658.9us
I20260709 12:59:26.789777  1608 raft_consensus.cc:1240] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:26.789891  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 77604us
I20260709 12:59:26.800662  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:26.790560  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 72779.5us
I20260709 12:59:26.792645  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:26.723493  5682 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:26.728623  6060 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.014s
W20260709 12:59:26.793407  6034 consensus_meta.cc:287] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.855s	user 0.006s	sys 0.005s
I20260709 12:59:26.799746  1532 pending_rounds.cc:85] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 5
I20260709 12:59:26.802009  1575 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:26.802021  1677 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:26.801327  1572 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:26.777383  6083 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:26.811466  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.805194  2339 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:26.806689  1530 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:26.775703  6099 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:26.842880  1607 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:59:26.848250  1532 pending_rounds.cc:107] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:59:26.851162  1532 raft_consensus.cc:2889] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:26.809546  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.697010  1526 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:26.794188  1679 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:26.713526  5968 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:26.807835  6060 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.002s	sys 0.014s
I20260709 12:59:26.797598  5849 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:59:26.791674  6025 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 12:59:26.865487  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64197.1us
I20260709 12:59:26.800143  6080 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.802938  5951 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:59:26.813431  5682 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.978266  6116 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:26.789518  6028 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 12:59:26.866036  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 64105.2us
I20260709 12:59:26.980302  5682 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:26.980059  5908 consensus_queue.cc:1048] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:26.981102  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:26.881289  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.981959  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.982796  6028 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:26.983027  6000 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.983215  6028 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:26.983531  6047 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.983712  6000 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.983814  6037 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.802953  5722 consensus_queue.cc:1059] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:59:26.984120  6028 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.889734  5731 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.985108  5722 raft_consensus.cc:3055] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:26.985476  5722 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:26.986065  6076 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:26.986806  5722 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.988113  6000 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.988346  5722 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:26.985476  6028 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:26.991225  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.995587  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:26.996284  1529 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
W20260709 12:59:26.804559  5826 consensus_meta.cc:287] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.942s	user 0.012s	sys 0.000s
I20260709 12:59:27.004540  6018 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:27.011960  6114 log.cc:927] Time spent T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:59:26.867311  6039 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:27.004769  5826 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.864634  6034 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.018405  6109 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.019558  6034 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:26.807940  6118 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:27.020015  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:26.846410  6090 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.020627  6109 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.020846  5741 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:27.020730  6090 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.021402  5741 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.021899  5741 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.023296  6090 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.028951  6070 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.029546  6070 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.031446  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2136) took 1035 ms. Trace:
I20260709 12:59:26.863101  6065 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:26.850188  6083 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:26.984195  5668 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.986884  6076 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.018958  5798 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:59:26.941859  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.863943  6099 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:27.031849  1527 rpcz_store.cc:276] 0709 12:59:25.995728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.995875 (+   147us) service_pool.cc:224] Handling call
0709 12:59:25.996270 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:26.349996 (+353726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.350051 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:26.350713 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.504836 (+154123us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:26.504881 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.504959 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.031238 (+526279us) raft_consensus.cc:1685] finished
0709 12:59:27.031257 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.031393 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91185,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":504910,"threads_started":2,"wal-append.queue_time_us":678864}
I20260709 12:59:26.885931  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.083629  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:26.883249  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:27.035277  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 56718.2us
I20260709 12:59:27.046852  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.050308  1674 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:27.016987  6040 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:26.874506  6091 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:27.074379  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 93342.6us
W20260709 12:59:27.101987  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 218910us
I20260709 12:59:27.102113  6075 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:27.102687  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:27.102787  6075 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.103356  6075 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:27.103513  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:27.031869  6101 log.cc:927] Time spent T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:59:27.033948  6063 consensus_meta.cc:287] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.000s
I20260709 12:59:27.106024  6012 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:27.106830  6012 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:27.107555  2461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1060) took 1026 ms. Trace:
I20260709 12:59:27.108695  6028 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:27.108120  6012 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.109242  6028 raft_consensus.cc:697] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:27.020366  6118 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:27.110173  6028 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.110436  6118 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.034502  5892 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.090731  6103 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.481s	user 0.005s	sys 0.006s
I20260709 12:59:27.052356  6090 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.113302  5892 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.107946  2461 rpcz_store.cc:276] 0709 12:59:26.081640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.081794 (+   154us) service_pool.cc:224] Handling call
0709 12:59:26.082261 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:26.112181 (+ 29920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.112216 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:26.116959 (+  4743us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.485446 (+368487us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:26.485489 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.485554 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.107303 (+621749us) raft_consensus.cc:1685] finished
0709 12:59:27.107326 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.107492 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29403,"raft.queue_time_us":41046,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":88765,"thread_start_us":190357,"threads_started":1,"wal-append.queue_time_us":624815}
I20260709 12:59:27.114821  6090 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:27.071228  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.077770  5668 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.116858  6090 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:27.118624  5668 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:27.118896  6094 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.613s	user 0.004s	sys 0.000s
I20260709 12:59:27.119895  5826 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:27.075470  5908 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:27.120625  5908 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:27.121006  5908 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:27.054942  6065 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.122668  6065 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.036888  6080 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:27.094949  5804 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:27.106153  6110 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 12:59:27.106606  6063 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.126317  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:27.127617  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.128554  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:27.128821  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.130107  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.130366  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.048022  6035 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:27.078156  5798 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:27.133627  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.134085  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.125782  1572 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:27.149737  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:27.150558  6113 log.cc:927] Time spent T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:59:27.150812  1601 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:27.142962  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.144757  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.145637  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.149737  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.153613  2421 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.073998  6116 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:59:27.158953  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.124868  6091 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:27.186717  6091 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.191177  5968 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.194259  2451 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:27.194622  6052 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.195377  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:27.197053  5987 consensus_meta.cc:287] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.000s
I20260709 12:59:27.203019  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2148) took 1077 ms. Trace:
I20260709 12:59:27.203563  1534 rpcz_store.cc:276] 0709 12:59:26.126120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.273270 (+147150us) service_pool.cc:224] Handling call
0709 12:59:27.202783 (+929513us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540010b154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:27.202935 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886012288}
W20260709 12:59:27.144812  6123 log.cc:927] Time spent T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
W20260709 12:59:27.210251  1605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.020s	sys 0.019s
W20260709 12:59:27.210682  1605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.020s	sys 0.019s
I20260709 12:59:27.161409  2423 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:27.162161  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:27.140020  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.165483  6096 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.633s	user 0.000s	sys 0.013s
I20260709 12:59:27.166327  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2145) took 1059 ms. Trace:
I20260709 12:59:27.167402  5798 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.169399  1533 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:27.139710  6029 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:59:27.182978  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2147) took 1074 ms. Trace:
I20260709 12:59:27.235204  1526 rpcz_store.cc:276] 0709 12:59:26.109055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.109199 (+   144us) service_pool.cc:224] Handling call
0709 12:59:27.182783 (+1073584us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54001c1bd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:27.182911 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213158656}
I20260709 12:59:27.185667  1529 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:27.186163  5889 consensus_meta.cc:287] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.004s
I20260709 12:59:27.206945  1530 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:27.209116  1534 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:27.160446  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:27.160200  6047 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:27.245788  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.246464  2423 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:27.251688  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.213727  1528 rpcz_store.cc:276] 0709 12:59:26.106958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.107108 (+   150us) service_pool.cc:224] Handling call
0709 12:59:26.107509 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.266440 (+158931us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:26.352326 (+ 85886us) log.cc:844] Serialized 14 byte log entry
0709 12:59:26.505765 (+153439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.505824 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:26.505880 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.030086 (+524206us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b180042aea0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab522 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:59:27.166122 (+136036us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540010ac54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:27.166168 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.166276 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59735,"prepare.queue_time_us":224292,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":10019,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":13585,"spinlock_wait_cycles":370986624,"thread_start_us":228857,"threads_started":2,"wal-append.queue_time_us":199251}
I20260709 12:59:27.135787  5741 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.159157  6070 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:27.257812  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.275141  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.279356  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.283025  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.275799  5798 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.286592  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:27.287168  1649 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.668s (SENT)
I20260709 12:59:27.243482  5889 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:27.291198  1528 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:27.255851  6047 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.273321  5987 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.296542  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.295064  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 146560us
I20260709 12:59:27.278046  5731 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.299660  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:27.284432  5951 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:27.305365  1528 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:27.294265  6047 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.304172  5731 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.317654  2421 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:27.319939  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.322609  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:27.323264  1609 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:27.302166  5987 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.324115  6093 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.322007  6018 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.350309  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.350438  1609 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:27.351007  1526 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:27.314328  5951 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.359754  1526 raft_consensus.cc:1275] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:27.364311  5951 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:27.365008  6102 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.839s	user 0.003s	sys 0.008s
I20260709 12:59:27.352949  6093 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.370329  5741 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.372018  6093 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.352697  6040 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.374830  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2500) took 1191 ms. Trace:
W20260709 12:59:27.377754  6127 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:59:27.376807  1604 rpcz_store.cc:276] 0709 12:59:26.183469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.183614 (+   145us) service_pool.cc:224] Handling call
0709 12:59:26.183925 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:26.184436 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.184473 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:26.218873 (+ 34400us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.300329 (+ 81456us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b1800427c60. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d15380d1 00007f25d1953a0f
0709 12:59:26.356121 (+ 55792us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:26.356172 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.356262 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.364325 (+1008063us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:27.374557 (+ 10232us) raft_consensus.cc:1685] finished
0709 12:59:27.374587 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.374759 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":44764,"spinlock_wait_cycles":81442048,"thread_start_us":55244,"threads_started":1,"wal-append.queue_time_us":211739}
I20260709 12:59:27.379086  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.378795  6065 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.379758  1528 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:27.380591  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.382025  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.384763  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.385684  2476 raft_consensus.cc:2393] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:27.374039  5987 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:27.386171  6130 log.cc:927] Time spent T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:59:27.388851  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.390357  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.391062  1527 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
W20260709 12:59:27.392464  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 92874us
I20260709 12:59:27.382606  1526 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:59:27.394248  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.394836  1526 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
W20260709 12:59:27.412250  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.395663  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.381094  1528 raft_consensus.cc:2376] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7. Re-sending same reply.
I20260709 12:59:27.395646  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.427606  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.426982  1525 raft_consensus.cc:2468] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:27.429301  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.428596  1528 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
W20260709 12:59:27.432418  1649 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.800s (SENT)
I20260709 12:59:27.432602  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.372815  6093 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:27.432626  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.433461  1525 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.424849  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.434739  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.435001  1526 raft_consensus.cc:2376] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12. Re-sending same reply.
I20260709 12:59:27.436872  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.436787  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.437879  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.438692  1528 raft_consensus.cc:2393] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 9: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:27.439597  1527 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:27.439872  1526 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:27.441279  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:27.440877  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.442039  1526 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:27.445418  1679 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:27.446308  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.446918  1528 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:27.396427  6065 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:27.369207  6080 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.452204  2435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 868) took 1658 ms. Trace:
W20260709 12:59:27.452975  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.454239  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:27.460031  1682 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:27.462287  1681 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:27.455806  2435 rpcz_store.cc:276] 0709 12:59:25.787404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.787565 (+   161us) service_pool.cc:224] Handling call
0709 12:59:26.009711 (+222146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.009976 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.010012 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.010066 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:26.010117 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.010197 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.445713 (+1435516us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54005235d0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:27.445824 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510070144}
I20260709 12:59:27.435935  6093 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.478853  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:27.437721  6099 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.479911  1680 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:27.480890  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:27.482118  1683 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:59:27.482795  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.483547  1527 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:27.497828  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:27.479257  6126 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:59:27.503336  1525 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:27.509413  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.510092  1525 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:59:27.510824  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.511759  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.512219  1525 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:27.512841  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.513505  1525 raft_consensus.cc:2410] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:59:27.480415  6093 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.514676  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.515702  1525 raft_consensus.cc:2410] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:27.517488  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.516978  1525 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:27.529959  1527 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:27.531474  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.532428  1527 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:27.507791  5968 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.524842  5731 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:27.543915  6139 log.cc:927] Time spent T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:59:27.527585  6076 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:27.534860  6118 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:27.507398  5908 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:27.604040  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.614678  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 134012us
I20260709 12:59:27.541553  5968 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:27.595909  6131 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 12:59:27.622015  6134 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.190s	user 0.001s	sys 0.001s
W20260709 12:59:27.635057  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.545042  6075 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:27.673436  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 281439us
I20260709 12:59:27.672816  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:27.685441  1647 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:27.681615  6142 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:59:27.669953  6076 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.671290  6090 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:27.708184  2475 raft_consensus.cc:2368] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:27.708432  1528 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
W20260709 12:59:27.704699  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.673040  5972 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.715153  6099 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.697093  6080 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.716217  6019 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:27.719055  5968 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.722775  6075 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:27.722682  6118 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:27.697373  6074 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:27.724797  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.690492  5964 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:27.728463  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.732654  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.732244  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 803) took 1504 ms. Trace:
I20260709 12:59:27.733685  6111 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:27.741106  1528 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:27.742588  1528 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:27.743703  6146 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:59:27.744449  6063 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:27.734443  6145 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:59:27.745599  2423 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:59:27.749776  2423 pending_rounds.cc:85] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 9
I20260709 12:59:27.750186  2423 pending_rounds.cc:107] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:59:27.750495  2423 raft_consensus.cc:2889] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.747885  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.754355  1528 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:27.755739  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.758622  1528 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:27.740427  1600 rpcz_store.cc:276] 0709 12:59:26.228138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.406817 (+178679us) service_pool.cc:224] Handling call
0709 12:59:26.407406 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.407802 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:27.551965 (+1144163us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b180043dc20. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25d15404bc 00007f25ce88e48b 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8a8455 00007f25d53903c7 00007f25d19a29a7 00007f25d19b20bf
0709 12:59:27.552104 (+   139us) log.cc:844] Serialized 14 byte log entry
0709 12:59:27.731776 (+179672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:27.731834 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:27.731886 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.732034 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.732184 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5286,"prepare.queue_time_us":79850,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2149,"spinlock_wait_cycles":7459584,"thread_start_us":254632,"threads_started":2}
I20260709 12:59:27.744915  6072 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:27.745319  5964 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.747400  6118 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.725690  6150 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:59:27.726516  6076 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.730788  6090 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.735858  5972 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.794654  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 789) took 1577 ms. Trace:
W20260709 12:59:27.795149  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 104218us
I20260709 12:59:27.796060  6097 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.796811  1528 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:27.808236  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:27.809162  1676 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:27.807075  1608 rpcz_store.cc:276] 0709 12:59:26.217163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.217276 (+   113us) service_pool.cc:224] Handling call
0709 12:59:26.217617 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.800438 (+582821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.794417 (+993979us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54003403d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:27.794597 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315218304}
I20260709 12:59:27.782382  6072 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:27.788254  5964 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:27.822136  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.823328  1528 raft_consensus.cc:2410] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:27.824416  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:27.824958  1680 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.830286  5892 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:27.838824  6072 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.839942  6072 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:27.846166  6152 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:59:27.805925  6047 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.851871  6047 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.852831  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.853791  1528 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:27.854697  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.855149  6111 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:27.855739  6111 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:27.858569  6076 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:27.860162  6147 log.cc:927] Time spent T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:59:27.860760  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:27.861470  1609 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:27.861778  6155 log.cc:927] Time spent T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:59:27.862192  1601 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:59:27.861456  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:27.867024  6067 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.779s	user 0.015s	sys 0.000s
I20260709 12:59:27.863318  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:27.867074  6047 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:27.869036  6047 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.869491  5972 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.819981  6063 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.870458  6063 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.871748  6047 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.872689  6063 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:27.873311  6140 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:59:27.876039  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.876659  2421 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:27.820714  6151 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:59:27.879273  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.863603  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.889715  1525 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:27.889899  1680 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:27.855473  1528 raft_consensus.cc:2393] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:27.886112  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:27.891218  1604 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:27.892416  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.824734  6040 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:27.886452  1609 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:27.893886  6040 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.896481  6040 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.898272  5908 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:27.899024  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:27.900121  6090 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:27.911360  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.911842  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.912477  1527 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:27.913353  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.913946  1527 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:27.916404  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.916512  2428 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:59:27.916869  2428 pending_rounds.cc:85] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 8
I20260709 12:59:27.917045  1527 raft_consensus.cc:2368] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12.
I20260709 12:59:27.917116  2428 pending_rounds.cc:107] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:59:27.917490  2428 raft_consensus.cc:2889] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.919793  1647 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:27.922127  2421 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:27.924386  1575 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:27.935410  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:27.937361  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:27.792282  6118 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:27.945410  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.946358  1525 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:27.947538  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.952553  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.953226  1527 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:27.953799  6083 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:27.957760  6047 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:27.957649  6023 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:27.958384  6047 raft_consensus.cc:697] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:27.959299  6047 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:27.948307  1525 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:27.963965  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.964502  1525 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:27.965308  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.966269  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.967108  1525 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:27.967926  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.970445  1525 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:27.961833  5972 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:27.975307  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.944584  6063 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:27.982187  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:27.984643  1528 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:27.982946  2461 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:59:27.985456  2461 pending_rounds.cc:85] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 9
I20260709 12:59:27.985728  2461 pending_rounds.cc:107] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:59:27.985956  2461 raft_consensus.cc:2889] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.948846  6090 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:27.969826  6091 consensus_meta.cc:287] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.783s	user 0.012s	sys 0.000s
I20260709 12:59:27.971285  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.967623  5968 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.959308  6109 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:27.984953  1603 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:27.992370  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:27.989064  5972 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:27.996456  1527 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:28.011511  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:27.993510  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.012048  1607 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:28.016211  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:28.013720  1525 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 14: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:28.011060  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:28.018975  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.019692  1525 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:28.029846  1528 raft_consensus.cc:2393] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:28.031397  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:28.031580  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:28.033910  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:28.034610  1527 raft_consensus.cc:2376] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14. Re-sending same reply.
I20260709 12:59:28.034813  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.040004  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:28.040831  1647 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:28.044008  6150 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:28.047657  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.051432  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:27.989256  6063 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:28.059839  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.062223  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:28.058511  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.065238  1528 raft_consensus.cc:2393] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:28.066087  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:28.066591  1528 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:28.067898  2428 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:28.062796  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:28.074213  1531 raft_consensus.cc:2393] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:28.075212  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.076131  1531 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:28.079144  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.079741  1531 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:28.088091  6037 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:28.089445  1527 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:28.093122  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:28.093483  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:28.093861  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:28.095542  1602 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:28.096935  6136 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.745s	user 0.001s	sys 0.003s
I20260709 12:59:28.100081  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 2175) took 1284 ms. Trace:
I20260709 12:59:28.100595  1530 rpcz_store.cc:276] 0709 12:59:26.816193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.846982 (+ 30789us) service_pool.cc:224] Handling call
0709 12:59:26.847280 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.237424 (+390144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.099722 (+862298us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54002120d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:28.099994 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826706176}
I20260709 12:59:28.101624  1527 raft_consensus.cc:1240] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: []
W20260709 12:59:28.102532  6154 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:59:28.103318  1602 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:28.100100  1528 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:28.007388  5968 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.107474  5968 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:28.110392  5964 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:28.111253  1526 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:28.043643  6075 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:59:28.105638  1531 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 13. Ops: []
I20260709 12:59:28.048782  5798 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:59:28.118469  1607 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:28.058293  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:28.118764  1531 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:27.991353  6091 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.118980  1527 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:59:28.124161  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 65960.9us
I20260709 12:59:28.124799  1532 raft_consensus.cc:1240] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:28.125242  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:28.126652  1572 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:59:28.131878  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.133023  2339 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:28.133713  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.047184  6023 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:59:28.124215  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 2173) took 1331 ms (client timeout 1668 ms). Trace:
I20260709 12:59:28.046958  6116 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:28.157316  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:28.050356  6090 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:28.009383  6109 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.145825  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:28.168824  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:28.175788  1681 raft_consensus.cc:2393] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:28.169066  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:28.176880  1675 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:28.140164  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 2178) took 1106 ms. Trace:
I20260709 12:59:28.177790  1529 rpcz_store.cc:276] 0709 12:59:27.033577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.034201 (+   624us) service_pool.cc:224] Handling call
0709 12:59:27.076031 (+ 41830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.236662 (+160631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.139854 (+903192us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002116d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:28.140084 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251602816}
I20260709 12:59:28.147444  1572 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:28.171522  1608 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:28.046656  6150 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:28.152487  1533 rpcz_store.cc:269] 0709 12:59:26.792391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.792722 (+   331us) service_pool.cc:224] Handling call
0709 12:59:28.124053 (+1331331us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54003ae154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:28.124165 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828272896}
I20260709 12:59:28.153535  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:28.155443  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:28.182664  1602 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:28.155475  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:28.157645  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:28.157966  2435 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:28.150921  1500 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:28.157337  1525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:28.159952  1528 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:59:28.161075  1682 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:59:28.144167  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 1022) took 1688 ms. Trace:
I20260709 12:59:28.112576  5964 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:28.172370  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:28.184636  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:28.055596  6065 consensus_queue.cc:1059] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:59:28.185088  1528 pending_rounds.cc:85] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 6
I20260709 12:59:28.194582  1528 pending_rounds.cc:107] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:59:28.194428  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:28.194931  1528 raft_consensus.cc:2889] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:28.195447  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.196324  1533 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:28.198020  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 50654.4us
I20260709 12:59:28.199029  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:28.186503  2423 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:28.200137  2435 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:28.185725  1674 rpcz_store.cc:276] 0709 12:59:26.455838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.455992 (+   154us) service_pool.cc:224] Handling call
0709 12:59:26.475462 (+ 19470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.086037 (+610575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.122261 (+1036224us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54000f9e54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:28.144102 (+ 21841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321362304}
I20260709 12:59:28.197221  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:28.205727  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:28.206245  1533 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:28.206779  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:28.206287  2476 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:28.195189  1604 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
W20260709 12:59:28.210198  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 59344.1us
I20260709 12:59:28.210593  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.210891  1500 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:28.211295  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:28.213538  6037 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:28.215392  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:28.215972  6143 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:28.216810  6143 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.217221  6143 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:28.218748  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:28.219147  1532 raft_consensus.cc:1275] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:28.216073  1528 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:28.159113  5996 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:28.227699  1602 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:28.222357  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:28.220422  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:28.161973  6090 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:28.211252  1529 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:28.173954  6029 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:59:28.162672  6019 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:59:28.219877  6040 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:28.221287  1500 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:28.389406  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 168168us
W20260709 12:59:28.390021  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 351558us
I20260709 12:59:28.390524  1500 leader_election.cc:400] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:28.390846  1500 leader_election.cc:403] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:28.236008  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.221740  6037 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:28.182835  6161 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:28.242973  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.155704  6159 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:28.236342  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.249298  1675 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:28.234704  6116 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 12:59:28.276808  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 2182) took 1023 ms. Trace:
I20260709 12:59:28.418044  1534 rpcz_store.cc:276] 0709 12:59:27.253805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.256820 (+  3015us) service_pool.cc:224] Handling call
0709 12:59:27.257168 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.257397 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:27.285744 (+ 28347us) log.cc:844] Serialized 14 byte log entry
0709 12:59:28.083597 (+797853us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b1800419800. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d153823a 00007f25d19a2a2a
0709 12:59:28.276385 (+192788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:28.276451 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:28.276529 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.276609 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:28.276738 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15257,"prepare.queue_time_us":28338,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2134,"raft.queue_time_us":452,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":106125,"spinlock_wait_cycles":11591552,"thread_start_us":192075,"threads_started":1}
I20260709 12:59:28.162576  5951 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:59:28.162346  6099 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 12:59:28.281378  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 61012.1us
I20260709 12:59:28.282765  1533 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 12:59:28.317494  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.429296  5892 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.222904  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:28.430043  5892 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:28.432412  5892 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:28.442358  6164 log.cc:927] Time spent T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 12:59:28.271337  5996 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.445815  5996 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:28.422711  6040 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:28.413724  6083 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:28.450453  6040 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.455250  1607 raft_consensus.cc:2393] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 14: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:28.423996  6150 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.281589  5968 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:28.385977  6090 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:28.461784  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 451018us
I20260709 12:59:28.387089  6118 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:28.385799  6097 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:28.409667  6115 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:59:28.466884  2342 connection.cc:256] RPC call timeout handler was delayed by -1.6322183030000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 12:59:28.463147  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 272248us
W20260709 12:59:28.475528  1649 leader_election.cc:336] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.976s (SENT)
I20260709 12:59:28.476063  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:28.492110  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.534137  5741 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:28.534993  5741 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.537672  5741 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:28.576231  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 100755us
W20260709 12:59:28.577600  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.235173  5972 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:28.467725  6102 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:59:28.582549  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.583587  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 450642us
I20260709 12:59:28.475950  6097 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.493335  6109 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:28.577172  5964 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.580014  5741 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:28.580307  6115 raft_consensus.cc:697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:28.468093  5968 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:28.615167  6052 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:28.618693  6097 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:28.634115  5798 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:28.643709  6169 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:28.633945  5964 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.652556  6063 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:28.669735  6166 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:59:28.668028  6169 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:28.733839  6169 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.735643  6169 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:28.660344  5798 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:28.738858  5798 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.740587  5798 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:28.749971  6141 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 1.242s	user 0.002s	sys 0.003s
I20260709 12:59:28.752871  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2254) took 1525 ms. Trace:
W20260709 12:59:28.754112  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 87572us
I20260709 12:59:28.656472  6174 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:28.754216  1605 rpcz_store.cc:276] 0709 12:59:27.227985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.230861 (+  2876us) service_pool.cc:224] Handling call
0709 12:59:27.254940 (+ 24079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:27.255342 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:27.286498 (+ 31156us) log.cc:844] Serialized 14 byte log entry
0709 12:59:27.804164 (+517666us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:27.813894 (+  9730us) log.cc:844] Serialized 26 byte log entry
0709 12:59:27.814074 (+   180us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:27.814110 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.814170 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:28.749289 (+935119us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:28.752450 (+  3161us) raft_consensus.cc:1685] finished
0709 12:59:28.752575 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:28.752778 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30980,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":30546,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":3648,"spinlock_wait_cycles":3888000,"thread_start_us":502352,"threads_started":2,"wal-append.queue_time_us":157922}
W20260709 12:59:28.766111  1531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.012s	sys 0.029s
W20260709 12:59:28.766503  1531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.012s	sys 0.029s
I20260709 12:59:28.766427  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:28.767779  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.774550  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.022s	sys 0.019s
I20260709 12:59:28.775033  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:28.775063  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.022s	sys 0.019s
W20260709 12:59:28.777300  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 547771us
W20260709 12:59:28.756548  6093 consensus_meta.cc:287] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 1.196s	user 0.012s	sys 0.000s
I20260709 12:59:28.715690  5968 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:28.723042  6091 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:28.762275  5741 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.761986  6174 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:28.779932  6065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.011s	sys 0.032s
I20260709 12:59:28.659263  6052 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.792209  1533 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:59:28.801525  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.014s	sys 0.031s
W20260709 12:59:28.805361  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.014s	sys 0.031s
W20260709 12:59:28.788507  6065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.033s
I20260709 12:59:28.787822  5968 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:28.793883  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 402625us
I20260709 12:59:28.788100  6174 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:28.781451  6093 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:28.721943  6115 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.789345  5741 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.827140  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:28.830605  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.839939  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.867585  1526 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:59:28.823819  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 594214us
I20260709 12:59:28.874342  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:28.824080  6111 consensus_meta.cc:287] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.967s	user 0.016s	sys 0.000s
I20260709 12:59:28.889952  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:28.890821  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.868834  5968 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.865151  6090 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.864564  5996 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:28.902666  6143 consensus_meta.cc:287] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.001s
I20260709 12:59:28.862848  6097 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:28.935853  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:28.904603  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:29.001965  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 97450.3us
W20260709 12:59:28.983366  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.991608  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2156) took 1067 ms. Trace:
I20260709 12:59:29.016026  1531 rpcz_store.cc:276] 0709 12:59:27.923877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.149831 (+225954us) service_pool.cc:224] Handling call
0709 12:59:28.150170 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:28.164718 (+ 14548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.164763 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:28.181686 (+ 16923us) log.cc:844] Serialized 52 byte log entry
0709 12:59:28.778296 (+596610us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:28.778432 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.778540 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:28.991369 (+212829us) raft_consensus.cc:1685] finished
0709 12:59:28.991391 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:28.991538 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5757,"raft.queue_time_us":322,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":13742,"thread_start_us":544768,"threads_started":1,"wal-append.queue_time_us":729666}
W20260709 12:59:28.946130  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.968685  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 384327us
I20260709 12:59:28.979158  1575 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:29.031311  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 52227.9us
I20260709 12:59:29.032160  2339 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:29.042996  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:29.034700  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:29.038522  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:28.974496  6178 log.cc:927] Time spent T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:59:28.971453  5968 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.060460  5968 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:29.060700  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2159) took 1130 ms. Trace:
I20260709 12:59:29.061039  5968 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:29.061071  1530 rpcz_store.cc:276] 0709 12:59:27.930465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.150920 (+220455us) service_pool.cc:224] Handling call
0709 12:59:28.181853 (+ 30933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.182300 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.182338 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.195930 (+ 13592us) log.cc:844] Serialized 26 byte log entry
0709 12:59:28.612948 (+417018us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:28.612991 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.613062 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:29.060470 (+447408us) raft_consensus.cc:1685] finished
0709 12:59:29.060492 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.060643 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6938,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":27392,"spinlock_wait_cycles":1890048,"thread_start_us":399523,"threads_started":1,"wal-append.queue_time_us":574981}
I20260709 12:59:29.063313  5968 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:29.064028  5968 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:29.064574  5968 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:29.073892  5968 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:29.075621  6174 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:28.951629  6159 consensus_meta.cc:287] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.007s
I20260709 12:59:29.050685  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:29.080739  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.081018  1606 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:29.043799  6062 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:28.975461  5741 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:28.978793  5996 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.086653  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:29.034063  6076 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:29.043586  6019 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:29.052511  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:29.054499  6052 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.077860  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:29.078758  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:28.982259  6118 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.967087  6150 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.980167  6091 consensus_queue.cc:1048] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:59:28.935190  6188 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.052578  2423 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:29.087474  1608 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:59:28.952527  6143 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:29.091867  1607 raft_consensus.cc:2393] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:29.095810  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.049580  6184 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:59:28.904867  6111 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.085951  6159 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:29.089641  2342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.001s	sys 0.017s
W20260709 12:59:29.114606  2342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.001s	sys 0.017s
I20260709 12:59:29.031689  6065 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 12:59:29.045228  6040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.008s	sys 0.026s
I20260709 12:59:29.100607  6075 raft_consensus.cc:3055] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:29.095422  6019 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.098438  6083 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:29.097882  6175 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:29.116789  2342 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:29.103359  6047 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:29.112829  6190 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:29.103986  5798 raft_consensus.cc:2764] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:29.099290  6076 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:29.144820  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 319183us
I20260709 12:59:29.086941  6062 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:29.198227  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 81491.1us
W20260709 12:59:29.198637  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 54622.4us
I20260709 12:59:29.104732  6150 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.102862  6118 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:29.141287  6040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.009s	sys 0.029s
I20260709 12:59:29.125526  5964 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.145001  6019 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:29.198151  6093 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:29.245908  1525 raft_consensus.cc:606] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:29.246387  1525 raft_consensus.cc:614] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:29.103865  6188 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.248452  1609 raft_consensus.cc:2410] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:59:29.141448  6075 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:29.172055  6083 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:29.259771  6040 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:29.263444  6062 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.274824  6172 consensus_queue.cc:1048] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:29.275298  5798 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:29.241667  6181 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:29.232030  6090 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:29.286020  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.239778  6189 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.232388  6159 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:59:29.305908  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.310817  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:29.311460  1606 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:29.313917  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:29.314651  1605 raft_consensus.cc:2393] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:29.315991  1530 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:59:29.316895  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:29.317936  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:29.318616  1529 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:29.196966  6190 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:29.288121  6052 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:29.289489  6097 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:29.331952  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 278538us
I20260709 12:59:29.197968  6175 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:29.353085  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.302773  6181 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:29.377331  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46606 (request call id 14) took 1303 ms. Trace:
I20260709 12:59:29.380877  1525 rpcz_store.cc:276] 0709 12:59:28.058859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.145497 (+ 86638us) service_pool.cc:224] Handling call
0709 12:59:29.333211 (+1187714us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003a8254. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1992853 00007f25d696060a 00007f25cfee67d4 00007f25cfee6762 00007f25cfee6691 00007f25cfee660c 00007f25cfee58c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:29.333347 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440052992}
I20260709 12:59:29.288743  6040 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.338762  6174 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:29.376791  6091 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.339394  6052 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.390985  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:29.377759  6093 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.393072  1606 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
W20260709 12:59:29.424371  1500 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:46719 timed out after 2.065s (SENT) [suppressed 34 similar messages]
I20260709 12:59:29.424669  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:29.435250  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:29.436525  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.438668  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:29.438925  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:29.439389  2475 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:29.442122  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:29.444610  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:29.444610  1498 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:29.379241  6037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.007s	sys 0.019s
I20260709 12:59:29.449498  2435 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:29.450141  2435 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:29.394879  6143 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:29.455417  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:29.458957  1525 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:29.458820  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:29.460399  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.461760  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.466156  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:29.466459  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:29.466966  1607 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:29.433399  6111 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.469039  2474 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:29.451128  2435 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.481163  2451 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:29.482692  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:29.483543  2451 raft_consensus.cc:2368] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15.
I20260709 12:59:29.473531  2474 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:29.485949  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:29.448869  6037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.008s	sys 0.020s
I20260709 12:59:29.490437  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:29.497359  1529 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:29.503870  1525 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:29.484771  2474 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.453647  6172 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:29.526906  1607 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:29.516055  2474 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:29.388687  6075 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.430404  6091 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:29.514592  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.440112  6174 consensus_queue.cc:1059] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 12:59:29.549762  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 441079us
I20260709 12:59:29.468981  6063 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:29.435387  6093 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:29.533396  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 324612us
I20260709 12:59:29.553972  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:29.551872  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:29.562255  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:29.563007  2461 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:29.240653  6074 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.289s
W20260709 12:59:29.556344  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 344569us
I20260709 12:59:29.282368  6198 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.290s
I20260709 12:59:29.515280  6118 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.504710  6109 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:59:29.533339  6076 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.509986  6037 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:29.299178  6189 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.595264  2344 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:29.632401  2435 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:29.565879  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:59:29.640110  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.647192  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:29.649231  2451 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:29.654213  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:29.571728  6150 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.655208  2476 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
W20260709 12:59:29.657856  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 92027.1us
I20260709 12:59:29.559494  6172 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:29.583894  6190 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:29.584324  6083 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:29.487430  6181 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.586274  6063 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:29.675853  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:29.660185  6200 raft_consensus.cc:3055] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:29.661423  5972 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:29.588896  5968 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.085s
W20260709 12:59:29.674652  6187 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 12:59:29.687822  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
W20260709 12:59:29.688756  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 93607.8us
I20260709 12:59:29.706069  2344 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:29.706476  2435 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:59:29.691043  6190 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:29.712848  6190 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:29.713035  6197 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:59:29.713279  6190 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:29.698141  6074 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:29.716320  6195 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:59:29.716238  2344 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:29.717895  2344 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:29.718855  6188 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.719208  2344 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:29.717988  6093 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.720702  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:29.687922  5741 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.688301  6200 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:29.727483  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:29.730924  6207 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:29.696286  6182 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:59:29.731456  6207 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:29.732002  6207 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:29.731945  5741 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:29.731514  6201 log.cc:927] Time spent T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.226s	user 0.008s	sys 0.003s
I20260709 12:59:29.691579  5972 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:29.735834  5972 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:29.731552  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:29.739698  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:29.729121  6174 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:29.751184  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:29.727370  6194 log.cc:927] Time spent T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.290s	user 0.001s	sys 0.001s
I20260709 12:59:29.735103  5741 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.728286  6215 raft_consensus.cc:2764] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:59:29.729812  6216 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:29.751741  6188 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:29.750730  6174 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:29.752821  6052 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.749171  2423 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:29.756644  6074 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:29.758164  6040 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:29.797137  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 228955us
I20260709 12:59:29.797906  2461 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:29.765684  6217 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:29.773696  6216 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:29.783886  6174 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:29.744571  6037 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.793442  6074 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:29.799420  6193 raft_consensus.cc:2764] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:59:29.919538  6210 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:29.806880  6091 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.913148  6216 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:29.897447  6217 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:29.922290  6209 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
W20260709 12:59:29.933458  6218 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:59:29.935520  6220 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:59:29.936666  6211 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:29.767562  6063 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:29.925542  6074 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:29.927162  6210 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:29.954295  6189 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:29.931624  6217 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:29.960160  6210 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:29.979110  6019 consensus_meta.cc:287] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.000s
I20260709 12:59:29.982270  6019 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:29.987589  6019 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:30.117969  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.118559  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2179) took 1245 ms. Trace:
W20260709 12:59:30.263489  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.262967  1526 rpcz_store.cc:276] 0709 12:59:28.872708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.872852 (+   144us) service_pool.cc:224] Handling call
0709 12:59:28.873153 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.889681 (+ 16528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.889712 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.890188 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.342601 (+452413us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:29.342644 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.342774 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.118029 (+775255us) raft_consensus.cc:1685] finished
0709 12:59:30.118063 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.118352 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16150,"raft.queue_time_us":16949,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":14693,"thread_start_us":379118,"threads_started":1,"wal-append.queue_time_us":671996}
I20260709 12:59:30.265486  6075 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:30.119712  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2157) took 2195 ms. Trace:
I20260709 12:59:30.266711  1527 rpcz_store.cc:276] 0709 12:59:27.924164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.151417 (+227253us) service_pool.cc:224] Handling call
0709 12:59:28.151808 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.152253 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.152293 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.152860 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:59:28.847921 (+695061us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b180031f9c0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d15380d1 00007f25d1953a0f
0709 12:59:29.245753 (+397832us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:29.245793 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.280340 (+ 34547us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:29.730858 (+450518us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:30.119197 (+388339us) raft_consensus.cc:1685] finished
0709 12:59:30.119232 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.119524 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22436,"raft.queue_time_us":4859,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11739,"spinlock_wait_cycles":35282688,"thread_start_us":397640,"threads_started":1,"wal-append.queue_time_us":1240533}
I20260709 12:59:30.128175  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:30.269729  1529 raft_consensus.cc:606] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.270262  1529 raft_consensus.cc:614] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:30.131373  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2181) took 1094 ms. Trace:
I20260709 12:59:30.271667  1531 rpcz_store.cc:276] 0709 12:59:29.036891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.037039 (+   148us) service_pool.cc:224] Handling call
0709 12:59:29.037313 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.037522 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.037547 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.039532 (+  1985us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.505119 (+465587us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:29.505177 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.505277 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.130623 (+625346us) raft_consensus.cc:1685] finished
0709 12:59:30.130675 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.131107 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":412501,"threads_started":1,"wal-append.queue_time_us":843321}
W20260709 12:59:30.132203  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.001s	sys 0.000s
W20260709 12:59:30.273756  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.002s	sys 0.000s
I20260709 12:59:30.133354  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2177) took 1328 ms. Trace:
I20260709 12:59:30.277242  1533 rpcz_store.cc:276] 0709 12:59:28.804655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.804819 (+   164us) service_pool.cc:224] Handling call
0709 12:59:28.805186 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.805549 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.805596 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.806121 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.132117 (+325996us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:29.132156 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.132224 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.132856 (+1000632us) raft_consensus.cc:1685] finished
0709 12:59:30.132901 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.133179 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":871,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7509,"thread_start_us":316757,"threads_started":1,"wal-append.queue_time_us":573170}
W20260709 12:59:30.280853  6229 log.cc:927] Time spent T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.348s	user 0.003s	sys 0.010s
I20260709 12:59:30.133352  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2182) took 1093 ms. Trace:
W20260709 12:59:30.153944  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 505604us
W20260709 12:59:30.175096  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 865670us
W20260709 12:59:30.176417  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.179333  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.814746  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.289314  1647 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:30.290423  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.290907  6097 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:30.291522  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.291623  6097 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.292819  6090 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:30.182713  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 461912us
I20260709 12:59:30.293280  1575 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:30.183897  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 432661us
I20260709 12:59:29.996819  6190 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.297297  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
W20260709 12:59:30.220299  1500 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.011s	sys 0.013s
W20260709 12:59:30.224943  1528 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.013s	sys 0.008s
W20260709 12:59:30.230358  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 432027us
I20260709 12:59:30.251345  6189 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:30.255988  1530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.016s	sys 0.012s
I20260709 12:59:30.258217  6198 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:29.802857  6200 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.245111  6083 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.202526  6040 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:30.182698  2421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 908) took 1279 ms. Trace:
I20260709 12:59:30.243727  6143 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:30.300066  1500 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.011s	sys 0.014s
I20260709 12:59:30.016587  6175 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:30.294445  6090 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:30.305629  1528 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.013s	sys 0.008s
W20260709 12:59:30.309544  1530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.016s	sys 0.012s
I20260709 12:59:30.307780  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:30.308784  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 884374us
I20260709 12:59:30.302901  2421 rpcz_store.cc:276] 0709 12:59:28.903083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.904053 (+   970us) service_pool.cc:224] Handling call
0709 12:59:28.904355 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.937407 (+ 33052us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:28.937441 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.937925 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.370365 (+432440us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:29.370425 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.370529 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.181862 (+811333us) raft_consensus.cc:1685] finished
0709 12:59:30.181910 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.182379 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89679,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":431316,"threads_started":1,"wal-append.queue_time_us":1010029}
W20260709 12:59:30.306679  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.313887  6083 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.311158  1533 raft_consensus.cc:606] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:30.317816  1533 raft_consensus.cc:614] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:30.317900  6214 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:30.318543  6214 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:30.311430  6090 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:30.319859  6214 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.321280  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:30.321830  6189 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.323203  6029 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:30.323799  6029 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:30.324671  6189 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.325775  6143 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.328461  6143 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:30.329272  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.329173  6076 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.329967  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.331596  1606 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:30.330017  6076 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.333890  6063 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:30.336138  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:30.336992  2421 raft_consensus.cc:2376] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14. Re-sending same reply.
I20260709 12:59:30.337693  6040 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.338713  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:30.339762  1609 raft_consensus.cc:2393] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:30.325145  6029 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:29.757299  6172 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.358027  1647 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:30.281883  1534 rpcz_store.cc:276] 0709 12:59:29.040274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.040399 (+   125us) service_pool.cc:224] Handling call
0709 12:59:29.040689 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.041004 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.041032 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.041453 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.393308 (+351855us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:29.393347 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.393414 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.132873 (+739459us) raft_consensus.cc:1685] finished
0709 12:59:30.132904 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.133179 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27769,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":341699,"threads_started":1,"wal-append.queue_time_us":633946}
I20260709 12:59:30.354493  6174 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.386861  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:30.390893  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 83382us
I20260709 12:59:30.391453  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.391958  1649 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.393201  1609 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:30.394091  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 100067us
I20260709 12:59:30.396386  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.398460  6182 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:30.399348  6182 consensus_queue.cc:1059] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:30.400669  6182 raft_consensus.cc:3055] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:30.405193  6182 raft_consensus.cc:740] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:30.405174  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 98631.1us
I20260709 12:59:30.407259  6190 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.407444  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.408705  6190 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:30.405215  6198 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:30.409746  6198 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:30.410251  6198 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.410827  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.405970  6189 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:30.412429  1500 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.413031  6189 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:30.413424  6037 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:30.414443  6189 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.417150  1575 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:30.418175  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 52300.1us
I20260709 12:59:30.419761  6143 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:30.420354  6143 raft_consensus.cc:697] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:30.421554  6143 consensus_queue.cc:237] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.420305  6090 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:30.430065  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 51278.3us
I20260709 12:59:30.430850  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.432229  6076 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:30.433947  6217 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:30.401330  5964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.000s	sys 0.033s
I20260709 12:59:30.409313  6190 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:30.451555  2455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:30.437813  1500 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:30.481796  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 44144us
I20260709 12:59:30.482878  6174 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:30.482584  6076 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:30.483806  6076 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:59:30.484117  6207 consensus_meta.cc:287] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.000s
I20260709 12:59:30.485176  6076 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:30.489776  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 93647us
I20260709 12:59:30.491894  2344 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:30.495313  6225 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.496227  6225 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.498757  6225 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:30.499542  6225 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:30.413372  6210 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.456583  2455 raft_consensus.cc:606] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:30.484760  6207 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:30.453192  1497 leader_election.cc:336] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.971s (SENT)
W20260709 12:59:30.453866  5964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.000s	sys 0.034s
W20260709 12:59:30.455436  5972 consensus_meta.cc:287] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.007s
I20260709 12:59:30.516590  6198 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.516911  5972 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.467597  6190 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:30.511322  1497 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.500330  6225 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.523494  6063 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:30.407359  6182 consensus_queue.cc:260] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:30.534834  6216 consensus_meta.cc:287] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.589s	user 0.002s	sys 0.012s
I20260709 12:59:30.535311  6225 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.535954  6225 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:30.535974  6208 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.521760  6174 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:30.537058  6208 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:30.538614  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 103178us
I20260709 12:59:30.539542  6208 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:30.540484  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:30.540762  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 110113us
I20260709 12:59:30.541157  1533 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:30.536006  6182 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:30.529706  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2186) took 1219 ms. Trace:
I20260709 12:59:30.546217  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:30.578056  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:30.571784  1500 leader_election.cc:400] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15.
I20260709 12:59:30.583505  1500 leader_election.cc:403] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:30.584856  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.591603  1606 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:30.576289  6143 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.587314  6208 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:30.542743  1528 rpcz_store.cc:276] 0709 12:59:29.309936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.311529 (+  1593us) service_pool.cc:224] Handling call
0709 12:59:29.311886 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:29.312105 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:59:30.322036 (+1009931us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.447121 (+125085us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.454303 (+  7182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:30.456119 (+  1816us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:30.502235 (+ 46116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.519852 (+ 17617us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.529646 (+  9794us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8259,"prepare.queue_time_us":969855,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":123,"raft.queue_time_us":3889,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":10879,"thread_start_us":1047369,"threads_started":2,"wal-append.queue_time_us":197068}
I20260709 12:59:30.596370  1529 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:30.535353  6216 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:30.623570  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 122492us
I20260709 12:59:30.591619  6062 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:30.622723  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.632718  6065 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:59:30.633198  6109 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:30.634070  6109 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.635095  6149 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.635699  6149 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.636430  6109 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:30.643544  6074 consensus_meta.cc:287] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.684s	user 0.005s	sys 0.008s
I20260709 12:59:30.644029  6037 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:59:30.644104  6074 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.650199  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.651300  6040 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.653528  6097 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.654045  6062 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.656347  6200 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:30.656497  6062 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:30.658494  2461 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:30.659077  6172 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:30.659785  6172 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.661653  6083 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:30.661803  5964 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:30.662457  5964 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.664706  5964 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.665870  6174 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.666500  6174 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.668736  6174 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:30.669905  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:30.671125  6181 consensus_queue.cc:1059] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:30.672442  6181 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:30.672799  6181 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:30.673431  6262 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:59:30.674238  6246 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:59:30.674186  6262 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.675408  6198 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:30.680090  1533 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
W20260709 12:59:30.669371  6236 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.345s	user 0.001s	sys 0.001s
I20260709 12:59:30.687731  2455 raft_consensus.cc:1240] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:30.675418  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 222292us
W20260709 12:59:30.696326  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 174268us
W20260709 12:59:30.696810  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.697171  1609 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:30.696405  6189 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:30.705922   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:30.706382  6189 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.699752  6143 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.696324  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.709930  6210 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:30.710963  6063 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:30.717021  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:30.718981  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.719771  6074 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.720629  6074 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:30.722805  6216 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:30.723402  6181 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.725627  6149 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.726845  6172 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:30.727655  5972 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.728775  2474 raft_consensus.cc:2410] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:59:30.690092  6090 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.738044  6207 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.738981  6262 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:30.740571  6230 log.cc:927] Time spent T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.415s	user 0.002s	sys 0.000s
I20260709 12:59:30.744179  1682 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:30.746417  1676 raft_consensus.cc:1240] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:30.746713  1681 raft_consensus.cc:1240] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:30.749022  1497 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.998s (SENT)
I20260709 12:59:30.749598  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:30.751938  1497 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.080s (SENT)
I20260709 12:59:30.752131  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:30.753010  1683 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:30.753926  6115 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:30.754531  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.755750  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:30.756366  1681 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:30.757372  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:30.758081  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:30.717108  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.759615  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.709272  6189 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.759124  6217 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:30.771060  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:30.759351  1500 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.771853  1604 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:30.772759  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:30.790447  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 73588.4us
W20260709 12:59:30.796229  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.797837  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 220284us
I20260709 12:59:30.806334  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2189) took 1495 ms. Trace:
W20260709 12:59:30.818900  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 48300.6us
W20260709 12:59:30.824432  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 54248.1us
I20260709 12:59:30.792981  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:30.721356  6074 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:30.781811  6075 consensus_meta.cc:287] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.005s
I20260709 12:59:30.809821  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:30.797400  6037 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15.
I20260709 12:59:30.805882  6262 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:30.798063  6143 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:30.787155  5996 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:30.832015  6181 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:30.833257  1649 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:30.790210  6216 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:30.852572   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:30.792454  6063 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:30.777518  6115 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:30.789722  6174 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:30.833666  6208 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.851114  6262 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.843431  6040 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:30.862962  2428 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
W20260709 12:59:30.863307  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 149789us
I20260709 12:59:30.818333  1530 rpcz_store.cc:276] 0709 12:59:29.310790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.324085 (+ 13295us) service_pool.cc:224] Handling call
0709 12:59:29.324475 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.390263 (+ 65788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.390295 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.399041 (+  8746us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.383387 (+984346us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:30.386386 (+  2999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.388823 (+  2437us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.739878 (+351055us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:30.760304 (+ 20426us) raft_consensus.cc:1685] finished
0709 12:59:30.760323 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.806273 (+ 45950us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66937,"raft.queue_time_us":105581,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6919,"spinlock_wait_cycles":48490880,"thread_start_us":837616,"threads_started":1,"wal-append.queue_time_us":876295}
I20260709 12:59:30.854462  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:30.876044  6174 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.876257  6208 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.876988  1498 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:30.878612  6174 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:30.876309  1431 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.874457  6189 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:30.882308  1431 catalog_manager.cc:5697] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 9, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 9 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:30.863497  6091 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:59:30.852973  6149 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 12:59:30.886060  2428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36912 (request call id 1076) took 1447 ms (client timeout 1920 ms). Trace:
W20260709 12:59:30.886583  2428 rpcz_store.cc:269] 0709 12:59:29.438602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.438710 (+   108us) service_pool.cc:224] Handling call
0709 12:59:30.885815 (+1447105us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400530f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:30.885967 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3261629824}
W20260709 12:59:30.887228  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.860868  6216 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:30.887682  6216 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:30.889292  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 318) took 41033 ms (client timeout 15000 ms). Trace:
W20260709 12:59:30.899881  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 64884.2us
I20260709 12:59:30.872342  5996 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:30.895651  2455 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:30.895524  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.896605  2475 pending_rounds.cc:85] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 9
W20260709 12:59:30.897154  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 64054.8us
I20260709 12:59:30.897189  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.894501  6174 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 12:59:30.867105  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.903023  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:30.908921  6210 consensus_queue.cc:1059] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:30.909350  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:30.910000  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.912235  6189 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:30.912880  6189 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:30.901486  2475 pending_rounds.cc:107] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:59:30.913769  6090 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:30.873219  6262 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:30.912551  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:30.905524  1431 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 9, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:30.919328  1683 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:30.914187  2475 raft_consensus.cc:2889] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.862088  6074 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.924652  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.903694  6040 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:30.938215  6091 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:30.938793  6091 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:30.939064  6040 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.939949  6091 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:30.941999  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:30.932111  2428 raft_consensus.cc:2376] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12. Re-sending same reply.
I20260709 12:59:30.928977  6090 consensus_queue.cc:1243] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:30.945021  2421 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:30.935910  6052 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:30.936540  6174 consensus_queue.cc:1243] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer 3cabc5110903443ba3beb5cbb14afa91 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:59:30.936448  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.945530  1431 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:30.948882  2435 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
W20260709 12:59:30.954795  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 51875.2us
I20260709 12:59:30.956777  1682 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:30.950768  6052 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.972431  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:30.972550  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:30.971167  1675 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:30.958207  6149 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:30.961061  6091 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:30.973647  2435 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 8.
I20260709 12:59:30.968479  6052 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:30.975960  5964 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:31.001813  6260 log.cc:927] Time spent T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:59:31.006335  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.997072  6180 consensus_queue.cc:1059] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 12:59:31.010587  6190 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.016569  6211 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:31.022336  6211 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:31.022789  6211 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:31.026413  6216 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.026755  6149 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.028808  6149 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:31.030069  6075 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.030654  6075 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.018661  1681 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:31.033878  6075 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:30.987179  6217 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:59:31.044116  6217 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:31.044519  6217 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.045730  2423 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:31.048877  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:30.970418  6097 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:59:31.028810  6216 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:31.054613  6190 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:31.055784  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 59143us
I20260709 12:59:30.970026  6037 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:59:31.056396  6074 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.057214  6090 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:31.056335  6190 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:31.059906  6190 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.060833  6190 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:30.998849  1431 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 10, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.069958  1681 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:31.000559  5964 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.966149  6189 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.017763  6180 raft_consensus.cc:3055] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:31.078460  6143 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.096181  5798 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:31.096961  6207 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:31.099766  6208 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.076900  1431 catalog_manager.cc:5697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 8, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.104938  6091 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.078038  5964 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:31.111706  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 144758us
I20260709 12:59:31.108628  6180 raft_consensus.cc:740] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:31.107532  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:31.045486  6217 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.121035  5798 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.120687  6143 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.122402  6207 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:31.136741  1431 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:30.900235  1428 rpcz_store.cc:269] 0709 12:58:49.855506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.859125 (+  3619us) service_pool.cc:224] Handling call
0709 12:58:50.833331 (+974206us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b540012eb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1902090 00007f25d19a0f3a 00007f25d77571cc 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc 00007f25d5d15392 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:30.888832 (+40055501us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:24.378599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:24.379329 (+   730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:24.379385 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:59:24.379414 (+    29us) tablet.cc:662] Decoding operations
0709 12:59:24.380317 (+   903us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:24.380431 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:24.380461 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:24.381045 (+   584us) tablet.cc:701] Row locks acquired
0709 12:59:24.381100 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:59:24.381256 (+   156us) write_op.cc:270] Start()
0709 12:59:24.381407 (+   151us) write_op.cc:276] Timestamp: P: 1783601964381194 usec, L: 0
0709 12:59:24.381453 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:59:24.382334 (+   881us) log.cc:844] Serialized 1691 byte log entry
0709 12:59:24.921138 (+538804us) op_driver.cc:464] REPLICATION: finished
0709 12:59:25.453881 (+532743us) write_op.cc:301] APPLY: starting
0709 12:59:25.453987 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:25.514252 (+ 60265us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:25.554795 (+ 40543us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:25.936577 (+381782us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:25.999619 (+ 63042us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:59:26.021064 (+ 21445us) write_op.cc:312] APPLY: finished
0709 12:59:26.189152 (+168088us) log.cc:844] Serialized 49 byte log entry
0709 12:59:26.533405 (+344253us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.539739 (+  6334us) write_op.cc:454] Released schema lock
0709 12:59:26.548336 (+  8597us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:26.600176 (+ 51840us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.616356 (+ 16180us) write_op.cc:454] Released schema lock
0709 12:59:27.030729 (+414373us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
Metrics: {"mutex_wait_us":1583054,"reported_tablets":42,"spinlock_wait_cycles":122880256,"child_traces":[["op",{"apply.queue_time_us":475579,"apply.run_cpu_time_us":42671,"apply.run_wall_time_us":1136925,"cfile_cache_hit":14,"cfile_cache_hit_bytes":14609,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":2469,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":4,"prepare.queue_time_us":33799,"prepare.run_cpu_time_us":82658,"prepare.run_wall_time_us":117544,"raft.queue_time_us":235661,"raft.run_cpu_time_us":78680,"raft.run_wall_time_us":552223,"replication_time_us":501048,"spinlock_wait_cycles":5443840,"thread_start_us":757862,"threads_started":5,"wal-append.queue_time_us":461688,"wal-append.run_cpu_time_us":58368,"wal-append.run_wall_time_us":2848919}]]}
I20260709 12:59:31.138427  5798 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.047581  6262 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:31.146582  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 147851us
I20260709 12:59:31.147511  2461 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:31.149070  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.150014  1681 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:31.150386  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.149204  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.151162  1679 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:31.151432  1683 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:31.151803  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.152447  1680 raft_consensus.cc:2410] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:59:31.153506  1677 raft_consensus.cc:1240] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 12. Ops: [10.10-10.10]
I20260709 12:59:31.154829  6174 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:31.155802  6174 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.150903  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.158229  1682 raft_consensus.cc:2393] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:31.160923  6180 consensus_queue.cc:260] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.162712  6180 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.165298  6217 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.166937  1575 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.169413  6029 raft_consensus.cc:2804] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:31.170439  6265 consensus_queue.cc:1175] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 12:59:31.172024  6019 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.172744  6019 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:31.177253  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.177873  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.178731  1609 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:31.180341  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:31.181736  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.177976  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:31.183771  1527 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:31.169248  6240 raft_consensus.cc:3055] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:31.185948  6240 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.139362  6052 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.186863  6240 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.188103  6240 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:31.185456  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.169252  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.194661  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.195326  1605 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:31.196581  1606 raft_consensus.cc:1240] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:31.197580  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.197947  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.198835  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.140184  6149 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:31.131589  6091 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.214861  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.172041  6262 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.206863  1431 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 7, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 7 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.212977  1607 raft_consensus.cc:1217] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 12:59:31.222054  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.222925  1609 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:31.223774  1607 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:31.207507  6149 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.210212  5798 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:31.231455  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.242116  1531 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:31.245697  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.246865  1682 raft_consensus.cc:2393] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:59:31.265328  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.274924  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.239616  5996 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:31.270017  1431 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:31.283473  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.243103  6149 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.288262  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.288964  1531 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:31.295190  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.288336  6029 raft_consensus.cc:697] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:31.300004  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:31.305680  1525 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:31.316025  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.263715  6207 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.321926  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:31.323468  1609 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:31.301281  6019 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.331264  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.320504  1682 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 12. Ops: []
I20260709 12:59:31.328289  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.334950  1680 raft_consensus.cc:2368] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:31.321244  1431 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 9, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:31.337594  1531 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:31.341197  1683 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:31.345660  1603 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:31.346206  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:31.351720  1679 raft_consensus.cc:1240] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:31.352363  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:31.329824  6174 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:31.357617  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:31.358197  2428 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:31.358737  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:31.360008  1680 raft_consensus.cc:1240] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:31.359246  2339 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:31.363807  1678 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 5. Current term is 7. Ops: []
I20260709 12:59:31.363893  1533 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:31.364797  6207 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.379477  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.380167  1431 catalog_manager.cc:5697] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:31.376915  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:31.383154  1683 raft_consensus.cc:2368] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:31.382058  2339 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:31.385862  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:31.386480  1674 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.389258  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:31.391367  6274 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:59:31.410709  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.411684  1602 raft_consensus.cc:2393] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:31.412626  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.413370  1602 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:31.414011  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.415375  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.416487  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.417789  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.418419  1601 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:31.420225  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.421976  1526 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:31.425664  6216 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:31.425946  6040 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.426388  6216 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.426610  6040 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.379989  6029 consensus_queue.cc:237] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.427491  6216 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.428701  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.429450  1678 raft_consensus.cc:2368] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:31.378212  6091 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.434726  1533 raft_consensus.cc:2468] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:31.436133  1606 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
W20260709 12:59:31.436462  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 54502.6us
I20260709 12:59:31.417138  1607 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:31.441922  6181 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:31.442410  6181 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:31.442596  6052 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:31.441941  1500 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:31.443737  6040 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.442708  6097 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:31.445458  2339 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:31.459960  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:31.460253  2344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.462273  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:31.510627  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48411.3us
I20260709 12:59:31.510146  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.442797  6181 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:31.436877  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.524289  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.524523  1526 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:59:31.524863  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.525419  1607 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.476692  1678 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:31.517198  1525 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
W20260709 12:59:31.525914  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 60611.7us
I20260709 12:59:31.518986  1534 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:59:31.527765  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.524998  1526 pending_rounds.cc:85] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 9
I20260709 12:59:31.531751  1526 pending_rounds.cc:107] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:59:31.532049  1526 raft_consensus.cc:2889] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:31.464421  6040 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:31.533450  1679 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:31.534287  1529 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:31.538486  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.512809  6172 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:31.541111  1603 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:31.512341  1431 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 8, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:31.541155  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 91028.2us
W20260709 12:59:31.548159  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.545827  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:31.553942  1531 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:31.556613  1601 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:31.524405  6198 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:31.559437  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.430781  5964 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.548792  1602 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:31.528834  6143 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.564656  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.566941  1529 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:31.567422  1525 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:31.541424  6040 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.523365  6174 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:59:31.558068  6172 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:31.581070  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.562270  6198 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.581607  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.582912  1674 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:31.583585  2474 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:31.584216  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.587955  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.587342  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.590484  1600 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:31.590046  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.600591  1602 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:31.587365  1575 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.589884  1529 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 9.
I20260709 12:59:31.607808  1605 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
W20260709 12:59:31.608968  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.610085  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.581418  6040 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:31.615571  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:31.591753  6190 consensus_meta.cc:287] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.001s
I20260709 12:59:31.588394  6172 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.618649  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:31.619951  1601 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:59:31.621348  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 72437.4us
I20260709 12:59:31.634905  2342 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:31.589164  6198 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:31.613602  6063 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.637658  1677 raft_consensus.cc:2410] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:59:31.638052  6063 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.640241  6063 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:31.625221  6211 consensus_meta.cc:287] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.602s	user 0.014s	sys 0.000s
I20260709 12:59:31.640897  6211 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.642766  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.643173  5964 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.643442  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.644196  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.644358  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.644742  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:31.644889  1682 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:31.645171  1679 raft_consensus.cc:2410] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:59:31.645730  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:31.646169  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.646003  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.630352  6189 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:31.646981  1680 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
I20260709 12:59:31.647131  6189 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.647806  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.647926  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.649786  6262 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:31.650213  6262 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:31.650581  6262 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:31.614530  6238 consensus_queue.cc:1059] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:59:31.652014  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:31.652774  1678 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:31.652892  6238 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:31.648871  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.652042  6189 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:31.625687  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:31.654994  1679 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:31.655638  6211 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:31.656298  6211 raft_consensus.cc:3055] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:31.656589  6211 raft_consensus.cc:740] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.646552  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.591655  6091 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:31.657398  6211 consensus_queue.cc:260] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.657900  6091 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.658120  1676 raft_consensus.cc:2410] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:59:31.658408  6091 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:31.653692  6238 consensus_queue.cc:1059] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:31.645972  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.637372  2342 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:31.644300  1681 raft_consensus.cc:2410] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:59:31.660470  1674 raft_consensus.cc:2410] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:59:31.666509  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.616176  1431 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 8, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.646404  2451 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:31.673405  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.674479  1682 raft_consensus.cc:2393] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:31.624203  1604 raft_consensus.cc:2468] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:31.581080  6199 consensus_queue.cc:1059] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:59:31.688337  1575 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.710148  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.691082  2474 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:31.701548  1498 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.692411  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:31.711119  1674 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:31.709584  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.713691  1431 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 11, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 11 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.712608  2476 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:31.611037  6065 consensus_queue.cc:1059] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 12:59:31.659531  6238 raft_consensus.cc:3055] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:31.715487  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:31.722095  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.724447  1682 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:59:31.722604  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 130066us
I20260709 12:59:31.696031  5798 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:31.727887  1607 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:31.713702  6143 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:31.730114  6109 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:31.718174  6063 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:31.739997  2475 raft_consensus.cc:1240] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:31.722425  6238 raft_consensus.cc:740] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.738451  1431 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 10, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.736433  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.687188  6190 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.722270  6268 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:59:31.752453  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.752537  2342 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.733420  6047 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:31.754940  1500 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:31.756026  1682 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:59:31.756981  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 189292us
I20260709 12:59:31.758322  6037 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.758713  6097 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:31.763422  6097 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:31.763847  6097 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:31.759068  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.764953  1431 catalog_manager.cc:5697] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 10, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.766005  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.766580  1683 raft_consensus.cc:2368] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15.
I20260709 12:59:31.766842  1681 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:31.765326  6097 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.769198  6097 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:31.773803  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.774075  1675 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:31.775619  6190 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.776832  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:31.778008  1575 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.778786  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:31.779779  6109 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:31.779822  6180 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:31.780335  6109 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.780625  6180 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:31.780745  6109 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.733784  6143 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:31.780354  6265 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:31.783543  6143 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:31.783838  6265 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.784264  6265 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.785938  6180 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.767252  1431 catalog_manager.cc:5697] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.791409  6052 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:31.791177  6238 consensus_queue.cc:260] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.792678  6238 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:31.793937  6174 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:31.794989  6174 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:31.795451  6174 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.791049  1431 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.797087  2344 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:31.799693  2344 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:31.800745  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:31.800959  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:31.801499  1602 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.806304  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:31.818908  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.820863  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.824074  2344 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:31.832864  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:31.833878  1681 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:31.835314  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.658852  6211 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.737545  6280 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:59:31.754560  6063 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:31.836174  1682 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:31.757513  6047 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:31.838510  1431 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.796211  6199 raft_consensus.cc:3055] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:31.857895  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:31.855768  6287 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:59:31.865584  1674 raft_consensus.cc:2410] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:31.838105  6217 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:31.819871  6189 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:59:31.831799  6240 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:59:31.867170  1431 catalog_manager.cc:5697] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 9, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 9 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:31.872606  6297 log.cc:927] Time spent T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:59:31.880054  6296 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:59:31.881735  6301 raft_consensus.cc:2804] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:31.882442  6301 raft_consensus.cc:697] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.840068  6019 consensus_queue.cc:1059] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:59:31.866005  6210 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:31.867741  6199 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:31.871263  6047 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.897786  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.883443  6301 consensus_queue.cc:237] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.870291  6217 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:31.909837  2343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.915138  6264 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:31.916227  6063 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.917644  6189 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:31.918088  6189 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:31.919142  6189 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:31.920692  6189 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:31.921358  6149 consensus_meta.cc:287] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 12:59:31.921833  6149 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.923931  6149 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.925137  1609 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 11. Ops: []
I20260709 12:59:31.925055  6109 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.926455  1605 raft_consensus.cc:1240] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:59:31.910990  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 156114us
I20260709 12:59:31.909451  1431 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 9, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 9 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.928361  6109 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:31.929802  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:31.930537  1674 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:31.910116  1682 raft_consensus.cc:2376] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10. Re-sending same reply.
W20260709 12:59:31.983065  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 174702us
I20260709 12:59:31.858249  6174 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:31.884922  6207 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 12:59:31.980531  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.986177  1431 catalog_manager.cc:5697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.992449  1602 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:32.002854  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.004179  1674 raft_consensus.cc:2410] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:59:32.008980  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 256472us
I20260709 12:59:31.994621  6210 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:31.984505  1647 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:32.014168   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:32.042178  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 57757.1us
I20260709 12:59:32.049996  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.050935  1674 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 7.
W20260709 12:59:32.050300  1497 leader_election.cc:336] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.590s (SENT)
I20260709 12:59:32.043996  1431 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 8, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 8 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.057826  6217 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.059739  6217 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:32.062103  6300 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:59:32.062513  6265 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.069573  6172 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.070297  6091 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.071753  6172 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.072258  6091 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:32.073504  1607 raft_consensus.cc:1240] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:32.075773  2423 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:32.076155  6198 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:32.077865  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:32.065372  6181 consensus_meta.cc:287] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.001s
I20260709 12:59:32.081993  2342 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:32.083135  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 259090us
I20260709 12:59:32.052896  6210 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:32.095911  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.097426  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.100399  1682 raft_consensus.cc:2410] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:59:32.100896  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 67068us
I20260709 12:59:32.088583  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.102836  1681 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:32.104938  6310 raft_consensus.cc:2804] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:32.105544  6310 raft_consensus.cc:697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:32.106540  6310 consensus_queue.cc:237] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.108029  2344 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:32.108465  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.109320  1677 raft_consensus.cc:2410] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:59:32.102299  1497 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.600s (SENT)
I20260709 12:59:32.111758  1674 raft_consensus.cc:2368] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:32.081089  1431 catalog_manager.cc:5697] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 2 to 4, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 4 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.084136  6308 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:32.049969  6199 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.092505  6312 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:32.086185  6037 consensus_queue.cc:1059] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:59:32.082695  6181 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.154335  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.155081  1682 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:32.168843  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.169706  1674 raft_consensus.cc:2376] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10. Re-sending same reply.
I20260709 12:59:32.117529  6299 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:32.083108  6143 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:32.117434  6172 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.178164  1431 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
W20260709 12:59:32.181070  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.183179  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.185968  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.187062  1674 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:32.188210  6097 raft_consensus.cc:3055] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:32.188655  6097 raft_consensus.cc:740] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:59:32.193483  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.167740  6312 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:32.110009  6314 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 12:59:32.197750  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 89801.4us
I20260709 12:59:32.198766  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.200094  1674 raft_consensus.cc:2410] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:59:32.173038  6265 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:32.155853  6262 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:32.204300  2344 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:32.192873  6208 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:32.206346  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 104069us
I20260709 12:59:32.206789  1431 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:32.209841  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.210655  1682 raft_consensus.cc:2368] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:32.210965  6238 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:32.211263  1572 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.905s (SENT)
I20260709 12:59:32.211838  1572 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:32.211660  6238 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:32.212996  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 100214us
I20260709 12:59:32.213130  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.213361  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.214179  1675 raft_consensus.cc:2410] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:59:32.214571  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.214180  1681 raft_consensus.cc:2368] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13.
I20260709 12:59:32.205341  6210 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.215921  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.216621  1683 raft_consensus.cc:2393] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.217864  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.221916  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.222821  1682 raft_consensus.cc:2393] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:32.189646  6097 consensus_queue.cc:260] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.226419  6097 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:32.207443  6198 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:32.230747  6312 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.231709  6265 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:32.192039  6172 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.209169  6208 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.240212  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.241118  1674 raft_consensus.cc:2410] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:59:32.179994  6040 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.230901  6262 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:32.244201  1572 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.947s (SENT)
I20260709 12:59:32.244580  6143 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.244701  1572 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:32.247256  6315 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:32.247584  1419 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 049eb4ac8c3a4cb896b8b236a384b04d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e45ac8b66854c2f905bf2c4114cb489 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:32.248567  6308 consensus_queue.cc:1059] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:32.249521  6308 raft_consensus.cc:3055] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:32.249928  6308 raft_consensus.cc:740] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:32.250952  6308 consensus_queue.cc:260] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.252475  6308 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:32.207448  6324 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.257361  6324 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:32.260847  1497 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.614s (SENT)
I20260709 12:59:32.269934  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:32.273591  1431 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 7, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:32.268512  6174 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:32.276510  6238 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.277872  6047 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:32.278568  6324 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.280507  6181 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.280959  6040 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:32.261255  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 57263.2us
I20260709 12:59:32.282953  1431 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.285262  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.284168  6063 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:32.292431  1608 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:32.292646  1497 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.615s (SENT)
I20260709 12:59:32.293802  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.294225  1497 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:32.294636  1682 raft_consensus.cc:2393] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.296401  6208 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:32.301347  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:32.302198  1609 raft_consensus.cc:2393] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:32.302969  6199 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:32.305298  6181 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.305825  6181 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.309863  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:32.310626  6240 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:32.311251  6240 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.311647  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:32.312249  2461 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:32.313781  5798 raft_consensus.cc:3055] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:32.313933  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:32.314231  5798 raft_consensus.cc:740] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:32.314568  2474 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:32.315140  5798 consensus_queue.cc:260] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:32.316922  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.318562  2475 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:32.322778  2474 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
W20260709 12:59:32.326983  6309 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 12:59:32.328408  6097 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:32.331192  6307 log.cc:927] Time spent T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:59:32.334074  6302 log.cc:927] Time spent T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.436s	user 0.001s	sys 0.002s
I20260709 12:59:32.334470  6047 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.338647  5798 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:32.341876  6304 log.cc:927] Time spent T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 12:59:32.343648  2423 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:32.344751  6268 raft_consensus.cc:3055] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:32.345171  6268 raft_consensus.cc:740] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:32.345913  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 53303.7us
I20260709 12:59:32.346101  6268 consensus_queue.cc:260] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.347622  6268 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:32.347759  1497 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.699s (SENT)
W20260709 12:59:32.348994  1497 leader_election.cc:336] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.760s (SENT)
W20260709 12:59:32.356232  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.365227  2474 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:32.366019  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:32.349367  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:32.368832  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:32.369656  1528 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:32.372172  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.372890  1683 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:32.373070  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.373170  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.373726  1675 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:32.374142  1677 raft_consensus.cc:2410] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:59:32.376785  2421 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:32.377823  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.378607  1681 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.372921  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:32.381752  2423 raft_consensus.cc:3060] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:32.382408  6063 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:32.383327  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.384235  1682 raft_consensus.cc:2410] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:59:32.385890  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:32.386580  2435 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:32.372315  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:32.390092  2461 raft_consensus.cc:3060] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:32.390311  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:32.390923  1525 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:32.401201  2423 raft_consensus.cc:2468] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:32.402817  1675 raft_consensus.cc:2468] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:32.405164  1525 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:32.405373  1528 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:32.395282  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:32.410996  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 43909.9us
W20260709 12:59:32.415288  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.365989  6210 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:59:32.417152  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:32.416126  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 67175.2us
I20260709 12:59:32.419246  1682 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.419871  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:32.419662  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:32.421988  1682 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:32.422930  2428 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:32.421986  1525 raft_consensus.cc:2410] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:59:32.422045  2461 raft_consensus.cc:2468] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
I20260709 12:59:32.424978  1500 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:32.430786  1500 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:32.432678  1500 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:32.435863  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:32.436656  1525 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:32.409868  6310 consensus_queue.cc:1059] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:59:32.441761  1526 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:59:32.447837  1526 pending_rounds.cc:85] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 10
I20260709 12:59:32.431744  5798 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:32.432010  6216 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.418890  6198 consensus_queue.cc:1059] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:32.456099  1683 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:32.440735  2339 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:32.446476  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.448108  1526 pending_rounds.cc:107] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:59:32.457955  1677 raft_consensus.cc:2368] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15.
I20260709 12:59:32.458012  1526 raft_consensus.cc:2889] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:32.459362  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:32.460170  1526 raft_consensus.cc:2410] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:59:32.448493  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.461925  1682 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:32.421998  6172 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.432353  6062 raft_consensus.cc:3060] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:32.449395  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:32.472658  6062 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:32.439069  6052 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:32.488579  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:32.492771  2344 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:32.500818  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.502003  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:32.502669  1528 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:32.502794  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.508845  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:32.511794  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:32.513760  2435 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:32.513777  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:32.514830  1602 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:32.449542  6240 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:32.478242  6238 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.522410  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:32.524497  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:32.476346  6264 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:32.481976  6314 raft_consensus.cc:2804] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:32.528402  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:32.530155  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:32.535620  1609 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:32.482846  6052 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.524673  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.549654  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.550621  1675 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.485188  6040 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:32.527896  1601 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.525126  6216 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.531239  6238 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.529400  1608 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:32.542876  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.518654  5798 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:32.525475  6217 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.497387  1525 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:32.522293  6299 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:32.534605  6264 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:32.552228  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.568086  1677 raft_consensus.cc:2393] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 8: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.571013  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.544970  6314 raft_consensus.cc:697] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:32.573835  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:32.574445  1533 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:32.542124  6052 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:32.519573  6310 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:59:32.564752  1575 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:32.574000  1682 raft_consensus.cc:2393] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 11: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.564723  1528 raft_consensus.cc:2468] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:32.582448  1575 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:32.563299  6324 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:32.559446  6190 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.586186  6091 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:32.611531  1525 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:32.541039  6262 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:59:32.587981  2342 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:32.591838  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 159228us
I20260709 12:59:32.615541  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:32.617532  2342 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:32.618817  6190 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:32.626983  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.627669  1674 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:32.590209  6265 raft_consensus.cc:2804] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:32.569629  6180 consensus_queue.cc:1059] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:59:32.573871  6217 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.625358  6210 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:32.638124  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.645200  1533 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:32.586266  6324 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.627774  6040 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:32.635757  6240 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:32.566805  6318 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:59:32.666435  5798 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.713636  1682 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:32.586217  6314 consensus_queue.cc:237] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.737267  1674 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:32.661397  6265 raft_consensus.cc:697] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:32.667461  6047 raft_consensus.cc:3055] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:32.742234  6040 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.744028  6190 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:32.752286  6217 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:59:32.753798  6316 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:32.775447  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.780841  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.724992  6210 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.740252  6282 raft_consensus.cc:2804] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:32.730396  6198 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:32.787639  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:32.792735  6282 raft_consensus.cc:697] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 15 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:32.793390  1674 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 14: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:32.793903  6282 consensus_queue.cc:237] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.795600  1682 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:59:32.796249  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.799064  1682 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:32.754928  6047 raft_consensus.cc:740] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:32.784868  6318 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:32.806035  6198 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:32.810622  6216 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.812938  6047 consensus_queue.cc:260] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.789788  6316 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:32.870064  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.814864  6318 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:32.829025  6316 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:32.902469  1609 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:32.798574  6210 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.917776  1682 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:59:32.903266  6047 raft_consensus.cc:3060] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:32.904387  6238 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:32.902200  6265 consensus_queue.cc:237] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.927795  6318 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.955847  6318 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:32.944146  6210 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:32.948378  6308 consensus_meta.cc:287] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.695s	user 0.013s	sys 0.002s
I20260709 12:59:32.965013  1534 raft_consensus.cc:2410] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:59:32.975155  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.976411  1682 raft_consensus.cc:2368] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10.
W20260709 12:59:32.978437  6341 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:59:32.982087  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:32.983029  1674 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:32.936821  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 349519us
I20260709 12:59:32.993330  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:32.990779  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.005961  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:33.009160  1682 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:59:32.946302  6199 consensus_meta.cc:287] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.001s
I20260709 12:59:32.968940  6264 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:32.954101  6198 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:33.031876  1674 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:33.035400  2475 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.011183  6180 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:33.030467  6324 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:33.056258  1674 raft_consensus.cc:1240] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:59:33.056847  6264 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:33.035032  6344 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:33.060942  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.062827  1683 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
W20260709 12:59:33.065070  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.053150  6240 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:33.074991  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.057768  6180 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:33.083630  1572 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.571s (SENT)
I20260709 12:59:33.097157  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:33.100848  1575 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:33.103148  1607 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:33.079110  6344 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:33.108624  1572 leader_election.cc:336] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.364s (SENT)
I20260709 12:59:33.111595  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.112413  1675 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:33.109230  1575 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:33.121938  6334 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.226s	user 0.000s	sys 0.002s
I20260709 12:59:33.108363  6143 raft_consensus.cc:2804] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:33.105851  6264 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:33.121639  6333 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:33.109349  6313 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:59:33.134214  2475 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
W20260709 12:59:33.136818  6345 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:59:33.139236  6268 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:33.139918  6268 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:33.140873  6268 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:33.150907  1682 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:33.161059  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.163129  1675 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:33.148463  6143 raft_consensus.cc:697] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:33.146531  6264 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:33.185755  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.200054  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:33.200732  2474 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.209263  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:33.210903  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.209957  1605 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:33.215019  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.215812  1603 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 11: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:33.220700  1602 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:33.222630  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.222944  1675 raft_consensus.cc:2410] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:59:33.224561  1601 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:33.228669  1675 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:33.231005  2342 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:33.234495  1497 leader_election.cc:336] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.920s (SENT)
W20260709 12:59:33.243206  1572 leader_election.cc:336] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.775s (SENT)
I20260709 12:59:33.248865  2474 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:33.256811  1575 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:33.155462  6180 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.288955  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:33.286947  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.291666  6324 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:33.233480  6314 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 12:59:33.302713  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.304214  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.304826  1674 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:33.289989  5798 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:33.308825  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.310446  6364 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:59:33.314196  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71058.7us
W20260709 12:59:33.315371  1572 leader_election.cc:336] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.784s (SENT)
I20260709 12:59:33.203621  6344 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:33.298870  6363 log.cc:927] Time spent T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:59:33.310096  5798 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.307017  6181 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:33.335552  1572 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.874s (SENT)
W20260709 12:59:33.337294  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 80617.8us
I20260709 12:59:33.338263  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.350646  1675 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.331595  5798 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:33.356362  6348 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 12:59:33.357198  6365 log.cc:927] Time spent T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:33.358664  1600 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:59:33.360708  6052 consensus_meta.cc:287] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 12:59:33.337661  6181 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.369136  1674 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
W20260709 12:59:33.384797  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.331384  6366 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:33.385052  2474 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:33.424300  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.306746  6264 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:33.334004  6265 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:33.312228  6143 consensus_queue.cc:237] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:33.420930  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.361447  6174 raft_consensus.cc:3055] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:33.425164  1683 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:33.422931  6181 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.418366  6052 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.446493  5964 raft_consensus.cc:3055] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:33.447136  5964 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:33.448664  6052 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:33.448186  5964 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:33.450657  1532 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:33.452337  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34406 (request call id 965) took 1024 ms. Trace:
I20260709 12:59:33.452656  1532 rpcz_store.cc:276] 0709 12:59:32.427892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.477737 (+ 49845us) service_pool.cc:224] Handling call
0709 12:59:33.452122 (+974385us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54003ae154. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:33.452246 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210203520}
I20260709 12:59:33.454886  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60876 (request call id 2229) took 1091 ms. Trace:
I20260709 12:59:33.455247  1534 rpcz_store.cc:276] 0709 12:59:32.363774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.365742 (+  1968us) service_pool.cc:224] Handling call
0709 12:59:33.454671 (+1088929us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540004cc54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:33.454787 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373011328}
I20260709 12:59:33.434818  1674 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:33.438818  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 103315us
I20260709 12:59:33.459622  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.459766  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.459749  6372 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:33.460537  1683 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:33.460549  1682 raft_consensus.cc:2410] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:59:33.461969  1572 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.960s (SENT)
I20260709 12:59:33.462386  1572 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:33.463256  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.463867  1603 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:33.464803  1605 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:33.457808  1675 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:33.467376  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.468209  2342 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:33.458833  6366 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:33.471776  1682 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:33.472405  6366 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.435848  6174 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:33.474956  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.474654  6174 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.458969  6181 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:33.466074  5964 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:33.480746  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.484761  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.485049  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.469164  6109 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:33.492776  2339 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:33.436074  6314 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:59:33.513820  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:33.513695  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 55410.9us
I20260709 12:59:33.512892  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:33.478853  6240 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:33.516543  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:33.515098  1572 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.121s (SENT)
W20260709 12:59:33.484786  6316 consensus_meta.cc:287] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
I20260709 12:59:33.517289  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.521986  1674 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:33.518021  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.517133  1605 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:33.496030  6174 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:33.565716  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.566582  1683 raft_consensus.cc:2376] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
W20260709 12:59:33.573318  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 58247.5us
W20260709 12:59:33.574024  1572 leader_election.cc:336] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.133s (SENT)
I20260709 12:59:33.574386  1682 raft_consensus.cc:2368] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10.
I20260709 12:59:33.481736  6324 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:59:33.512725  6198 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.513651  6310 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:33.516829  6240 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.585012  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:33.590659  6370 log.cc:927] Time spent T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 12:59:33.591614  6374 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:59:33.517429  6352 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.593847  1572 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:33.601514  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.604501  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.594816  1674 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:33.595980  6240 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.613863  2474 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:33.565428  6316 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:33.631299  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.665118  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 91123.3us
W20260709 12:59:33.667501  1572 leader_election.cc:336] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.857s (SENT)
I20260709 12:59:33.598317  6310 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:33.668908  6310 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:33.631470  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 395766us
I20260709 12:59:33.678437  6379 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:33.679287  6308 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.679061  6379 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.679976  6308 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:33.682133  6379 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:33.682333  6308 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:33.683082  6308 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.683862  2474 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:33.683619  6308 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.686757  6308 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:33.687021  1497 leader_election.cc:336] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.542s (SENT)
I20260709 12:59:33.688311  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:33.687048  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 204814us
I20260709 12:59:33.687813  1530 raft_consensus.cc:1275] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:33.689308  6180 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:59:33.694844  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.698495  1497 leader_election.cc:336] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.548s (SENT)
I20260709 12:59:33.597543  6198 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:33.714006  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.715157  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:33.715994  2423 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:33.721758  6316 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:33.664297  6381 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.724565  1500 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:33.730312  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:33.619134  6211 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.697885  6377 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
I20260709 12:59:33.731379  1682 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:33.612967  6380 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:33.695631  6181 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.741242  1497 leader_election.cc:336] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.611s (SENT)
I20260709 12:59:33.703902  6379 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.736666  6308 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:33.743940  6181 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.744876  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.600936  6352 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.749993  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 941) took 1395 ms. Trace:
I20260709 12:59:33.754123  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:33.761787  1607 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:33.763188  2475 rpcz_store.cc:276] 0709 12:59:32.355063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.359452 (+  4389us) service_pool.cc:224] Handling call
0709 12:59:33.749807 (+1390355us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b5400475754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:33.749936 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433240320}
I20260709 12:59:33.770817  2423 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:33.758024  6308 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.775632  1682 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:59:33.776571  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.739030  6211 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.774031  1602 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:33.777881  1497 leader_election.cc:336] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.624s (SENT)
W20260709 12:59:33.774009  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.780750  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 270637us
I20260709 12:59:33.781689  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:33.783254  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:33.773281  6115 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:33.772441  6344 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:33.792460  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.793102  1682 raft_consensus.cc:2376] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12. Re-sending same reply.
I20260709 12:59:33.778851  6308 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:33.790856  2428 raft_consensus.cc:2393] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 11: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:33.739909  6381 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:33.798121  1497 leader_election.cc:336] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.942s (SENT)
I20260709 12:59:33.808182  6240 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.809954  6198 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:33.818490  1497 leader_election.cc:336] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.969s (SENT)
I20260709 12:59:33.818993  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:33.814241  6386 log.cc:927] Time spent T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:59:33.820716  6115 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:33.823015  6352 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:33.823700  6240 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:33.824570  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.824913  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.825215  1674 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:33.826449  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.826740  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.827212  1674 raft_consensus.cc:2410] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:59:33.827268  1683 raft_consensus.cc:2376] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11. Re-sending same reply.
I20260709 12:59:33.801258  6392 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:59:33.829089  6181 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:33.835752  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.836354  6314 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.836696  1682 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:33.836993  6314 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.829371  6392 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:33.873413  6392 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:33.874586  6392 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:33.876037  6392 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.862048  6211 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:33.863041  6381 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:33.864084  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.880012  1683 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:33.880075  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.824928  6352 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:33.880971  1674 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:33.881573  6352 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:33.882454  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:33.883188  1674 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:33.882835  6352 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:33.884631  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.865288  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.885229  1674 raft_consensus.cc:2376] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8. Re-sending same reply.
I20260709 12:59:33.885506  1682 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.887627  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.888360  1683 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:33.890571  1572 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.692s (SENT)
I20260709 12:59:33.891173  6315 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:33.891466  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 53902.1us
I20260709 12:59:33.872736  6314 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:33.794055  6379 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:33.877238  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.891567  6315 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:33.861976  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 43518.1us
I20260709 12:59:33.869892  6308 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:33.897833  1572 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.516s (SENT)
I20260709 12:59:33.903118  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:33.906097  1497 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.977s (SENT)
I20260709 12:59:33.782141  6268 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.912524  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.913317  1677 raft_consensus.cc:3055] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:59:33.904438  5798 consensus_meta.cc:287] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.006s
I20260709 12:59:33.915910  2428 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:33.901067  6316 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.918038  1677 raft_consensus.cc:740] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:33.901479  6381 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:33.928475  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:33.929167  1608 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:33.925896  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:33.930545  1602 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.927213  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.931346  1609 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
W20260709 12:59:33.949702  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.799319  6344 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:33.953961  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.957993  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.958904  1600 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:33.962774  1682 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:33.965452  1683 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:33.960625  1677 consensus_queue.cc:260] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:33.980033  1677 raft_consensus.cc:3060] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.974946  6115 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:33.977226  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.982573  1607 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 14: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:33.980942  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.983724  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:33.983932  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:33.924901  6063 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.981514  2342 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:33.985846  6315 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.928704  6062 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.991050  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.992257  1606 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:33.993908  1602 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:33.995499  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:33.961685  6343 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:33.985047  6115 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:34.025473  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.051061  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.941995  5798 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.951784  6316 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.997406  6198 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.947301  6268 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:33.981032  6380 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:59:33.956317  6381 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:34.069876  6143 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:34.072535  6344 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:34.074110  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.077464  6115 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:33.996878  6063 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.001102  6062 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.024720  6315 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:34.083331  6316 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:34.089962  6342 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.130257  6342 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.130705  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.131971  1683 raft_consensus.cc:2410] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:59:34.132066  6387 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.348s	user 0.002s	sys 0.000s
I20260709 12:59:34.132505  6342 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:34.024300  6324 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:34.119300  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 213231us
I20260709 12:59:34.120839  1601 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
W20260709 12:59:34.137317  1497 leader_election.cc:336] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.985s (SENT)
W20260709 12:59:34.122275  6384 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:59:34.142582  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:34.055686  6343 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.149886  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:34.136302  6324 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.120824  6198 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:34.154372  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 228877us
W20260709 12:59:34.173070  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 391481us
I20260709 12:59:34.118662  6143 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.194023   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:34.146168  6342 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:34.195920  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.201058  1647 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:34.201468  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64196.5us
W20260709 12:59:34.202155  1497 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.044s (SENT)
W20260709 12:59:34.202241  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.202545  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:34.189013  6324 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.215476  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:34.203111  6384 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:59:34.218851  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.224324  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.225875  1676 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 8.
I20260709 12:59:34.220726  2342 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:34.230369  1681 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:34.230717  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.231317  1682 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:34.231418  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.206405  6308 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:34.245029  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.223507  1680 raft_consensus.cc:3055] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:34.246577  1680 raft_consensus.cc:740] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:34.250633  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:34.251312  1605 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:34.243630  1683 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:34.253358  2428 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:59:34.018800  6180 consensus_queue.cc:1175] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e45ac8b66854c2f905bf2c4114cb489" responder_term: 11 status { last_received { term: 11 index: 11 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:34.254349  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:34.254678  1572 leader_election.cc:336] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.579s (SENT)
I20260709 12:59:34.259130  1572 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:34.259966  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.260825  2423 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:34.262274  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.228343  6211 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:34.217777  6399 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:34.265129  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.267040  2461 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:34.229817  6342 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:34.217656  6312 consensus_queue.cc:1059] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:59:34.244939  6172 raft_consensus.cc:2804] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:34.279870  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:34.284135  1572 leader_election.cc:336] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.616s (SENT)
W20260709 12:59:34.284483  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.298636  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.297223  1677 raft_consensus.cc:1275] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:59:34.300860  1677 pending_rounds.cc:85] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 7
I20260709 12:59:34.301172  1677 pending_rounds.cc:107] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:59:34.301463  1677 raft_consensus.cc:2889] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.266363  1680 consensus_queue.cc:260] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.273187  6211 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.271066  6282 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:34.304860  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.272683  6399 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:34.325711  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.328524  1679 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:34.351898  1676 raft_consensus.cc:1275] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:59:34.407631  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 202585us
I20260709 12:59:34.437812  2423 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:34.306995  1683 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:34.330832  1680 raft_consensus.cc:3060] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:34.408107  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 205958us
I20260709 12:59:34.463799  1683 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:34.463838  1498 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:34.325907  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.468189  1677 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:34.279990  6062 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:34.453668  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.005s (SENT) [suppressed 59 similar messages]
W20260709 12:59:34.470068  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.377147  1681 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:34.401286  1608 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:34.470670  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:34.467222  1497 leader_election.cc:336] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.059s (SENT)
W20260709 12:59:34.472798  1572 leader_election.cc:336] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.078s (SENT)
I20260709 12:59:34.477119  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:34.431951  6198 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:34.478989  6415 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:34.479391  6413 log.cc:927] Time spent T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:59:34.479528  6415 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:34.480063  6415 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:34.480373  6143 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:34.488237  1680 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:34.323052  6172 raft_consensus.cc:697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:34.306450  6312 consensus_queue.cc:1243] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:59:34.373842  6381 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:34.403810  6063 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:34.489336  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.464514  6399 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.489923  6310 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.490547  6310 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.468699  6268 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:34.492777  6310 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:34.493656  6318 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:34.370636  6388 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:34.464751  6211 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:34.499828  6392 consensus_meta.cc:287] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.000s
I20260709 12:59:34.501971  6172 consensus_queue.cc:237] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.510054  6063 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:34.512490  6190 raft_consensus.cc:3055] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:34.512967  6190 raft_consensus.cc:740] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:59:34.516709  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.518247  6343 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:34.519987  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.521252  1674 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
W20260709 12:59:34.434151  6406 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:59:34.521505  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:34.535034  1529 raft_consensus.cc:1275] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:59:34.535530  1529 pending_rounds.cc:85] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 11
I20260709 12:59:34.535796  1529 pending_rounds.cc:107] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:59:34.536180  1529 raft_consensus.cc:2889] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.307912  5798 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:34.544895  1533 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:59:34.549131  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 501966us
W20260709 12:59:34.553934  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 86765.1us
W20260709 12:59:34.554675  1497 leader_election.cc:336] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.081s (SENT)
I20260709 12:59:34.557689  2423 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:34.557452  2339 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:34.558717  1527 raft_consensus.cc:1275] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:59:34.559069  1527 pending_rounds.cc:85] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 9
I20260709 12:59:34.559285  1527 pending_rounds.cc:107] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:59:34.559542  1527 raft_consensus.cc:2889] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.561929  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:34.562011  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:34.563036  1679 raft_consensus.cc:3060] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:34.508424  6415 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.563376  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:34.288956  6367 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.259s
I20260709 12:59:34.560976  1683 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.569583  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.570632  2475 raft_consensus.cc:2368] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:34.509429  6324 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.576462  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:34.575335  1497 leader_election.cc:336] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.104s (SENT)
I20260709 12:59:34.582317  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:34.582962  1678 raft_consensus.cc:3060] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.584199  1531 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:34.566797  6181 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:34.589011  1608 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:34.591400  1683 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.566310  6316 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:59:34.594394  6190 consensus_queue.cc:260] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.599756  6324 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:34.606606  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:34.616525  1607 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.606642  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:34.608363  1531 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:34.608919  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.619109  1679 raft_consensus.cc:2468] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:34.620968  6324 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:34.622378  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:34.623184  1527 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:34.625811  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.626488  1680 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:34.628037  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:34.626531  6316 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.605897  6174 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:59:34.628767  6316 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.630427  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.605654  6314 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:34.632436  6316 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:34.632632  6415 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:34.580052  5798 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:34.633971  1605 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:34.638105  1604 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:34.640005  1683 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:34.605090  6181 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.650033  1607 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
W20260709 12:59:34.642714  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 67436.9us
I20260709 12:59:34.653025  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:34.649758  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.653456  1497 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.111s (SENT)
I20260709 12:59:34.657670  1497 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:34.649847  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.658553  1679 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:34.644516  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:34.606029  6351 consensus_queue.cc:1048] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:59:34.674557  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.675149  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:34.683591  1605 raft_consensus.cc:2368] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12.
I20260709 12:59:34.676450  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:34.676600  1534 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:34.677186  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.685429  1679 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:34.690832  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:34.691062  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.691902  1683 raft_consensus.cc:2376] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
I20260709 12:59:34.694648  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.695739  1680 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:34.698457  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
W20260709 12:59:34.700179  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.700163  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:34.700856  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.700985  1683 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:34.701833  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:34.656955  6181 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:34.700270  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:34.678398  6190 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:34.696950  6415 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:34.710311  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:34.711117  1680 raft_consensus.cc:2376] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13. Re-sending same reply.
I20260709 12:59:34.712249  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.713147  1680 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:34.715092  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.718098  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.737368  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:34.714471  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 131356us
I20260709 12:59:34.674317  6318 consensus_queue.cc:1048] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:59:34.723665  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:34.730947  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 77528us
W20260709 12:59:34.763840  1497 leader_election.cc:336] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.152s (SENT)
I20260709 12:59:34.764317  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:34.706465  6343 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.696883  6344 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:34.767668  6343 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.739841  1680 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
W20260709 12:59:34.756227  6409 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:59:34.738221  2461 raft_consensus.cc:2368] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:34.769779  6415 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:34.770816  1680 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:34.772125  1680 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:59:34.772918  1497 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.153s (SENT)
I20260709 12:59:34.773758  1497 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:34.775228  1497 leader_election.cc:336] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.175s (SENT)
I20260709 12:59:34.776206  6405 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:34.776942  6343 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:34.775761  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:34.772482  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 95355.1us
I20260709 12:59:34.780953  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:34.781636  2423 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:34.786561  6430 consensus_queue.cc:1048] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:34.787530  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:34.788239  2421 raft_consensus.cc:2368] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12.
W20260709 12:59:34.786594  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.786844  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.789145  2475 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:34.789427  2339 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:34.794983  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.799516  2423 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 16.
I20260709 12:59:34.794504  2339 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:34.804350  2339 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:34.806432  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:34.808313  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.809182  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.807796  5798 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:34.810565  5798 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.810937  5798 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:34.813889  6314 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:34.814383  6405 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:34.814476  6314 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.815006  6405 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.815112  6314 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:34.815322  6418 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:59:34.813912  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.817586  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.817925  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.819101  1572 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.661s (SENT)
I20260709 12:59:34.820590  6282 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:34.814005  6313 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:59:34.802291  6381 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:34.825682  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.817088  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.781260  6399 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:34.815413  6405 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.802021  6211 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.853075  6211 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:34.804915  6351 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.884565  6351 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:34.886238  6423 log.cc:927] Time spent T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:59:34.887629  6351 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:34.888156  6424 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.116s	user 0.000s	sys 0.002s
W20260709 12:59:34.890363  6425 log.cc:927] Time spent T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:59:34.855159  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.892382  1675 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
W20260709 12:59:34.892999  6427 log.cc:927] Time spent T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:59:34.856909  1683 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:34.857290  6399 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:34.861914  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 86728.2us
I20260709 12:59:34.805869  6172 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:59:34.896951  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
W20260709 12:59:34.897814  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.897995  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:34.898212  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.898695  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.864571  1498 leader_election.cc:400] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12.
W20260709 12:59:34.899153  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.899379  1498 leader_election.cc:403] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:59:34.899585  2451 raft_consensus.cc:2368] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:34.869827  1680 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:34.900719  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.873056  1682 raft_consensus.cc:2368] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12.
I20260709 12:59:34.876592  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:34.898795  2455 raft_consensus.cc:2368] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:34.878543  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.879223  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.879905  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:34.882428  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.905686  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 74387us
I20260709 12:59:34.905411  2423 raft_consensus.cc:2410] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:59:34.884084  6315 consensus_meta.cc:287] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.004s
I20260709 12:59:34.877408  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.911507  1606 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:34.914603  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:34.922318  1500 leader_election.cc:400] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12.
I20260709 12:59:34.923841  1500 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:34.793417  6426 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:34.933722  1678 raft_consensus.cc:2468] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:34.929260  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:34.936267  2451 raft_consensus.cc:2368] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:34.930642  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:34.938287  1500 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:34.939105  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:34.939330  1498 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:34.939724  1609 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:34.940989  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:34.941816  1608 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.928892  6380 consensus_queue.cc:1059] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:59:34.950259  1679 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:34.954766  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:34.955384  1681 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:34.950920  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:34.910739  6062 raft_consensus.cc:3060] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.956866  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:34.962311  1683 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.962406  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:34.958989  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:34.933997  6426 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.956884  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:34.968531  5798 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:34.968838  6181 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:34.942978  1649 connection.cc:256] RPC call timeout handler was delayed by -4.3934839710000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 12:59:34.963274  1607 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:34.972188  2339 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:34.934827  6040 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:59:34.975492  1649 connection.cc:256] RPC call timeout handler was delayed by -4.3367839709999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 12:59:34.978606  1649 connection.cc:256] RPC call timeout handler was delayed by -4.2944839709999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 12:59:34.978932  1649 connection.cc:256] RPC call timeout handler was delayed by -3.6860839710000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2916s for a response
W20260709 12:59:34.979203  1649 connection.cc:256] RPC call timeout handler was delayed by -3.5573839709999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30590000000000006s for a response
I20260709 12:59:34.944695  6414 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.994151  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:34.974344  1608 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:34.996932  2474 raft_consensus.cc:2368] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:34.943320  6366 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:34.957830  6399 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.977387  6351 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:34.998591  2342 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:35.017270  2342 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:34.937358  6375 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:59:35.005759  2461 raft_consensus.cc:2368] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:34.974280  6426 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:35.019449  1607 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:35.020933  1683 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:34.961917  6367 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:34.988018  6040 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:34.988844  6343 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:34.972710  6318 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:59:34.972398  6344 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:59:34.997936  6324 raft_consensus.cc:2804] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:35.037024  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:34.981313  6211 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:59:35.076756  1677 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:35.030794  6240 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:35.038663  6172 raft_consensus.cc:2804] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:35.038501  6198 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:35.079849  6198 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:35.080744  6198 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.083952  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:35.084808  2451 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:35.041236  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 47203us
I20260709 12:59:35.045841  2339 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:35.016521  6351 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:35.087949  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 191442us
I20260709 12:59:35.066937  5798 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:35.067704  6431 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.303s	user 0.003s	sys 0.000s
I20260709 12:59:35.068323  6040 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:35.090009  1497 leader_election.cc:336] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.395s (SENT)
I20260709 12:59:35.092646  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:35.024562  6399 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:35.013193  6312 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:59:35.096336  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.112061  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 138627us
I20260709 12:59:35.042181  6109 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:59:35.089423  6351 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:35.124606  6343 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:35.092967  6415 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.123310  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:35.093196  6240 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:35.140960  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.149776  1497 connection.cc:256] RPC call timeout handler was delayed by -1.3856078740000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2549s for a response
W20260709 12:59:35.150715  1497 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.530s (SENT)
W20260709 12:59:35.159950  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 221695us
I20260709 12:59:35.183614  1497 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:35.204954  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.208640  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 115694us
I20260709 12:59:35.167578  2428 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:35.134126  6381 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.177028  2455 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:59:35.241245  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 90563us
I20260709 12:59:35.246232  2421 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:59:35.147118  6415 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:35.258096  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.275008  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2182078740000293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2735s for a response
W20260709 12:59:35.279047  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 260514us
W20260709 12:59:35.284616  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.245962  6316 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:35.251080  6029 raft_consensus.cc:3055] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:35.293790  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 248013us
I20260709 12:59:35.297863  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:35.250885  6181 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 12:59:35.299460  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:35.300685  1681 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:35.300922  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:35.301577  1679 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:35.301649  6172 raft_consensus.cc:697] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:35.306310  2428 raft_consensus.cc:1240] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:35.282204  6312 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.297773  6029 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:35.314580  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 56052.8us
I20260709 12:59:35.319968  1679 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
W20260709 12:59:35.327349  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.261675  6381 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.337083  2339 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:35.338519  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:35.341886  1681 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:35.344254  1531 raft_consensus.cc:1275] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:35.312024  6399 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:35.303145  6438 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:35.352854  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:35.361788  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.366190  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.362818  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:35.363194  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.375881  1497 connection.cc:256] RPC call timeout handler was delayed by -1.064091803999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:59:35.376566  1497 connection.cc:256] RPC call timeout handler was delayed by -1.0433918040000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 12:59:35.367990  2455 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:35.284850  6240 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.390542  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:35.315747  6312 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:35.351387  5964 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:35.302604  6172 consensus_queue.cc:237] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:35.380466  6433 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:59:35.402658  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.389454  6314 consensus_meta.cc:287] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.005s
I20260709 12:59:35.397943  6399 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:35.418100  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 81106.8us
W20260709 12:59:35.430462  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.412262  6449 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:35.439284  6440 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:59:35.439935  6435 log.cc:927] Time spent T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 12:59:35.433316  6432 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:59:35.430575  6447 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:35.445763  1649 leader_election.cc:400] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:35.464659  1649 leader_election.cc:403] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:35.434623  6448 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:35.447817  6414 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:35.409055  6314 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.421949  6316 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:35.421707  6441 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:35.459187  6312 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:35.469098  2423 raft_consensus.cc:2368] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:35.471233  6414 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.473670  6399 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:35.474671  6448 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:35.475953  6446 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:59:35.476702  6442 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:35.476559  1649 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:35.477397  6414 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:35.460340  6449 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.490878  6181 consensus_queue.cc:1048] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:35.493028  6449 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:35.496593  6414 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:35.496973  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:35.497879  6458 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:35.498348  6458 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:35.498703  6458 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:35.500018  6314 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:35.501233  6062 consensus_meta.cc:287] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.001s
I20260709 12:59:35.505321  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:35.515873  2428 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
I20260709 12:59:35.519369  1497 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:35.518584  6418 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:59:35.481009  6447 raft_consensus.cc:697] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:35.519069  6062 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12.
I20260709 12:59:35.497430  6426 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.572504  6426 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:35.573844  2475 raft_consensus.cc:2368] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 10.
I20260709 12:59:35.526940  6324 raft_consensus.cc:697] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:35.552758  6415 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:35.578332  6324 consensus_queue.cc:237] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:35.579079  6405 consensus_meta.cc:287] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.735s	user 0.013s	sys 0.000s
I20260709 12:59:35.579736  6405 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.569990  6462 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.583189  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60668 (request call id 2309) took 1061 ms. Trace:
I20260709 12:59:35.582988  6462 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:35.583604  1602 rpcz_store.cc:276] 0709 12:59:34.522077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.522182 (+   105us) service_pool.cc:224] Handling call
0709 12:59:34.522507 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.522754 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:59:34.542595 (+ 19841us) log.cc:844] Serialized 14 byte log entry
0709 12:59:34.909711 (+367116us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b18003341e0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d153823a 00007f25d19a2a2a
0709 12:59:35.582811 (+673100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.582864 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:59:35.582916 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.582989 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.583114 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":497248,"prepare.queue_time_us":19663,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3967,"spinlock_wait_cycles":41977472,"thread_start_us":179930,"threads_started":1,"wal-append.queue_time_us":733210}
W20260709 12:59:35.586457  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 469985us
I20260709 12:59:35.541898  6414 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:35.561813  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 56695.9us
I20260709 12:59:35.592281  1497 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:35.481216  6441 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:35.609679  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.586998  6463 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:59:35.643817  2474 raft_consensus.cc:1240] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:35.635203  6440 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:59:35.660913  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 68732.1us
I20260709 12:59:35.664400  1497 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:35.665693  6415 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:35.673925  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.641597  6109 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:35.567530  6458 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.554824  6316 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.645319  6268 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:59:35.684365  6466 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:35.692000  6462 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:35.702494  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:35.644660  6467 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:59:35.706343  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:35.680079  6447 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.719076  6414 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:35.719534  6458 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:35.690891  6109 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.721385  6180 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:35.722113  6180 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.722467  6180 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:35.723209  6109 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:35.729727  6430 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:35.732733  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.733870  1527 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:59:35.732733  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.756289  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:35.699868  6408 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:35.758810  1530 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:35.760857  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.765734  1527 raft_consensus.cc:1240] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:59:35.729245  6375 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:59:35.768743  1526 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:59:35.782315  1530 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:59:35.760670  6354 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:35.794595  1527 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13. Ops: []
W20260709 12:59:35.788509  6456 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.310s	user 0.003s	sys 0.000s
W20260709 12:59:35.786358  6465 log.cc:927] Time spent T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.216s	user 0.003s	sys 0.000s
I20260709 12:59:35.797004  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:35.801400  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 73102.6us
I20260709 12:59:35.770705  6268 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:35.757613  6430 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:59:35.760565  6313 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:59:35.821976  6380 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.827970  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.848968  1526 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:35.849828  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:35.850478  1530 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.829485  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:35.794824  6354 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:35.795849  6324 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:35.853010  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.851720  6380 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.854730  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:35.854902  6354 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:35.856190  6354 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:35.856442  6380 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:35.866729  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:35.873100  6351 consensus_meta.cc:287] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.000s
I20260709 12:59:35.882426  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:35.874428  6441 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:35.765372  6408 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.829162  6268 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:35.876403  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:35.876533  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.878952  6180 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.884660  1534 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:35.885139  1533 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 12:59:35.888322  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 124013us
I20260709 12:59:35.799571  6405 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:35.890113  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:35.892383  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.893169  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.888631  6367 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:35.887403  6268 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:35.899610  1527 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 14: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:35.900408  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 71004.3us
I20260709 12:59:35.901765  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:35.903388  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:35.903514  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:35.904544  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:35.905525  1525 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:35.907912  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:35.909188  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:35.881925  6324 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.928417  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:35.929239  1607 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:35.939440  1525 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:35.940352  1534 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:35.926759  6380 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:59:35.887912  6351 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:35.945756  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.928508  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.964778  1607 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:35.965224  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.965978  1527 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:35.966836  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:35.967031  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.967377  1527 raft_consensus.cc:606] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:35.967844  1527 raft_consensus.cc:614] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:35.967876  1525 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:35.967638  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.973213  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.973299  1525 raft_consensus.cc:1240] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:35.973755  2451 raft_consensus.cc:2368] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13.
I20260709 12:59:35.977730  1527 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:35.985347  1527 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:35.927490  6264 consensus_queue.cc:1048] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:59:35.988307  1527 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:35.990734  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:35.991257  1527 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:35.993745  1525 raft_consensus.cc:1217] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Deduplicated request from leader. Original: 7.4->[8.5-10.6]   Dedup: 8.5->[10.6-10.6]
I20260709 12:59:35.994415  1525 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:59:35.953805  6429 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:59:35.984411  6417 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:59:36.005930  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.007392  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.033929  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:36.035081  1602 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:36.054361  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.063133  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:36.067126  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:36.072280  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.072430  1647 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:36.073521  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 596988us
I20260709 12:59:36.074676  1649 leader_election.cc:400] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:36.075129  1602 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:36.076951  2342 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:36.079393  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.080214  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.082276  2475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 989) took 1182 ms. Trace:
I20260709 12:59:36.082808  2475 rpcz_store.cc:276] 0709 12:59:34.899958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.900458 (+   500us) service_pool.cc:224] Handling call
0709 12:59:36.081989 (+1181531us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b5400530f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:36.082199 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546185088}
I20260709 12:59:36.090548  1530 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:36.094717  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:36.105835  1525 raft_consensus.cc:2468] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:36.107270  2476 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:36.108564  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:36.109397  1530 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:36.114178  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.114892  1525 raft_consensus.cc:2376] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12. Re-sending same reply.
I20260709 12:59:36.115737  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:36.068040  6350 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.019s	sys 0.014s
I20260709 12:59:36.121384  1530 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9.
I20260709 12:59:36.122718  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.070951  6486 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:36.073664  6399 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:36.125363  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.126364  1601 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:36.073915  6351 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:36.093777  6417 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:36.127411  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.078217  6392 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:36.130921  1530 raft_consensus.cc:2376] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 9. Re-sending same reply.
I20260709 12:59:36.131426  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:36.107365  6312 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:36.119418  6350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.020s	sys 0.014s
I20260709 12:59:36.133495  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:36.136229  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.120620  6402 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:36.120532  6324 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:36.142560  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:36.146358  1525 raft_consensus.cc:3060] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.120069  6405 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:36.119885  6466 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:36.122601  6315 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.129791  6462 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:36.150202  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.140261  1530 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:36.094044  5964 consensus_queue.cc:1059] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:59:36.153781  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.142403  6417 raft_consensus.cc:697] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:36.140463  6392 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:36.150976  6478 log.cc:927] Time spent T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:59:36.135910  6483 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:59:36.151409  6399 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.158268  6350 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.158350  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.159832  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.134495  6486 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:36.177110  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 51053.9us
W20260709 12:59:36.155946  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 74805.4us
W20260709 12:59:36.193315  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.193687  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.148142  6408 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.149444  6402 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:36.183815  1530 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
W20260709 12:59:36.150234  6484 log.cc:927] Time spent T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:59:36.142208  6312 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:36.222240  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.224093  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.222446  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.221668  1525 raft_consensus.cc:2468] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:36.228356  1531 raft_consensus.cc:1275] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:36.155982  6315 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.154251  6405 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.271363  6405 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.230167  1602 raft_consensus.cc:2410] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 12:59:36.272384  6482 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:59:36.163846  6462 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:36.233723  6493 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:59:36.233822  6392 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:36.275664  6462 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:36.234851  6498 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.276314  6498 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:36.236599  6477 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:59:36.237905  6402 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:36.153512  6466 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.238721  6486 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.241415  6312 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:36.243788  6381 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:36.245290  6437 log.cc:927] Time spent T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.935s	user 0.000s	sys 0.003s
W20260709 12:59:36.246044  6491 log.cc:927] Time spent T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:59:36.246768  6494 log.cc:927] Time spent T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:59:36.222128  6415 consensus_meta.cc:287] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.001s
I20260709 12:59:36.241416  6448 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:36.254805  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36908 (request call id 998) took 1076 ms. Trace:
I20260709 12:59:36.257043  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 996) took 1163 ms. Trace:
I20260709 12:59:36.306973  2451 rpcz_store.cc:276] 0709 12:59:35.094091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.094670 (+   579us) service_pool.cc:224] Handling call
0709 12:59:36.256813 (+1162143us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54005d0a54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:36.256973 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926016896}
I20260709 12:59:36.262246  6417 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.223174  5964 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:36.199791  6350 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:36.293869  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 178222us
W20260709 12:59:36.296270  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.310843  1649 leader_election.cc:400] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:36.269407  6268 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.297366  1525 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:36.298892  2344 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:36.311218  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 119388us
I20260709 12:59:36.271370  6315 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.306105  2474 rpcz_store.cc:276] 0709 12:59:35.178188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.178672 (+   484us) service_pool.cc:224] Handling call
0709 12:59:35.178969 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.648204 (+469235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.254335 (+606131us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54005f6254. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:36.254714 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068496256}
I20260709 12:59:36.311254  1649 leader_election.cc:403] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:36.315012  6448 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.318813  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.320564  6350 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.322127  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.304898  6381 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:36.307952  6415 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:36.324294  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.325937  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.310050  5964 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:36.332043  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.334275  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.334594  1533 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:36.320868  6029 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:36.336288  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.336407  2344 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:36.336845  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.318066  6312 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:36.330906  6405 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:36.356890  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.352989  1649 leader_election.cc:400] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:36.344209  6392 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:36.362748  2476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1127) took 1445 ms. Trace:
I20260709 12:59:36.363284  2476 rpcz_store.cc:276] 0709 12:59:34.917532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.941443 (+ 23911us) service_pool.cc:224] Handling call
0709 12:59:36.093996 (+1152553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.113857 (+ 19861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.362465 (+248608us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400530f50. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d19978ad 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:36.362667 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626308480}
I20260709 12:59:36.355010  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.370864  1649 leader_election.cc:400] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:36.372000  1649 leader_election.cc:403] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:59:36.373283  1526 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:36.350924  2344 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:36.356454  1601 raft_consensus.cc:1240] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:36.351262  6324 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:36.375671  6467 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:36.375897  6466 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.376086  6467 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:36.359916  6481 log.cc:927] Time spent T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.532s	user 0.004s	sys 0.000s
I20260709 12:59:36.376550  6466 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.346566  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:36.377426  1533 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.332933  6447 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:59:36.376513  6467 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.347232  6399 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:36.382220  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2275) took 1058 ms. Trace:
I20260709 12:59:36.382737  1534 raft_consensus.cc:1240] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:36.382622  1528 rpcz_store.cc:276] 0709 12:59:35.324094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.324250 (+   156us) service_pool.cc:224] Handling call
0709 12:59:35.337411 (+ 13161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.432926 (+ 95515us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:35.553445 (+120519us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.771715 (+218270us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.796596 (+ 24881us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.796742 (+   146us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:35.796777 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.796843 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.382008 (+585165us) raft_consensus.cc:1685] finished
0709 12:59:36.382026 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.382164 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5323,"prepare.queue_time_us":251677,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":81991,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":16864,"thread_start_us":295862,"threads_started":3,"wal-append.queue_time_us":354878}
I20260709 12:59:36.384413  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:36.384964  1534 raft_consensus.cc:606] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.385301  1534 raft_consensus.cc:614] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:36.385437  1533 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:36.387461  1649 leader_election.cc:400] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:36.387817  1649 leader_election.cc:403] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:59:36.388067  6180 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.388406  6312 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:36.388536  6498 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:36.344439  6504 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:36.389322  6399 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:36.390425  1649 leader_election.cc:400] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:36.390760  1649 leader_election.cc:403] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:59:36.391561  1534 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:36.394752  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2278) took 1069 ms. Trace:
I20260709 12:59:36.394812  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 1104) took 1475 ms. Trace:
I20260709 12:59:36.395768  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.395362  1678 rpcz_store.cc:276] 0709 12:59:34.919516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.942840 (+ 23324us) service_pool.cc:224] Handling call
0709 12:59:34.943189 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.971969 (+ 28780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.971999 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.987728 (+ 15729us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.294925 (+307197us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:35.294984 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.295080 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.393901 (+1098821us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b24001cc8c8. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7319c4 00007f25ce72facb 00007f25ce8eadc9 00007f25ce8eaa55 00007f25ce8e9fb0 00007f25d1560488 00007f25d1560be8 00007f25d1538398 00007f25d153376a 00007f25d1532bb6
0709 12:59:36.394503 (+   602us) raft_consensus.cc:1685] finished
0709 12:59:36.394522 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.394736 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32434,"raft.queue_time_us":33462,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3650,"spinlock_wait_cycles":65813888,"thread_start_us":209101,"threads_started":1,"wal-append.queue_time_us":342279}
I20260709 12:59:36.397099  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.395994  6399 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 9.
I20260709 12:59:36.398974  2339 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:36.399880  1572 leader_election.cc:336] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.564s (SENT)
I20260709 12:59:36.399755  6399 consensus_queue.cc:1059] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:36.393908  6467 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.400691  6399 raft_consensus.cc:3055] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:59:36.400812  1572 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.743s (SENT)
I20260709 12:59:36.401087  6399 raft_consensus.cc:740] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:36.402179  6467 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:36.402132  6399 consensus_queue.cc:260] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.403492  6399 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:36.404111  1531 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 13. Current term is 14. Ops: []
W20260709 12:59:36.405835  1572 leader_election.cc:336] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 1.810s (SENT)
W20260709 12:59:36.406665  1572 leader_election.cc:336] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.215s (SENT)
I20260709 12:59:36.330176  6462 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:36.424330  1608 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:36.407437  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.423749  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.434057  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.395289  1529 rpcz_store.cc:276] 0709 12:59:35.325141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.325798 (+   657us) service_pool.cc:224] Handling call
0709 12:59:35.326161 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.422156 (+ 95995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.422194 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.943071 (+520877us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b2c00000658. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d0291a11 00007f25d02a1372 00007f25d19d3a01 00007f25d199843a 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2
0709 12:59:35.943496 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.074087 (+130591us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:36.074124 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.394470 (+320346us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54003192d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:36.394515 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.394557 (+    42us) raft_consensus.cc:1685] finished
0709 12:59:36.394569 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.394698 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12194,"raft.queue_time_us":36893,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":196502144,"thread_start_us":124216,"threads_started":1,"wal-append.queue_time_us":209794}
I20260709 12:59:36.439965  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:36.410054  1497 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.029s (SENT)
I20260709 12:59:36.441498  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.444120  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.377117  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.447367  1677 raft_consensus.cc:1275] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:36.449400  1500 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.452484  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.377096  6466 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:36.454903  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.458876  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:36.459635  1680 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:36.331182  6381 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:36.387398  6268 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.464896  1649 leader_election.cc:400] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:36.468014  1649 leader_election.cc:403] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:59:36.433516  6429 raft_consensus.cc:2804] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:36.450129  6504 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:36.485958  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:36.500267  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.501806  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:36.502482  1674 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:36.503301  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:36.503752  1674 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:36.504328  1680 raft_consensus.cc:2468] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:36.505146  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.505851  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.506245  1679 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:59:36.501448  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.506464  1681 raft_consensus.cc:2468] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:36.506631  1679 pending_rounds.cc:85] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 6
I20260709 12:59:36.507211  1683 raft_consensus.cc:2393] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:36.507213  1679 pending_rounds.cc:107] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:59:36.508002  1679 raft_consensus.cc:2889] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:36.496160  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:36.509610  1676 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:36.511648  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 179495us
I20260709 12:59:36.518507  1680 raft_consensus.cc:2410] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:36.528827  1674 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:36.530328  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:36.530838  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.531148  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.532116  1674 raft_consensus.cc:2410] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:59:36.421851  6405 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:36.539541  1677 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:36.540678  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:36.540928  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:36.541100  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.506944  6268 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:36.507308  6392 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:36.438239  6462 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.542380  1680 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:36.505791  6198 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 11. Current term is 12.
I20260709 12:59:36.548934  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:36.551046  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 143632us
I20260709 12:59:36.553339  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.556118  1683 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:36.556334  1681 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:36.512718  6417 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:36.555658  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:36.510769  6429 raft_consensus.cc:697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:36.558071  1572 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.608s (SENT)
I20260709 12:59:36.561702  1572 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:36.557585  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.575388  1680 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:36.562363  1674 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:36.539332  6343 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:36.482743  6498 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 12:59:36.583225  1572 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 3.053s (SENT)
I20260709 12:59:36.482631  6505 consensus_queue.cc:1059] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:59:36.587278  1572 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:36.561614  6268 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.555648  6344 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:36.593837  6344 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:36.594429  6344 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:36.465834  5964 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.602406  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.604552  1676 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 10.
I20260709 12:59:36.605453  1682 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:36.607860  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.611949  6268 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.613054  6466 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:36.555269  6467 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:59:36.649266  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 196655us
W20260709 12:59:36.674014  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 71560.9us
I20260709 12:59:36.676460  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.677172  1677 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:36.597604  6264 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.563150  6486 consensus_queue.cc:1059] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:59:36.559546  6392 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.686429  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:36.689021  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.692478  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 315544us
W20260709 12:59:36.694209  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.696205  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 113009us
I20260709 12:59:36.699112  2344 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:36.691794  6211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.011s	sys 0.020s
I20260709 12:59:36.719242  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.720211  1680 raft_consensus.cc:2368] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9.
I20260709 12:59:36.722697  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.723708  1677 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:36.727101  1606 raft_consensus.cc:1275] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:59:36.730217  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.731032  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.712096  6211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.011s	sys 0.020s
W20260709 12:59:36.779976  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 61664.4us
W20260709 12:59:36.780335  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 324652us
I20260709 12:59:36.704946  6264 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:36.708675  6316 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.785523  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.788471  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:36.799651  6172 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:36.800225  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.802237  6211 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:36.802955  6211 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.797133  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:36.806075  6316 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:36.806833  6316 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:36.694715  6429 consensus_queue.cc:237] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.717708  6417 consensus_queue.cc:1048] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:59:36.816793  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.817746  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.822080  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.822938  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:36.823194  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.828367  1677 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:36.828999  2474 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.837916  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.803516  6405 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:36.839416  6462 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.839556  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:36.840178  2451 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:36.794312  6516 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 12:59:36.846249  6512 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:59:36.851410  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.853202  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:36.831871  6211 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:36.862779  6198 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.863538  6198 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:36.866351  6198 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:36.872779  6392 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:36.807973  6316 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.891265  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.894739  2428 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:36.894907  2451 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 16.
I20260709 12:59:36.898729  2428 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:59:36.903451  2474 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
W20260709 12:59:36.901345  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 46509.6us
I20260709 12:59:36.908926  1575 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:36.911304  1575 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:36.918329  1649 connection.cc:256] RPC call timeout handler was delayed by -1.0665828200000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:59:36.918752  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34852
I20260709 12:59:36.919456  1529 raft_consensus.cc:606] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Received request to transfer leadership
I20260709 12:59:36.919941  1529 raft_consensus.cc:614] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:36.918787  1649 connection.cc:256] RPC call timeout handler was delayed by -1.0521828200000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:59:36.923856  1649 connection.cc:256] RPC call timeout handler was delayed by -1.0197828200000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 12:59:36.924348  1649 connection.cc:256] RPC call timeout handler was delayed by -1.0089828200000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 12:59:36.925325  1649 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.926970  6198 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.927562  6198 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:36.928862  6350 raft_consensus.cc:2804] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:36.929474  6350 raft_consensus.cc:697] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:36.930529  6198 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:36.930540  6350 consensus_queue.cc:237] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.933197  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.936412  1608 raft_consensus.cc:1240] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:36.938912  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:36.942056  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:36.944518  6344 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:36.954777  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:36.968369  1500 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.970363  1500 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.975008  1500 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.977193  1607 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:36.950526  6380 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:36.956916  6316 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:36.956071  6505 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:36.986240  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 61054.6us
I20260709 12:59:36.958886  6392 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:36.995608  1676 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:59:36.997133  1497 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.018s	sys 0.009s
W20260709 12:59:36.998387  1497 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.018s	sys 0.009s
W20260709 12:59:36.998914  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 555918us
I20260709 12:59:36.999418  1649 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.981925  6414 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.983739  6501 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:37.036732  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.988782  6415 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:36.982323  6521 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:37.045264  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:37.041208  6417 consensus_queue.cc:1048] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:37.048686  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.041669  2339 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:36.998660  6380 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:37.046705  6512 log.cc:927] Time spent T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:59:37.084980  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:37.132299  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.048161  6392 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:59:37.147013  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 68941.2us
I20260709 12:59:37.060882  2344 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:36.984169  6504 consensus_queue.cc:1059] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:59:37.003173  6505 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.055673  6310 raft_consensus.cc:2804] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:37.156741  6482 log.cc:927] Time spent T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:59:37.155581  6504 consensus_queue.cc:1243] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer fc6fbca2eb8d4bec997c51003e277180 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:59:37.182134  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7c3ea752cffa4a138dd2984b56316ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3cabc5110903443ba3beb5cbb14afa91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:59:37.189693  1416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 215478us
W20260709 12:59:37.194260  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.193888  2339 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:37.213188  6344 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:37.215622  6324 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:37.216415  6324 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:37.217423  6324 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.222334  2339 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.223826  6527 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:37.224381  6527 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:37.224856  6527 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.243690  6505 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:37.244658  6523 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:37.180651  6310 raft_consensus.cc:697] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:37.246145  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 185355us
I20260709 12:59:37.247334  6310 consensus_queue.cc:237] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.256441  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:37.264119  1681 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:59:37.252343  6402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.046s	sys 0.042s
I20260709 12:59:37.211660  6180 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:37.199604  6448 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:59:37.212713  6447 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 12:59:37.286470  6402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.047s	sys 0.042s
W20260709 12:59:37.320168  1572 leader_election.cc:336] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 2.005s (SENT)
W20260709 12:59:37.318543  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.014s
I20260709 12:59:37.318543  6541 consensus_queue.cc:1048] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:59:37.254738  6380 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.332087  6367 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:37.334218  6350 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:37.297338  6180 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.336491  6536 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:37.336942  6180 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:37.338773  6536 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:37.340157  6029 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.288266  6527 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:37.328588  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.011s	sys 0.014s
I20260709 12:59:37.350313  6527 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:37.356832  2474 raft_consensus.cc:1240] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:59:37.355451  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 207889us
I20260709 12:59:37.357968  1575 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:37.365253  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 371683us
I20260709 12:59:37.366175  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:37.369699  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:37.370498  1681 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.377482  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:37.324841  6313 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:59:37.382432  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:37.383165  1526 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:37.384531  1497 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.386722  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:37.387255  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:37.388871  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:37.393059  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.399006  1526 raft_consensus.cc:2468] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:37.367522  6315 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.373920  6312 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.406373  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.377681  6525 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:37.390844  6501 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:37.443836  1681 raft_consensus.cc:2468] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:37.448323  1649 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.401000  6439 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:37.437098  6315 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.390065  6462 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:59:37.452639  6315 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.437867  6533 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:37.454115  6533 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:37.454591  6533 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:37.455569  6315 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:37.457664  6544 log.cc:927] Time spent T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:59:37.409986  6312 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:37.478024  6312 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.487460  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2294) took 1165 ms. Trace:
W20260709 12:59:37.501166  6316 consensus_meta.cc:287] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.000s
I20260709 12:59:37.505390  6504 consensus_queue.cc:1059] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:37.507174  1674 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:37.438117  6367 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:37.512199  6439 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:37.512390  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2284) took 1192 ms. Trace:
W20260709 12:59:37.539386  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.453290  6550 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:37.538570  1534 rpcz_store.cc:276] 0709 12:59:36.319716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.392315 (+ 72599us) service_pool.cc:224] Handling call
0709 12:59:36.392588 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.512407 (+119819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.512451 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.512502 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.512552 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.512045 (+999493us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003f61d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:37.512123 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.512313 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275028224}
I20260709 12:59:37.488066  1525 rpcz_store.cc:276] 0709 12:59:36.322133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.536308 (+214175us) service_pool.cc:224] Handling call
0709 12:59:36.553180 (+ 16872us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:36.901858 (+348678us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:36.961787 (+ 59929us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.359386 (+397599us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:37.360122 (+   736us) log.cc:844] Serialized 52 byte log entry
0709 12:59:37.360300 (+   178us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:37.361712 (+  1412us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.361909 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.361974 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.487150 (+125176us) raft_consensus.cc:1685] finished
0709 12:59:37.487178 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.487377 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65370,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":96,"raft.queue_time_us":132777,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":20082,"spinlock_wait_cycles":14753920,"thread_start_us":692108,"threads_started":2,"wal-append.queue_time_us":416431}
I20260709 12:59:37.547282  1649 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:37.552809  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 146511us
I20260709 12:59:37.553925  1497 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:37.537009  6441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.022s	sys 0.025s
W20260709 12:59:37.557693  6441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.023s	sys 0.026s
I20260709 12:59:37.551501  6439 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:37.556653  6521 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:37.555156  6504 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.451992  6525 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:37.556038  6367 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.575469  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.557627  6458 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:37.590992  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.570535  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.585297  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:37.585986  1604 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:37.587774  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.590205  2428 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:37.600011  1497 leader_election.cc:400] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9.
I20260709 12:59:37.600592  1497 leader_election.cc:403] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:37.578838  6521 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:37.593322  6550 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:37.609398  1601 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:37.606782  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:37.611753  6550 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:37.612004  6414 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:59:37.616619  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:37.601336  6504 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:37.617901  6569 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 8. Current term is 9.
I20260709 12:59:37.622283  6504 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:37.623803  6458 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.624800  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:37.610965  6521 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.626828  6399 raft_consensus.cc:3055] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:37.623639  6533 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:37.640480  6533 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:37.641091  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:37.644544  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:37.649996  6525 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:37.658403  1575 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:37.637755  6399 raft_consensus.cc:740] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:37.651158  6441 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:37.661414  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.645362  5964 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.677963  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:37.684756  1533 raft_consensus.cc:1240] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 12:59:37.686998  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 87189.9us
I20260709 12:59:37.689312  1497 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.659142  6504 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:37.655676  6367 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:37.665112  6313 raft_consensus.cc:2804] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:37.664685  6402 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:37.694247  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:37.696363  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:37.703680  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.663631  6447 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:59:37.691007  6552 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.693552  6536 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:37.717096  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:37.717058  6501 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.719494  6312 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.721903  1680 raft_consensus.cc:1240] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.723475  6552 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:37.726045  6563 log.cc:927] Time spent T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 12:59:37.692415  6504 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:37.730163  6504 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:37.695135  6553 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:37.735648  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 69435.1us
W20260709 12:59:37.752918  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.706539  6533 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:59:37.756203  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 46501.7us
I20260709 12:59:37.759354  6501 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:37.761755  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 45157.4us
I20260709 12:59:37.765300  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:37.756592  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 127186us
I20260709 12:59:37.761966  1649 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:37.768033  1572 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Timed out: RequestConsensusVote RPC to 127.0.107.195:35399 timed out after 3.034s (SENT)
I20260709 12:59:37.770330  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:37.770924  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:37.771935  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:37.772188  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:37.773468  6312 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:37.774430  1529 raft_consensus.cc:1240] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:37.775094  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:37.775857  1528 raft_consensus.cc:1240] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:59:37.775799  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:37.776940  1527 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.761699  6408 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.779352  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:37.783046  1529 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:37.763475  6533 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:37.767383  6525 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:37.790453  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:37.790814  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:37.765093  6439 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:37.796866  6392 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:37.796576  6312 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:37.789824  6408 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:37.768641  6313 raft_consensus.cc:697] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:37.801594  6313 consensus_queue.cc:237] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.804308  6455 raft_consensus.cc:3055] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:37.770984  6458 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:37.761950  6402 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:59:37.784241  1525 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:37.731182  6399 consensus_queue.cc:260] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:37.804744  6455 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:37.823509  6439 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:37.806354  6533 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:37.815207  6458 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:37.824973  6572 log.cc:927] Time spent T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:59:37.825894  1534 raft_consensus.cc:1275] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:59:37.826308  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:37.830987  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.824240  6399 raft_consensus.cc:3060] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.838963  1525 raft_consensus.cc:1275] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:37.839723  1527 raft_consensus.cc:2468] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
W20260709 12:59:37.841208  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.846760  2451 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:37.756356  6553 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.853706  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.857832  1527 raft_consensus.cc:3060] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.870115  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:37.872682  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 110614us
I20260709 12:59:37.871053  1534 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:37.874306  1649 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.874506  2344 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:37.879856  1527 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:37.883813  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.841059  6566 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:37.819868  6354 consensus_queue.cc:1059] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:59:37.847589  6458 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:37.913272  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 887) took 1202 ms. Trace:
I20260709 12:59:37.913715  1607 rpcz_store.cc:276] 0709 12:59:36.711350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.711526 (+   176us) service_pool.cc:224] Handling call
0709 12:59:36.711894 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.977643 (+265749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.913066 (+935423us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001d0954. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:37.913219 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609671040}
I20260709 12:59:37.885691  6316 consensus_queue.cc:1059] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:59:37.915911  6316 raft_consensus.cc:3055] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:37.916311  6316 raft_consensus.cc:740] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:37.916566  6566 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.886181  6467 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:59:37.918805  6566 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:37.890287  6581 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:37.886904  1527 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:37.891145  1534 raft_consensus.cc:1240] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:37.886181  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.892550  6537 raft_consensus.cc:2804] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:37.894563  6553 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:37.900934  6520 log.cc:927] Time spent T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.897s	user 0.000s	sys 0.003s
I20260709 12:59:37.905148  6504 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.886044  6527 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:37.910128  6318 raft_consensus.cc:3055] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:37.909684  6455 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.924079  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.934849  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:37.935382  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.923427  6439 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.885289  6447 consensus_queue.cc:1048] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:59:37.902017  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2285) took 1582 ms. Trace:
I20260709 12:59:37.905166  6350 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:37.922286  6198 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:37.936228  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:37.936543  1649 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:37.930922  6581 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:37.924692  1682 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:37.917147  6316 consensus_queue.cc:260] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.944919  6439 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.884836  6441 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:59:37.949949  6392 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:37.951538  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:37.952132  1681 raft_consensus.cc:2376] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11. Re-sending same reply.
I20260709 12:59:37.932739  6367 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.940174  1531 rpcz_store.cc:276] 0709 12:59:36.319949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.404918 (+ 84969us) service_pool.cc:224] Handling call
0709 12:59:36.405232 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.865012 (+459780us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b180041bc60. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25d15404bc 00007f25ce88e48b 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8a8455 00007f25d1990060 00007f25d1990bfb 00007f25d199b64b
0709 12:59:36.865164 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.865194 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:37.510343 (+645149us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b2c00000658. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d0291a11 00007f25d02a1372 00007f25d19d3a01 00007f25d199843a 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2
0709 12:59:37.510998 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 12:59:37.655189 (+144191us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:37.655225 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.901697 (+246472us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b54000c62d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:37.901741 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.901787 (+    46us) raft_consensus.cc:1685] finished
0709 12:59:37.901801 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.901962 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4583,"raft.queue_time_us":154002,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":8014,"spinlock_wait_cycles":246973696,"thread_start_us":333880,"threads_started":2,"wal-append.queue_time_us":145949}
I20260709 12:59:37.943598  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:37.925303  1680 raft_consensus.cc:1275] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:37.956966  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:37.957450  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:37.958261  1675 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:37.958141  1676 raft_consensus.cc:2376] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10. Re-sending same reply.
I20260709 12:59:37.926733  6211 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:59:37.958276  1679 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:37.961519  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:37.965890  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:37.934002  6318 raft_consensus.cc:740] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:37.968019  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:37.968614  1677 raft_consensus.cc:3060] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.939335  6402 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:37.975488  1649 leader_election.cc:400] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 10.
I20260709 12:59:37.988018  1649 leader_election.cc:403] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:37.965850  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:37.932636  6324 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:59:37.990801  1649 leader_election.cc:400] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13.
I20260709 12:59:37.992967  1649 leader_election.cc:403] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:59:37.993850  1676 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:59:37.949965  6316 raft_consensus.cc:3060] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:37.942963  6498 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:37.989653  1677 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:38.006467  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.007019  1677 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 16.
I20260709 12:59:38.007651  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.008097  1677 raft_consensus.cc:2376] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11. Re-sending same reply.
I20260709 12:59:38.008765  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:37.944372  6455 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:38.009866  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.010692  6439 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.010962  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.012018  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.012516  1683 raft_consensus.cc:2376] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11. Re-sending same reply.
I20260709 12:59:37.957345  6381 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:37.958581  6392 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.990603  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.017903  6392 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.018643  6504 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.020723  6392 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.017870  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.013370  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.022852  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.023581  1677 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:37.991601  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:37.970139  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:37.999522  6198 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 8. Current term is 10.
I20260709 12:59:37.999768  6318 consensus_queue.cc:260] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.000303  6582 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13.
I20260709 12:59:38.003443  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:38.030695  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:37.944814  6312 consensus_queue.cc:1059] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:59:37.962420  6343 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:37.947854  6527 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:59:38.041460  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.042104  1607 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:38.042462  1531 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:37.943481  6521 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.045903  6343 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.050999  6312 consensus_queue.cc:1243] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:59:38.051580  6312 raft_consensus.cc:3055] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:38.051905  6312 raft_consensus.cc:740] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:38.052709  6312 consensus_queue.cc:260] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:37.953343  6350 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.035918  6537 raft_consensus.cc:697] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:38.039856  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 117168us
I20260709 12:59:37.969380  6367 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.060726  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:38.063841  1534 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:59:38.064441  1534 pending_rounds.cc:85] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 8
I20260709 12:59:38.064791  1534 pending_rounds.cc:107] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:59:38.065148  1534 raft_consensus.cc:2889] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:38.025393  6458 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.067430  1680 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 16.
I20260709 12:59:38.075251  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.077122  6537 consensus_queue.cc:237] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.080964  6367 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.082134  6550 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:38.084265  6350 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.089035  2339 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:38.090870  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 101857us
I20260709 12:59:38.093029  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:38.094616  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:38.097409  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:38.099854  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:38.099918  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:38.103451  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 978) took 2121 ms. Trace:
I20260709 12:59:38.073668  6312 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:38.104082  1532 rpcz_store.cc:276] 0709 12:59:35.981952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.274817 (+292865us) service_pool.cc:224] Handling call
0709 12:59:36.402502 (+127685us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5800010e98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873a22 00007f25d778cc09 00007f25d68e6ee0 00007f25d69b00ab 00007f25d69b0131 00007f25d6971fc0 00007f25d695c929 00007f25d695c3d2 00007f25cfed3bd4
0709 12:59:36.402720 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.587232 (+184512us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:59:36.809327 (+222095us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.409154 (+599827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.409295 (+   141us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:37.409486 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.103123 (+693637us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54003adc54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:38.103198 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.103371 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5540,"prepare.queue_time_us":245980,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":27778,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":13666,"spinlock_wait_cycles":473657472,"thread_start_us":676449,"threads_started":2,"wal-append.queue_time_us":589285}
I20260709 12:59:38.130883  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:38.123243  6439 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:38.136361  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47526.4us
I20260709 12:59:38.137125  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:38.132676  6198 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.142326  6527 consensus_queue.cc:1048] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:59:38.129304  6533 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.152683  1526 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:38.153970  6198 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.154906  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.156134  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.156863  1683 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 13: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:38.157008  6198 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.159632  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:38.159730  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 193962us
I20260709 12:59:38.160321  1683 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:38.161147  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.140260  6211 raft_consensus.cc:2804] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:38.135751  5964 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.162082  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.162370  5964 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.163239  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.164031  1572 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:38.164366  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.164773  5964 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.165437  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.165534  6264 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:38.166210  1683 raft_consensus.cc:2368] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11.
I20260709 12:59:38.166970  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.167223  6553 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:38.162653  6588 consensus_queue.cc:1059] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:38.173923  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:38.190999  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:38.192029  2435 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:38.193769  1681 raft_consensus.cc:1275] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:38.115741  6582 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:59:38.204137  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:38.207279  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:38.207518  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:38.208974  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:38.162082  6354 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:38.227108  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 1117) took 1727 ms. Trace:
I20260709 12:59:38.227702  1679 rpcz_store.cc:276] 0709 12:59:36.499576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.550206 (+ 50630us) service_pool.cc:224] Handling call
0709 12:59:36.550510 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.967068 (+1416558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.226774 (+259706us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003200d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:38.227023 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3236837760}
I20260709 12:59:38.231741  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.233888  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:38.233914  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64576.6us
W20260709 12:59:38.233865  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 44773.3us
I20260709 12:59:38.240918  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:38.242581  1532 raft_consensus.cc:2410] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:38.243997  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.244692  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:38.193367  6553 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.229377  6211 raft_consensus.cc:697] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:38.266383  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:38.284538  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 49384.9us
I20260709 12:59:38.288187  6198 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:38.288872  6198 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.294031  6458 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.295125  1575 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:38.254637  6582 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.298751  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:38.251551  6594 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:38.308609  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:38.320672  6592 consensus_queue.cc:1048] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:59:38.259326  6268 consensus_queue.cc:1059] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:59:38.305507  6447 consensus_queue.cc:1059] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:59:38.328994  6310 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:38.330066  6029 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:38.330756  6408 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.331054  1572 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:38.306075  6523 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 12:59:38.323314  6597 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:59:38.357352  1572 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:38.344882  6595 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:59:38.339789  6264 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:38.372113  2474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1143) took 1111 ms. Trace:
I20260709 12:59:38.373010  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:38.373376  2474 rpcz_store.cc:276] 0709 12:59:37.260535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.262582 (+  2047us) service_pool.cc:224] Handling call
0709 12:59:37.262895 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:37.357297 (+ 94402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.371801 (+1014504us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b5400530f54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:38.372040 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215359232}
I20260709 12:59:38.346239  6310 consensus_queue.cc:1243] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer 3cabc5110903443ba3beb5cbb14afa91 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:38.345788  6029 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:38.384742  6599 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:59:38.351696  6590 consensus_queue.cc:1059] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:59:38.386845  6264 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:38.397099  6264 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:38.397724  6264 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:38.380484  6367 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:38.351225  6315 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:59:38.383405  6029 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:38.405690  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 1121) took 1859 ms. Trace:
I20260709 12:59:38.406121  1678 rpcz_store.cc:276] 0709 12:59:36.546678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.546919 (+   241us) service_pool.cc:224] Handling call
0709 12:59:36.559983 (+ 13064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.701964 (+141981us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:59:37.039776 (+337812us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.294237 (+254461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.294284 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:59:37.294330 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.405429 (+1111099us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001b9754. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:38.405476 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.405632 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":340441,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":3192,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4913,"spinlock_wait_cycles":326006144,"thread_start_us":579444,"threads_started":2,"wal-append.queue_time_us":338701}
I20260709 12:59:38.407835  6590 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:38.408253  6590 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:38.409057  6590 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.410344  6590 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:38.370872  6350 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:38.414191  1649 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:38.415810  1649 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:38.426748  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:38.437438  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:38.429708  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:38.440534  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:38.456707  1497 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:38.420747  6392 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:38.454425  6599 log.cc:927] Time spent T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:59:38.429055  6429 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:38.450119  6582 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:38.453339  6581 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:38.480302  6553 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:38.482851  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 196848us
I20260709 12:59:38.378075  6211 consensus_queue.cc:237] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.454156  6505 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:38.497251  1497 leader_election.cc:400] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11.
I20260709 12:59:38.452942  6198 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.459836  6439 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:38.491815  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.479322  6458 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:38.506246  1497 leader_election.cc:403] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:59:38.488333  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 192352us
I20260709 12:59:38.486168  6466 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:38.498822  6414 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:38.514393  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.519042  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:38.520128  6414 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.522428  6414 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.524150  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.525262  1676 raft_consensus.cc:2410] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:38.526211  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.526834  1676 raft_consensus.cc:2376] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11. Re-sending same reply.
I20260709 12:59:38.527796  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.528517  1676 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 7.
I20260709 12:59:38.529489  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:38.530442  1572 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:38.532694  1676 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:59:38.533222  1676 pending_rounds.cc:85] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 12
I20260709 12:59:38.533514  1676 pending_rounds.cc:107] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:59:38.533847  1676 raft_consensus.cc:2889] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:38.505272  6505 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:38.535082  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:38.536191  1572 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:38.536913  2435 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:59:38.541169  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.498952  6429 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.518637  6455 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 10. Current term is 11.
W20260709 12:59:38.547514  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 216260us
W20260709 12:59:38.555002  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 137931us
I20260709 12:59:38.556912  1676 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:38.544034  6505 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:38.543570  6408 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:38.512861  6458 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.515103  6316 raft_consensus.cc:3055] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:38.544849  6582 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.550570  6439 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:38.562000  6602 log.cc:927] Time spent T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 12:59:38.587152  6601 log.cc:927] Time spent T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.291s	user 0.003s	sys 0.000s
I20260709 12:59:38.550217  6581 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:38.553488  6462 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:38.577517  6313 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:38.579192  6604 log.cc:927] Time spent T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:59:38.570655  6605 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:59:38.572708  6316 raft_consensus.cc:740] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:38.585237  6582 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.587697  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:38.553941  6466 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:38.553362  6198 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:38.550392  6399 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:59:38.597963  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.574023  6566 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:38.584760  6611 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.642877  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 94100.6us
I20260709 12:59:38.594890  6594 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:38.655099  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.645279  6439 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.662693  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.663007  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:38.731114  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 175148us
W20260709 12:59:38.734400  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 68387us
I20260709 12:59:38.639926  6581 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:38.737914  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 74952.5us
I20260709 12:59:38.662801  6566 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.644609  6462 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.707751  6399 consensus_queue.cc:1243] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:59:38.660678  6381 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 12:59:38.660521  6537 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:59:38.660157  6466 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.774941  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:38.751564  6566 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.663796  6198 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.755286  6429 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:38.706480  6611 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.733096  6439 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.802943  6439 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:38.806216  6623 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:59:38.818244  6635 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:38.819235  6402 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:38.818892  6635 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.827114  6635 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.827670  6635 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:38.829226  6581 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.799057  6408 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:38.833597  6582 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.772457  6316 consensus_queue.cc:260] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.863140  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:38.865976  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 129813us
I20260709 12:59:38.881706  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:38.886351  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:38.887441  1679 raft_consensus.cc:2393] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 7: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:38.838099  6408 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:38.890456  6029 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.891850  6343 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.892781  6029 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.864794  6264 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.890868  6466 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.898164  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.901377  6264 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.866024  6458 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.901432  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.862766  6635 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.891850  6462 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.926753  1647 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:38.936511  1647 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:38.892814  6198 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.902478  6466 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:38.918401  6632 log.cc:927] Time spent T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:59:38.918853  6533 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.924446  6635 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:38.925154  6582 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:38.925809  6633 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:38.895758  6408 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:38.928787  1608 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:38.956167  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2428) took 1002 ms. Trace:
I20260709 12:59:38.945827  6637 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:38.942224  6402 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:38.950966  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:38.956653  1681 rpcz_store.cc:276] 0709 12:59:37.953451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.953643 (+   192us) service_pool.cc:224] Handling call
0709 12:59:37.958838 (+  5195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.194288 (+235450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.955865 (+761577us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54002800d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:38.956097 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520278272}
I20260709 12:59:38.969991  6029 consensus_queue.cc:1048] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:38.973369  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.974156  6566 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.974694  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:38.953291  6466 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:38.976316  6566 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.976742  6466 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.970217  6619 consensus_queue.cc:1059] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:59:38.969298  6611 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:38.987088  1681 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:38.963989  6633 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:38.990935  6633 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:38.992992  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.963792  6582 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.009374  6552 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:39.019722  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.020759  2435 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:59:39.021822  2476 raft_consensus.cc:2410] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:59:39.023293  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1148) took 1105 ms. Trace:
I20260709 12:59:39.024474  2451 rpcz_store.cc:276] 0709 12:59:37.918153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.920772 (+  2619us) service_pool.cc:224] Handling call
0709 12:59:37.921057 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.938945 (+ 17888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.938992 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.939048 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:37.939095 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.023031 (+1083936us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b54004cd454. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:39.023081 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.023228 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40590720}
I20260709 12:59:39.033758  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.037618  2474 raft_consensus.cc:1275] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:39.043901  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:39.044735  1680 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.045825  2435 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:39.047839  1681 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
I20260709 12:59:39.049013  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:39.043659  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.051687  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:39.057439  1681 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:39.058784  6408 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.062124  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:39.064782  1681 raft_consensus.cc:2376] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14. Re-sending same reply.
I20260709 12:59:39.071655  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.071903  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.073551  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.073969  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.061293  6408 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.062028  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:39.079788  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.095371  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:39.097684  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.083015  6354 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:59:39.104113  1525 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:59:39.104218  6582 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.085306  6264 consensus_queue.cc:1059] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:59:39.084362  6029 consensus_queue.cc:1048] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:59:39.087986  6611 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:39.107379  6611 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.107767  6611 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:39.111896  6458 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.112565  6458 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.114439  6343 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.114728  6458 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.115387  6458 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.115096  6343 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.117334  1649 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.118570  6344 consensus_queue.cc:1059] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:39.118808  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.119424  6344 raft_consensus.cc:3055] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:39.107522  1525 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:39.120002  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:39.121945  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.122191  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.089859  5964 raft_consensus.cc:3055] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:39.126609  6637 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.127136  6198 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:39.126541  6633 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:39.122458  6636 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:39.117331  6343 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:39.158150  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.128230  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 396340us
I20260709 12:59:39.144768  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:39.170125  2339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.147732  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.177093  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.164021  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.179685  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.180982  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.181965  1527 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:39.183038  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:39.183743  1527 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:59:39.161661  1674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.005s	sys 0.017s
I20260709 12:59:39.178100  1525 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:39.186553  2476 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:59:39.186695  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:39.187626  1525 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:59:39.185446  1674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.005s	sys 0.018s
I20260709 12:59:39.185436  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.115837  6458 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:39.202775  1678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.003s	sys 0.026s
I20260709 12:59:39.192253  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:39.205025  1678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.004s	sys 0.026s
I20260709 12:59:39.204074  1531 raft_consensus.cc:1240] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:39.163364  6614 log.cc:927] Time spent T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.408s	user 0.001s	sys 0.000s
I20260709 12:59:39.193004  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 1019) took 1142 ms. Trace:
I20260709 12:59:39.212809  1680 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:39.129163  6264 consensus_queue.cc:1243] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer 1e45ac8b66854c2f905bf2c4114cb489 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:59:39.213207  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.214761  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:39.215411  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:39.219487  1531 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:39.215308  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:39.221350  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:39.214944  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:39.128456  6344 raft_consensus.cc:740] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:39.137663  6504 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.156358  6521 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:39.141682  5964 raft_consensus.cc:740] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
W20260709 12:59:39.190748  6505 consensus_meta.cc:287] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.004s
I20260709 12:59:39.211126  1534 rpcz_store.cc:276] 0709 12:59:38.050720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.590342 (+539622us) service_pool.cc:224] Handling call
0709 12:59:38.590669 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.591010 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.591036 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:38.591426 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 12:59:38.753748 (+162322us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:39.169353 (+415605us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.192789 (+ 23436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.192842 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.192870 (+    28us) raft_consensus.cc:1685] finished
0709 12:59:39.192876 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.192963 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273034,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":23126,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":9696,"thread_start_us":473435,"threads_started":2,"wal-append.queue_time_us":320356}
I20260709 12:59:39.230096  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.230554  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.230799  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.256125  1531 raft_consensus.cc:2393] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:39.230132  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.256345  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.210474  6637 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.258634  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.168623  6582 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:59:39.261778  6582 consensus_queue.cc:1243] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer 5a2554c3dead4fcfa5f51708a9ecd5ac log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:39.200678  6198 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:39.258577  6640 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:59:39.258186  6505 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.259168  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.262121  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.216459  6029 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:59:39.262063  1498 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.260232  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.263238  6582 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.272526  1603 raft_consensus.cc:2368] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8.
I20260709 12:59:39.272907  6582 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.140151  6635 consensus_queue.cc:1059] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:59:39.276160  6458 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.276357  6582 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:39.259722  6626 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:39.277729  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:39.278179  6622 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:39.278642  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:39.165887  6636 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.286170  6636 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.288501  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.288914  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.291531  1498 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.294107  1676 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:39.295202  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:39.306416  1498 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:39.308599  1525 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 8.
I20260709 12:59:39.309650  1527 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
W20260709 12:59:39.315694  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 49125.4us
I20260709 12:59:39.316802  1534 raft_consensus.cc:1240] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:39.320957  1498 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.296877  6343 raft_consensus.cc:2749] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:39.332851  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 45955.3us
I20260709 12:59:39.337312  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60884 (request call id 2260) took 1228 ms. Trace:
I20260709 12:59:39.337198  1498 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.304834  6521 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:39.344012  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.342500  1534 raft_consensus.cc:1275] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:59:39.337805  1533 rpcz_store.cc:276] 0709 12:59:38.108585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.653093 (+544508us) service_pool.cc:224] Handling call
0709 12:59:38.653528 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.664619 (+ 11091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.664670 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:38.665272 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:59:38.952657 (+287385us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:39.328974 (+376317us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.337009 (+  8035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.337078 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.337115 (+    37us) raft_consensus.cc:1685] finished
0709 12:59:39.337125 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.337255 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9498,"prepare.queue_time_us":74342,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":13946,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":24635,"thread_start_us":565513,"threads_started":2,"wal-append.queue_time_us":356739}
W20260709 12:59:39.339715  6527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.009s	sys 0.010s
I20260709 12:59:39.314287  6525 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:59:39.348122  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 68851.2us
I20260709 12:59:39.263363  6198 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.341334  6381 raft_consensus.cc:2764] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:59:39.307763  6344 consensus_queue.cc:260] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.340848  6458 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:39.347390  6343 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:39.347740  6527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.010s	sys 0.011s
I20260709 12:59:39.315469  6611 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.356062  1534 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:39.364071  1533 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:39.370158  6628 raft_consensus.cc:3055] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:39.371129  6628 raft_consensus.cc:740] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:39.375594  5964 consensus_queue.cc:260] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.376996  5964 raft_consensus.cc:3060] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:39.377182  6316 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.390347  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2319) took 1521 ms. Trace:
I20260709 12:59:39.390789  1526 rpcz_store.cc:276] 0709 12:59:37.869427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.925112 (+ 55685us) service_pool.cc:224] Handling call
0709 12:59:37.925470 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.153232 (+227762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.390080 (+1236848us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54003af054. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:39.390286 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521865472}
I20260709 12:59:39.391450  6198 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.356115  6447 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:59:39.403450  6447 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:39.403856  6447 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:39.349704  6521 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.408298  6414 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:39.415340  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 1004) took 1636 ms. Trace:
I20260709 12:59:39.405000  6447 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.420670  6414 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.422969  6447 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:39.423871  6578 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.948s	user 0.002s	sys 0.000s
I20260709 12:59:39.416040  1530 rpcz_store.cc:276] 0709 12:59:37.778581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.778714 (+   133us) service_pool.cc:224] Handling call
0709 12:59:37.779013 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.779718 (+   705us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:59:37.805818 (+ 26100us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.089486 (+1283668us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b1800318400. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d153823a 00007f25d19a2a2a
0709 12:59:39.407933 (+318447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:39.407992 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:39.408046 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.408137 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.415249 (+  7112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25958,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2135,"raft.queue_time_us":149,"raft.run_cpu_time_us":637,"raft.run_wall_time_us":3485,"spinlock_wait_cycles":19344256,"thread_start_us":318204,"threads_started":1}
I20260709 12:59:39.433333  6521 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.434894  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:39.436887  2428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36912 (request call id 1146) took 1819 ms. Trace:
I20260709 12:59:39.437465  2428 rpcz_store.cc:276] 0709 12:59:37.617731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.620529 (+  2798us) service_pool.cc:224] Handling call
0709 12:59:37.620887 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:37.621276 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.621305 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:37.621929 (+   624us) log.cc:844] Serialized 52 byte log entry
0709 12:59:37.690262 (+ 68333us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:59:37.709756 (+ 19494us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.710059 (+   303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.710160 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:38.380082 (+669922us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18004b1360. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:59:39.423299 (+1043217us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:39.436656 (+ 13357us) raft_consensus.cc:1685] finished
0709 12:59:39.436683 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.436826 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21475,"prepare.queue_time_us":16287,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":9344,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":27175,"spinlock_wait_cycles":9063168,"thread_start_us":67962,"threads_started":1,"wal-append.queue_time_us":138789}
I20260709 12:59:39.439366  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:39.440694  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.440814  1531 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:39.439325  6611 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:39.453763  1600 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:39.457254  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2458) took 1482 ms. Trace:
I20260709 12:59:39.472584  1531 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 15.
I20260709 12:59:39.468231  6399 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.472322  6552 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:39.469435  6198 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:59:39.519857  1677 raft_consensus.cc:1275] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:59:39.524225  1677 pending_rounds.cc:85] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 9
I20260709 12:59:39.524497  1677 pending_rounds.cc:107] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:59:39.524803  1677 raft_consensus.cc:2889] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:39.481345  6624 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:39.497145  6399 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.541738  6624 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.545611  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.545717  6399 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:39.549611  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.550506  1600 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:39.551952  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 1141) took 1037 ms. Trace:
W20260709 12:59:39.554486  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.552413  1682 rpcz_store.cc:276] 0709 12:59:38.514565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.762843 (+248278us) service_pool.cc:224] Handling call
0709 12:59:38.763229 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:39.000304 (+237075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.000335 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:39.006338 (+  6003us) log.cc:844] Serialized 52 byte log entry
0709 12:59:39.408729 (+402391us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:39.456562 (+ 47833us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.456841 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.456948 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.551729 (+ 94781us) raft_consensus.cc:1685] finished
0709 12:59:39.551748 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.551892 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37247,"prepare.queue_time_us":48821,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1534,"raft.queue_time_us":73604,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12613,"spinlock_wait_cycles":23348608,"thread_start_us":595639,"threads_started":2,"wal-append.queue_time_us":493208}
I20260709 12:59:39.567629  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:39.568437  1682 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:39.556843  6447 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:39.529207  6552 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.617384  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.618299  1600 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:39.624624  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:39.639093  1682 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 15.
W20260709 12:59:39.678045  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 53544.1us
I20260709 12:59:39.618476  6624 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:39.683560  6527 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:39.697320  6661 log.cc:927] Time spent T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:59:39.736049  1682 raft_consensus.cc:1217] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-11.10]   Dedup: 7.8->[9.9-11.10]
I20260709 12:59:39.575691  6447 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.737623  1529 raft_consensus.cc:606] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:39.696271  6343 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:39.740622  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 393728us
I20260709 12:59:39.748632  1498 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.744719  1682 pending_rounds.cc:85] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 8
I20260709 12:59:39.749416  1682 pending_rounds.cc:107] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:59:39.749922  1682 raft_consensus.cc:2889] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:39.750041  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 1006) took 1963 ms. Trace:
I20260709 12:59:39.746079  1529 raft_consensus.cc:614] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:39.751005  1528 rpcz_store.cc:276] 0709 12:59:37.779294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.779495 (+   201us) service_pool.cc:224] Handling call
0709 12:59:37.779784 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:37.788581 (+  8797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.788625 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:37.789467 (+   842us) log.cc:844] Serialized 52 byte log entry
0709 12:59:38.057262 (+267795us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:59:39.413680 (+1356418us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b180006fe20. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25d15404bc 00007f25ce88e48b 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8a8455 00007f25d53903c7 00007f25d19a29a7 00007f25d19b20bf
0709 12:59:39.414622 (+   942us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.688610 (+273988us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.737388 (+ 48778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.737526 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.741890 (+  4364us) raft_consensus.cc:1685] finished
0709 12:59:39.741925 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.742264 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56633,"prepare.queue_time_us":91833,"prepare.run_cpu_time_us":1171,"prepare.run_wall_time_us":3680,"raft.queue_time_us":57291,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":12059,"spinlock_wait_cycles":10605696,"thread_start_us":544806,"threads_started":3,"wal-append.queue_time_us":301132,"wal-append.run_cpu_time_us":3250,"wal-append.run_wall_time_us":1264960}
W20260709 12:59:39.762421  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.762288  1498 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.764428  1498 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.766034  1498 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.743604  6527 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:39.768903  1575 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:40197 timed out after 1.607s (SENT) [suppressed 21 similar messages]
I20260709 12:59:39.754525  6501 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:39.758401  6458 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:39.773032  6381 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.774169  6527 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.774629  6525 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:39.781776  6466 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.755545  6343 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:39.797127  6666 log.cc:927] Time spent T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:59:39.799863  6447 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:39.800776  6662 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:59:39.802251  6659 log.cc:927] Time spent T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:59:39.803274  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.804261  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 907) took 1211 ms. Trace:
I20260709 12:59:39.807920  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2469) took 1042 ms. Trace:
I20260709 12:59:39.808482  1681 rpcz_store.cc:276] 0709 12:59:38.765875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.065577 (+299702us) service_pool.cc:224] Handling call
0709 12:59:39.081767 (+ 16190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:39.082284 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:39.126726 (+ 44442us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.367984 (+241258us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:39.371893 (+  3909us) log.cc:844] Serialized 26 byte log entry
0709 12:59:39.374074 (+  2181us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:39.374128 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.374223 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.807617 (+433394us) raft_consensus.cc:1685] finished
0709 12:59:39.807664 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.807839 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":506,"prepare.queue_time_us":45863,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":344,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":5857,"thread_start_us":222340,"threads_started":1,"wal-append.queue_time_us":344211}
I20260709 12:59:39.804652  1605 rpcz_store.cc:276] 0709 12:59:38.593395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.593542 (+   147us) service_pool.cc:224] Handling call
0709 12:59:38.593980 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:38.638865 (+ 44885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.638895 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:38.650284 (+ 11389us) log.cc:844] Serialized 52 byte log entry
0709 12:59:39.029163 (+378879us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b180008de20. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d15380d1 00007f25d1953a0f
0709 12:59:39.453400 (+424237us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:39.757974 (+304574us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.758197 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.758282 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.803954 (+ 45672us) raft_consensus.cc:1685] finished
0709 12:59:39.804055 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.804196 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10913,"prepare.queue_time_us":70379,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":45262,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":16815,"spinlock_wait_cycles":7837440,"thread_start_us":708596,"threads_started":2,"wal-append.queue_time_us":952982}
W20260709 12:59:39.813369  6650 log.cc:927] Time spent T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 12:59:39.785415  6501 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.802528  6318 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:39.817448  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 51519us
I20260709 12:59:39.816396  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:39.819150  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50296.9us
I20260709 12:59:39.823246  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.814831  6343 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.832435  6375 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:39.833113  6375 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.836509  6375 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:39.839568  1498 leader_election.cc:400] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8.
I20260709 12:59:39.840564  1498 leader_election.cc:403] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:39.841254  6439 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 7. Current term is 8.
I20260709 12:59:39.843324  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.845158  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.847419  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:39.850792  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.849476  1575 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:39.823246  6590 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:39.858088  1606 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:39.840324  6343 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:39.860221  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:39.860664  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.861006  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:39.861101  1498 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.864712  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.852628  6439 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:39.861462  6612 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.128s	user 0.000s	sys 0.010s
I20260709 12:59:39.850167  6180 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:39.868038  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:39.850420  6588 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:39.883550  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:39.868350  6616 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:39.865855  6668 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:39.863473  6590 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.872225  6681 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:39.891052  6380 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:39.892757  6590 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.892822  1498 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:39.898216  6681 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:39.890379  6616 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:39.896957  6685 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:39.902304  6616 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:39.874176  6439 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.909762  1534 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 5.
I20260709 12:59:39.910864  6505 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:39.911150  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:39.911834  1605 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 5.
I20260709 12:59:39.883292  6375 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:39.877652  6180 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.921970  6447 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:59:39.923920  1480 auto_rebalancer.cc:893] Removing replace marker failed: Replica 5a2554c3dead4fcfa5f51708a9ecd5ac is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:39.921619  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2455) took 1948 ms. Trace:
W20260709 12:59:39.924414  1480 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:59:39.924811  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:59:39.924363  1683 rpcz_store.cc:276] 0709 12:59:37.973597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.186445 (+212848us) service_pool.cc:224] Handling call
0709 12:59:38.232583 (+ 46138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.240896 (+  8313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.240928 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:38.254475 (+ 13547us) log.cc:844] Serialized 26 byte log entry
0709 12:59:38.507906 (+253431us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:38.508167 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.508673 (+   506us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.789626 (+1280953us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:39.919747 (+130121us) raft_consensus.cc:1685] finished
0709 12:59:39.919764 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.921522 (+  1758us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7381,"raft.queue_time_us":7477,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":7555,"spinlock_wait_cycles":27610368,"thread_start_us":206869,"threads_started":1,"wal-append.queue_time_us":361563}
I20260709 12:59:39.885239  6552 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.921187  2344 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:39.929806  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34852
I20260709 12:59:39.930588  1527 raft_consensus.cc:606] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 12:59:39.930959  6527 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:39.932782  6654 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.534s	user 0.000s	sys 0.006s
I20260709 12:59:39.887717  6617 consensus_queue.cc:1059] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:59:39.934480  6617 raft_consensus.cc:3055] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:39.934872  6617 raft_consensus.cc:740] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:39.935506  5964 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.936028  5964 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.936403  6663 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.936992  6663 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.937819  6550 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.938319  6550 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.938709  6617 consensus_queue.cc:260] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.939713  6663 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.939993  6581 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.940258  6550 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:39.940670  6671 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.940830  6550 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:39.941725  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 386529us
I20260709 12:59:39.928674  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:39.940582  6581 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.941417  6671 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.946784  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2431) took 1991 ms. Trace:
I20260709 12:59:39.930981  1527 raft_consensus.cc:614] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:39.933346  6527 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:39.954340  1674 rpcz_store.cc:276] 0709 12:59:37.955949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.956107 (+   158us) service_pool.cc:224] Handling call
0709 12:59:37.990186 (+ 34079us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:38.298254 (+308068us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:38.589675 (+291421us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b18003d6420. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce825c0a 00007f25d7f65219 00007f25ce8ada40 00007f25ce8a84e4 00007f25ce8a8455 00007f25d53903c7 00007f25d19a29a7 00007f25d19b20bf 00007f25d19b2038
0709 12:59:38.592745 (+  3070us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.204572 (+611827us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:39.205184 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 12:59:39.205344 (+   160us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:39.205637 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.205955 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.373484 (+167529us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b18003d6420. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab522 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:59:39.385749 (+ 12265us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b18003d6420. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8a8455 00007f25d1990060 00007f25d19a2716 00007f25d19b3287 00007f25d19b3208
0709 12:59:39.620984 (+235235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.946340 (+325356us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002ffb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:39.946417 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.946482 (+    65us) raft_consensus.cc:1685] finished
0709 12:59:39.946502 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.946706 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86657,"prepare.queue_time_us":360757,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":4515,"raft.queue_time_us":53437,"raft.run_cpu_time_us":580,"raft.run_wall_time_us":52256,"spinlock_wait_cycles":766755584,"thread_start_us":772023,"threads_started":2,"wal-append.queue_time_us":527382}
I20260709 12:59:39.938318  5964 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:39.952535  6617 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.940286  6663 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.970341  1683 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:59:39.954159  6624 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:39.979625  1647 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:39.980656  6663 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.982088  6504 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.982621  6504 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:39.984009  6663 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.984467  6504 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:39.987607  6399 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.988149  6399 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:39.990592  6643 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:39.990737  6414 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:39.991086  6643 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:39.991585  6643 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:40.007594  6399 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.009795  1601 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:40.011547  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56224 (request call id 913) took 1110 ms. Trace:
I20260709 12:59:40.012037  1601 rpcz_store.cc:276] 0709 12:59:38.901054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.901177 (+   123us) service_pool.cc:224] Handling call
0709 12:59:40.011286 (+1110109us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002bd9d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:40.011438 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537729408}
W20260709 12:59:40.015038  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 131599us
W20260709 12:59:40.018625  1480 auto_rebalancer.cc:893] Removing replace marker failed: Replica 5a2554c3dead4fcfa5f51708a9ecd5ac is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:59:40.019153  1480 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:59:40.019434  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:59:40.018540  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2346) took 1274 ms. Trace:
I20260709 12:59:40.021533  1674 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:40.020826  1679 rpcz_store.cc:276] 0709 12:59:38.744009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.888991 (+144982us) service_pool.cc:224] Handling call
0709 12:59:38.889308 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.926559 (+ 37251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.926588 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:38.927084 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:59:39.215469 (+288385us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:39.273775 (+ 58306us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.274002 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.274099 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.932201 (+658102us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:40.018259 (+ 86058us) raft_consensus.cc:1685] finished
0709 12:59:40.018360 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.018484 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38081,"prepare.queue_time_us":59068,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":46622,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":5152,"spinlock_wait_cycles":18056448,"thread_start_us":281018,"threads_started":1,"wal-append.queue_time_us":412050}
I20260709 12:59:40.022868  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:39.458058  1678 rpcz_store.cc:276] 0709 12:59:37.974364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.408005 (+433641us) service_pool.cc:224] Handling call
0709 12:59:38.408421 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:38.408808 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.408841 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:38.424123 (+ 15282us) log.cc:844] Serialized 52 byte log entry
0709 12:59:38.595633 (+171510us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:39.206113 (+610480us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.456636 (+250523us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.456880 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.456971 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.457023 (+    52us) raft_consensus.cc:1685] finished
0709 12:59:39.457040 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.457187 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121134,"prepare.queue_time_us":160691,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":61345,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":27576,"thread_start_us":873324,"threads_started":3,"wal-append.queue_time_us":348948}
I20260709 12:59:39.943706  6550 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:40.026160  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 52859.7us
I20260709 12:59:40.028736  1575 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:40.032568  1575 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:40.035893  6552 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:40.036499  6552 raft_consensus.cc:697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:40.037298  6552 consensus_queue.cc:237] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:40.038923  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.040680  1497 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:40.043411  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:40.045941  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:40.047271  1534 raft_consensus.cc:1217] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.4->[8.5-12.7]   Dedup: 8.5->[10.6-12.7]
I20260709 12:59:40.047587  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.047902  1534 pending_rounds.cc:85] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 5
I20260709 12:59:40.048167  1534 pending_rounds.cc:107] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:59:40.048403  1534 raft_consensus.cc:2889] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:40.045310  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.044386  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.046075  2451 raft_consensus.cc:1240] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:59:40.054102  1497 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:40.056452  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.056675  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:40.056030  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:40.059901  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:40.053946  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 77736.4us
I20260709 12:59:40.008893  6628 consensus_queue.cc:260] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.065662  1681 raft_consensus.cc:2393] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 14: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:40.067984  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:40.048926  6668 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:40.069865  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.073918  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:40.074936  1681 raft_consensus.cc:2393] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 6: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:40.078244  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.080641  1497 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:40.053118  6521 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:40.084002  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.084493  1497 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:40.087864  2451 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 6.
I20260709 12:59:40.090480  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.064664  6414 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:40.089175  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:40.097784  6343 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:40.104424  6589 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:40.098057  6688 consensus_queue.cc:1059] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:59:40.069653  6525 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:40.104707  6581 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:40.077775  6628 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:40.139428  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.111475  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:40.116926  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:40.120473  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.146294  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.122304  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.147867  1531 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 13: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:40.148892  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.150223  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.082170  6375 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:40.091289  6626 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:40.152268  1531 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:59:40.146294  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.153223  1526 raft_consensus.cc:2393] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 11: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
W20260709 12:59:40.073285  6537 consensus_queue.cc:1175] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3cabc5110903443ba3beb5cbb14afa91" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
I20260709 12:59:40.156064  6581 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:40.157809  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 46415.2us
I20260709 12:59:40.069257  6619 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:59:40.102078  6668 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:40.105507  6671 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:40.167749  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:40.169701  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 69149.5us
I20260709 12:59:40.109751  6402 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:40.101819  6380 consensus_queue.cc:1048] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:59:40.163029  6624 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:40.166162  6590 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:59:40.175841  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 93018.4us
W20260709 12:59:40.181798  6683 log.cc:927] Time spent T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
I20260709 12:59:40.179196  6180 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.265597  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.253270  1649 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:40.186846  6590 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:40.273020  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:40.279716  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:40.276587  5964 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:40.288756  6689 log.cc:927] Time spent T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:59:40.290477  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2348) took 1160 ms. Trace:
I20260709 12:59:40.291770  6439 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.290868  1680 rpcz_store.cc:276] 0709 12:59:39.130079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.935603 (+805524us) service_pool.cc:224] Handling call
0709 12:59:39.935968 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:39.936295 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.936323 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:39.936774 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:59:40.027241 (+ 90467us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:59:40.027287 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.027346 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.290247 (+262901us) raft_consensus.cc:1685] finished
0709 12:59:40.290269 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.290417 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28697,"raft.queue_time_us":4163,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":90167,"threads_started":1,"wal-append.queue_time_us":119463}
I20260709 12:59:40.292394  6439 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:40.292922  6439 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:40.301246  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.179879  6616 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:40.251158  6402 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.306063  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:40.310792  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.311584  2461 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
W20260709 12:59:40.313786  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 130871us
I20260709 12:59:40.315229  1530 raft_consensus.cc:2393] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 15: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:40.315523  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:40.247862  6688 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:59:40.320050  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.321354  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.324199  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.326612  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.329413  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.331146  1500 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:40.337282  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.333536  2451 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 6.
I20260709 12:59:40.341718  1526 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
I20260709 12:59:40.343974  6594 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:40.318513  6692 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.132s	user 0.003s	sys 0.000s
I20260709 12:59:40.300523  6198 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:40.313493  6581 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:40.314244  6550 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.321951  6392 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:40.356055  6375 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:40.355893  1500 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:40.358536  6375 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:40.362200  6668 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.345180  6624 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.350648  6505 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:40.379566  6505 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.380052  6505 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:40.382831  6616 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:40.382931  6439 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:40.320669  6402 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.355082  6392 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.408018  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:40.411805  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:40.413411  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:40.352439  6590 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:40.426855  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:40.406559  6392 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:40.426031  6590 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:40.433549  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.436276  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.416800  6616 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.443994  1608 raft_consensus.cc:3055] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:40.444484  1608 raft_consensus.cc:740] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:40.445310  1608 consensus_queue.cc:260] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.446538  1608 raft_consensus.cc:3060] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:40.450891  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 1150) took 1461 ms. Trace:
I20260709 12:59:40.451298  1677 rpcz_store.cc:276] 0709 12:59:38.989039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.403366 (+414327us) service_pool.cc:224] Handling call
0709 12:59:39.403705 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.525315 (+121610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.450659 (+925344us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001c61d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:40.450831 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258149248}
I20260709 12:59:40.455951  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38982 (request call id 2477) took 1324 ms. Trace:
I20260709 12:59:40.456364  1675 rpcz_store.cc:276] 0709 12:59:39.131612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.943167 (+811555us) service_pool.cc:224] Handling call
0709 12:59:39.951788 (+  8621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.965972 (+ 14184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.966003 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:39.966053 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:39.966085 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.455711 (+489626us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54001f7554. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:40.455758 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.455881 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32208640}
I20260709 12:59:40.458792  6616 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:40.460597  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.461149  6616 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.467399  6402 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:40.469636  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.485294  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:40.486315  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 1152) took 1496 ms. Trace:
I20260709 12:59:40.486843  1682 rpcz_store.cc:276] 0709 12:59:38.989545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.734340 (+744795us) service_pool.cc:224] Handling call
0709 12:59:39.734883 (+   543us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:39.942308 (+207425us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:39.964064 (+ 21756us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.092311 (+128247us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:40.092843 (+   532us) log.cc:844] Serialized 52 byte log entry
0709 12:59:40.092970 (+   127us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:40.180705 (+ 87735us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.181193 (+   488us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.485487 (+304294us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b18003d6600. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce825c0a 00007f25d7f65219 00007f25d154ed70 00007f25d1542293 00007f25d1537cea 00007f25d153823a 00007f25d19a2a2a 00007f25d19b20bf 00007f25d19b2038
0709 12:59:40.485832 (+   345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.486015 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.486066 (+    51us) raft_consensus.cc:1685] finished
0709 12:59:40.486085 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.486245 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207126,"prepare.queue_time_us":73608,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":99,"raft.queue_time_us":213336,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":10546,"spinlock_wait_cycles":269780992,"thread_start_us":204244,"threads_started":2,"wal-append.queue_time_us":139197}
I20260709 12:59:40.472994  6643 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:40.493834  6660 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:40.494253  6668 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:40.505141  6660 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:40.510164  6660 raft_consensus.cc:3060] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:40.556485  1608 raft_consensus.cc:1275] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:40.558663  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56224 (request call id 919) took 1386 ms. Trace:
I20260709 12:59:40.559243  1608 rpcz_store.cc:276] 0709 12:59:39.171787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.171890 (+   103us) service_pool.cc:224] Handling call
0709 12:59:39.172162 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.443885 (+1271723us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b5400035aa0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d190fdc0 00007f25d199a1c0 00007f25d199b231 00007f25d1997d8f 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c
0709 12:59:40.558023 (+114138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.558470 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109488512}
I20260709 12:59:40.561621  1572 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:40.566082  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.572643  2428 raft_consensus.cc:1240] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:40.574010  6375 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.575155  6375 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.576757  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.577939  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.579978  6375 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.580852  6375 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.583979  6380 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:40.583463  6343 consensus_queue.cc:1059] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:40.605032  6594 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.606038  6343 raft_consensus.cc:3055] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:40.585772  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.588255  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.589067  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.589924  1601 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:40.590417  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.590478  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.591776  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:40.595762  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.596573  6402 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:40.592999  1575 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:40.606812  6343 raft_consensus.cc:740] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
W20260709 12:59:40.610677  6567 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:59:40.610546  6536 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.606413  6594 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.621989  6375 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.628645  6343 consensus_queue.cc:260] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.643172  6589 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.644130  6589 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.642338  6704 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.642352  6536 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:40.627170  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 62833.9us
I20260709 12:59:40.656169  6536 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.651664  1608 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 5.
I20260709 12:59:40.658262  6643 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:40.660027  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 67497.2us
I20260709 12:59:40.662331  6707 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:40.662815  6707 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.663290  6707 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.663192  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60876 (request call id 2336) took 1504 ms. Trace:
I20260709 12:59:40.663898  1525 rpcz_store.cc:276] 0709 12:59:39.158273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.311722 (+153449us) service_pool.cc:224] Handling call
0709 12:59:39.312002 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.444567 (+132565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.444604 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:39.444645 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:39.444681 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.662351 (+1217670us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54000c6cd4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:40.662451 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.662959 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304398720}
I20260709 12:59:40.669889  6630 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:40.671478  6630 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.672585  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46606 (request call id 19) took 2890 ms. Trace:
I20260709 12:59:40.678058  6660 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.684510  6589 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.685705  6660 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:40.637073  6402 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.707130  6402 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.709117  6704 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.713739  6704 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.637701  6537 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:40.694763  1674 raft_consensus.cc:1217] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 12:59:40.715473  1647 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:40.715377  6316 consensus_queue.cc:1048] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:40.719704  6344 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:40.728813  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:40.730700  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 44033.4us
I20260709 12:59:40.731796  6501 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.734326  6685 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:40.737313  6702 raft_consensus.cc:3055] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:40.674070  6375 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.673218  1529 rpcz_store.cc:276] 0709 12:59:37.781776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.787929 (+  6153us) service_pool.cc:224] Handling call
0709 12:59:40.672001 (+2884072us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400198a54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1992853 00007f25d696060a 00007f25cfee67d4 00007f25cfee6762 00007f25cfee6691 00007f25cfee660c 00007f25cfee58c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:40.672244 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4475810048}
I20260709 12:59:40.691507  6630 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:40.741005  6594 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.853456  6505 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.854476  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45362 (request call id 1148) took 1904 ms. Trace:
I20260709 12:59:40.854954  1676 rpcz_store.cc:276] 0709 12:59:38.949472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.302056 (+352584us) service_pool.cc:224] Handling call
0709 12:59:39.302470 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.354924 (+ 52454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.354953 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:39.354994 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:39.355024 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.853837 (+1498813us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b5400342954. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:40.853936 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.854229 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117549952}
I20260709 12:59:40.860662  6521 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:40.861591  6521 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.863147  6458 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:40.864064  6458 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.743563  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.744632  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:40.810019  1674 raft_consensus.cc:1240] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:59:40.875771  6458 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.819696  1604 raft_consensus.cc:1240] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:40.819058  1429 catalog_manager.cc:5697] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 8 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.813297  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.813208  6685 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:40.822705  6702 raft_consensus.cc:740] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:40.823952  6392 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.886921  6702 consensus_queue.cc:260] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:40.824899  6707 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.888741  1683 raft_consensus.cc:2368] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:59:40.829154  5964 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:40.832227  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 117206us
I20260709 12:59:40.833173  6671 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:40.840412  6590 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:40.842862  6588 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:40.843307  1572 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:40.843701  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.848703  6343 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:40.852279  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:40.852620  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.875865  6537 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.897863  6594 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.902889  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:40.903298  6594 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.904508  6537 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:40.907974  5964 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:40.911274  5964 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:40.889050  6702 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:40.888836  6392 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.896186  6588 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
W20260709 12:59:40.928207  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 76037.5us
W20260709 12:59:40.927563  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 128256us
I20260709 12:59:40.941972  6536 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:40.971769  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.972092  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:40.973997  6594 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.963397  6537 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.982355  6537 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:40.984939  6537 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:40.985790  1606 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:40.998145  6521 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:40.945611  6567 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:41.010558  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.012961  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:41.015944  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 51836.9us
I20260709 12:59:41.013293  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.018265  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
W20260709 12:59:41.022158  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 57492.2us
I20260709 12:59:41.026245  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.026587  6671 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:41.027619  6671 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.028357  6671 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:41.013901  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 170729us
I20260709 12:59:41.014153  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.015045  1647 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.015323  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:41.052644  2451 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.056960  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.032123  6643 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:41.061194  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:40.966271  6707 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.034560  6505 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.066476  2461 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:41.068492  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.070313  6594 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:41.067373  6643 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:41.072552  1429 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 12, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:41.098802  1575 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:41.099961  6643 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.105901  1608 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:41.101346  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.119338  1527 raft_consensus.cc:1240] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:41.119462  6567 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:41.108816  6685 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.131125  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:41.105643  6671 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:41.133392  1602 raft_consensus.cc:2468] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:41.092892  6527 consensus_queue.cc:1048] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
W20260709 12:59:41.138660  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64847.6us
I20260709 12:59:41.139947  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:41.124532  6567 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
W20260709 12:59:41.141856  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 126969us
I20260709 12:59:41.146165  1530 raft_consensus.cc:2393] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:41.145164  6567 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:41.149621  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.145449  6671 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:59:41.159456  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 62545.6us
I20260709 12:59:41.158931  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:41.163437  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.164387  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.158531  6671 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.161043  6521 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:41.183643  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.172852  6671 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:41.181439  6521 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.190734  6521 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.194640  1647 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.181880  5964 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:41.196866  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.197981  6198 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:41.202935  1572 leader_election.cc:400] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
W20260709 12:59:41.207216  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 108520us
I20260709 12:59:41.138018  6588 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.212742  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.214569  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:41.238545  6643 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:41.245126  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.186242  6392 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.252624  1527 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:41.254733  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:41.254946  2451 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:41.252832  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.263844  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.210688  6521 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.272665  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.270246  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.257058  6685 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:41.263780  6594 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:41.286157  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:41.287393  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 90689us
I20260709 12:59:41.278774  1500 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.282042  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.289899  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.277398  6691 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.297075  1532 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:41.299803  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.295712  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:41.307829  6343 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:41.297963  1429 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:41.313798  6588 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:41.313993  6392 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.293781  6198 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:41.316473  6392 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:41.316888  6198 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.319586  6198 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:41.306226  1500 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:41.320482  1431 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40874 (request call id 354) took 30182 ms (client timeout 15000 ms). Trace:
I20260709 12:59:41.321635  1676 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:41.321858  6458 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:41.325891  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:41.326874  1679 raft_consensus.cc:2368] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:59:41.329490  6691 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.331883  6691 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.329977  6523 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.334195  1527 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 13: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:41.333922  6523 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.335505  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.336133  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.336493  1526 raft_consensus.cc:2393] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:41.335372  1497 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:41.336834  1532 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:41.336333  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:41.341748  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.341024  1525 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.341040  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.341162  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.344635  2461 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:41.347162  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.352813  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.336341  6523 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.294584  6521 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.349704  6505 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:41.364493  1500 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.356264  1429 catalog_manager.cc:5697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 6, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.366770  1500 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:41.381130  1534 raft_consensus.cc:2393] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 13: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:41.362102  6458 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:41.369949  6198 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:41.359768  6392 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:41.379539  1429 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:41.391746  6439 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:41.393986  6198 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.396696  6198 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.409235  6521 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.409735  1682 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:59:41.410490  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 110739us
I20260709 12:59:41.412364  1530 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:41.410555  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63449.7us
I20260709 12:59:41.383519  6343 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:41.426074  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.426074  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.430857  1607 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:41.439797  1525 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:41.444134  1572 leader_election.cc:400] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:59:41.444586  1572 leader_election.cc:403] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:59:41.441182  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.449514  6343 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:41.450634  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.451429  6343 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.450103  1526 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:41.451702  6567 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.435958  6198 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.449820  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.474783  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:41.475656  1525 raft_consensus.cc:2368] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:59:41.480192  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:41.449759  6318 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:59:41.447149  6702 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:41.505366  2474 raft_consensus.cc:2368] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:59:41.505669  6617 raft_consensus.cc:3060] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.506031  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.480223  6198 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.507421  6643 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:41.508093  6643 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.508818  6198 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:41.509420  6198 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.509764  6466 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.510138  1682 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:41.510306  6466 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.511870  1429 catalog_manager.cc:5697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:41.512554  6466 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.513339  6198 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.515923  6198 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:41.519976  6671 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.533772  6702 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.535226  6671 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.536315  6702 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.521678  5964 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:41.480878  6392 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.540007  6392 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.540601  1680 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:41.541796  6643 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.528236  6590 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.543371  6590 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.545195  1678 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:41.545981  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.534252  6668 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.478849  6594 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:41.548306  1677 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:41.545348  6590 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:41.321496  1431 rpcz_store.cc:269] 0709 12:59:11.141791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.196192 (+ 54401us) service_pool.cc:224] Handling call
0709 12:59:41.320245 (+30124053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:33.120123 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:33.120794 (+   671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:33.120845 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:59:33.120858 (+    13us) tablet.cc:662] Decoding operations
0709 12:59:33.125165 (+  4307us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:33.125260 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:33.125294 (+    34us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:59:33.127807 (+  2513us) tablet.cc:701] Row locks acquired
0709 12:59:33.127867 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:59:33.128032 (+   165us) write_op.cc:270] Start()
0709 12:59:33.128194 (+   162us) write_op.cc:276] Timestamp: P: 1783601973127963 usec, L: 0
0709 12:59:33.128229 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:59:33.214538 (+ 86309us) log.cc:844] Serialized 11122 byte log entry
0709 12:59:33.972126 (+757588us) op_driver.cc:464] REPLICATION: finished
0709 12:59:34.268070 (+295944us) write_op.cc:301] APPLY: starting
0709 12:59:34.284477 (+ 16407us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:34.514644 (+230167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:34.515285 (+   641us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:34.892537 (+377252us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:34.893187 (+   650us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 12:59:34.893248 (+    61us) write_op.cc:312] APPLY: finished
0709 12:59:34.893844 (+   596us) log.cc:844] Serialized 244 byte log entry
0709 12:59:34.894028 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:34.894248 (+   220us) write_op.cc:454] Released schema lock
0709 12:59:34.894326 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:34.894761 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:34.894792 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":224678,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":252617,"apply.run_cpu_time_us":43780,"apply.run_wall_time_us":648047,"cfile_cache_hit":114,"cfile_cache_hit_bytes":120999,"num_ops":28,"prepare.queue_time_us":439128,"prepare.run_cpu_time_us":34022,"prepare.run_wall_time_us":314025,"raft.queue_time_us":206277,"raft.run_cpu_time_us":42564,"raft.run_wall_time_us":141628,"replication_time_us":843618,"thread_start_us":691247,"threads_started":4,"wal-append.queue_time_us":217416,"wal-append.run_cpu_time_us":34555,"wal-append.run_wall_time_us":2402038}]]}
I20260709 12:59:41.562057  6594 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.564451  6594 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.564886  6567 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.557898  1429 catalog_manager.cc:5697] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 3 to 10, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:41.481669  6375 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:59:41.586390  6685 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.605152  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.587138  6439 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.598245  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:41.559899  6668 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.630173  6594 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.630700  6594 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.632339  6594 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:41.636250  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:41.622360  6685 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.637194  1679 raft_consensus.cc:2368] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15.
I20260709 12:59:41.602559  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:41.638046  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.626863  1429 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 7 to 10, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:41.658962  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:41.650218  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.643056  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.652731  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.660494  1679 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:41.662022  1525 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:41.639685  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.644515  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.670131  1606 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:41.670986  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:41.669976  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.674108  1601 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:41.665503  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:41.674263  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 204251us
I20260709 12:59:41.683357  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.639868  6594 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:41.638475  6685 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.684849  1676 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
W20260709 12:59:41.687268  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.619061  6439 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.690945  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.691777  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:41.695374  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.687776  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.683390  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.693638  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.694038  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.643631  6613 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:59:41.694519  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.623195  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:41.700994  1534 raft_consensus.cc:606] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.701417  1534 raft_consensus.cc:614] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:41.702694  1682 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:41.706951  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.689110  6594 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.704687  1600 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
W20260709 12:59:41.712620  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 48397.9us
I20260709 12:59:41.717971  6592 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:41.718477  6592 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.718952  6592 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:41.726822  1497 leader_election.cc:400] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15.
I20260709 12:59:41.727926  1498 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:41.728514  1602 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:41.730335  1533 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 14: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:41.734402  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:41.736624  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.738108  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.739537  6735 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:41.748466  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.729188  1429 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:41.755333  1606 raft_consensus.cc:2393] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:41.740847  6735 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.727949  6594 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:41.767977  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.768950  1603 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:41.745790  6466 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.775904  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:41.742925  6625 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:41.747251  6685 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:59:41.785504  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 111992us
I20260709 12:59:41.796772  6736 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:41.797899  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.796768   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:41.802287  6462 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:41.803361  6462 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.804992  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.805431   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:41.805824  1531 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 8.
I20260709 12:59:41.806079  6668 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.806912  6668 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.807530  6668 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:41.812541  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 75943.6us
I20260709 12:59:41.789764  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:41.828014  1649 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:41.801077  6685 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.793941  6505 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.836261  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:41.795106  6316 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:59:41.827142  6668 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.843807  6685 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:41.798692  6466 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.826691  6625 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:41.842453  6736 raft_consensus.cc:2804] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:41.859671  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.876256  6462 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:41.869679  6625 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.879931  6625 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:41.881505  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:41.882529  6462 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.882973  2342 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:41.883155  6462 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.885180  6734 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:41.885658  6448 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:41.882975  6211 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:41.885684  6734 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.888176  6734 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:41.894531  6618 raft_consensus.cc:2804] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:41.895155  6618 raft_consensus.cc:697] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:41.900104  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 110451us
I20260709 12:59:41.845530  6505 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.896111  6618 consensus_queue.cc:237] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.875001  6736 raft_consensus.cc:697] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:41.906939  1649 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:41.928066  6733 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:41.930022  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.930716  1604 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:41.932049  6734 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.934257  6736 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:41.932314  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:41.936311  6745 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.942487  6505 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.943687  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.944226  6735 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:41.946974  6466 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:41.947815  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:41.952924  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 46118.8us
W20260709 12:59:41.955322  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 54252.1us
I20260709 12:59:41.954810  1532 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:41.958630  1497 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:41.970077  1572 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:41.976615  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.977414  1678 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:41.982905  1575 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:41.975039  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:41.990520  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.994676  6748 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:41.995177  6748 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.995546  6748 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:41.997004  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.997605  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:41.998322  1676 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:41.956030  5964 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:41.989106  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:41.993891  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:41.992244  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:42.016860  1682 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:42.016364  1683 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:41.982146  6505 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:42.006233  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.019410  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.025336  6590 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.038741  1676 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:59:42.040689  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 70754.6us
I20260709 12:59:42.041452  6343 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:42.041754  6750 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:42.042017  6343 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.042584  6343 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:42.045867  6521 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.046530  6521 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.049463  6643 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:42.050333  6741 log.cc:927] Time spent T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.147s	user 0.004s	sys 0.000s
I20260709 12:59:42.050236  6643 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:42.052904  6617 consensus_meta.cc:287] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.005s
I20260709 12:59:42.053639  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:41.956281  6745 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.056118  6462 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.056442  6745 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.057708  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:42.058388  1572 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:42.059876  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 101654us
I20260709 12:59:42.060829  6702 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:42.061348  6702 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.061739  6702 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.062158  6733 consensus_queue.cc:1059] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:42.063824  6588 raft_consensus.cc:3055] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:42.064199  6588 raft_consensus.cc:740] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:42.064424  6448 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:42.064842  6448 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:42.002040  6735 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:42.065240  6448 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:42.065011  6750 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:42.065707  6735 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.066562  6750 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:41.929682  6592 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.060861  1575 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:42.053380  6617 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:59:42.090498  1575 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:42.022287  5964 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.109418  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:42.031442  6505 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.114269  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.106194  6745 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:42.124505  1575 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:42.127297  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.105887  5964 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:42.132591  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.133363  2461 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:42.134493  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.135053  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:42.065235  6588 consensus_queue.cc:260] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.136134  6588 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:42.118489  6505 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:42.138020  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:42.138676  2435 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:42.141327  6392 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:42.141851  6392 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:42.142288  6392 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:42.114508  6734 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.092617  6462 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:59:42.114367  6375 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:42.149597  1575 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:42.150032  1608 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 7.
I20260709 12:59:42.163178  1575 leader_election.cc:400] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Vote denied by peer 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) with higher term. Message: Invalid argument: T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:59:42.166016  1575 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:42.146464  6594 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.160420  6746 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:42.161612  6590 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:42.190569  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 55598.1us
I20260709 12:59:42.196345  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.174778  6643 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.190898  6344 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.190403  6466 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.217998  6756 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.218704  6592 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.218923  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.225867  6466 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.227439  6448 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.228271  6466 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.230626  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:42.213354  6343 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.236917  6343 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.218704  6756 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.238456  2339 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:42.239599  6693 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:42.240070  6693 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.240448  6693 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.240595  6756 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.241442  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:42.244956  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.246857  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.247582  1601 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:42.248370  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.249228  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.249071  6693 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.249971  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.250118  6643 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:42.251439  6693 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.251665  1527 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:42.252480  6702 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.255451  6594 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.252496  6505 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.257714  1526 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 15: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:42.258800  6505 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.261312  6735 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.263196  6439 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.263928  6521 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.251439  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.267941  1607 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 12:59:42.199157  6736 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:42.271327  6760 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.063s	user 0.000s	sys 0.002s
I20260709 12:59:42.272305  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.273399  6615 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:42.274148  6615 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:42.275137  6615 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.273013  6748 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.279459  6748 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.320672  1647 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.321992  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.286250  6448 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.330258  1677 raft_consensus.cc:2393] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 15: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:42.255505  6702 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.291529  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.299314  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.301141  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.337288  1674 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:42.301832  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:42.302873  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:42.311944  2435 raft_consensus.cc:2468] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:42.338053  1680 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:42.338179  1683 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:42.302999  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:42.324128  1575 leader_election.cc:400] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 6 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 6. Current term is 7.
I20260709 12:59:42.323930  6344 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:42.290603  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.346069  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.346717  1680 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.346843  1675 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:42.342480  2474 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:42.330506  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:42.336386  6736 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.342455  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.342724  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.343103  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.340476  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.343750  6590 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:42.352582  1607 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 14: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:42.350708  1647 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.353046  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.354621  2342 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.355386  1497 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.357134  1649 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.358110  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.310699  6392 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.362943  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.365906  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.367833  1647 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.362901  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.369220  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.369876  1608 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:42.372355  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.374634  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:42.376024  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:42.358265  6458 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:42.369625  6735 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.425704  6765 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:59:42.373314  6643 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:42.425782  6753 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:42.431072  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:42.438638  1680 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:42.431435  6736 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:42.432452  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.339491  6763 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
W20260709 12:59:42.427624  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 60323.5us
I20260709 12:59:42.446363  1607 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:42.369544  6590 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:42.427685  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 56973.5us
I20260709 12:59:42.430361  1532 raft_consensus.cc:1240] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:42.360419  6685 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.373520  6691 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:42.369364  6668 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:42.384650  6748 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:42.444269  1525 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 14: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:42.468114  2428 raft_consensus.cc:1240] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:42.468268  2342 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:42.438627  6766 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:59:42.444977  6753 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.451699  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.445957  6736 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.436822  1681 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.368597  5964 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.437888  6734 raft_consensus.cc:2804] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:42.466220  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.466852  1500 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:42.471896  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:42.472096  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 104365us
I20260709 12:59:42.470456  2423 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:42.468565  1497 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.483680  1647 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.481980  1527 raft_consensus.cc:2368] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 15. Current term is 16.
I20260709 12:59:42.485989  1529 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:42.482455  1609 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:42.492848  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.493033  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.483439  1607 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:42.493784  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.496663  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.494417  1601 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:42.496588  6615 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.501849  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.502456  1607 raft_consensus.cc:3060] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.502733  6448 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.503302  6448 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.497713  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.463966  6668 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.501766  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.508745  1678 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:59:42.509202  1600 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:42.506089  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.507501  6505 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.514788  1647 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.471683  6748 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.508047  1604 raft_consensus.cc:2410] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:42.477303  6736 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:42.507858  6615 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.518539  6448 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.480213  6527 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:42.506119  6702 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:42.497079  6751 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:42.525817  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.538872  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:42.510643  6767 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:59:42.528030  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:42.528860  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.545584  1609 raft_consensus.cc:2393] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:42.545723  6770 raft_consensus.cc:2764] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:59:42.546126  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.546643  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.547300  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.547881  1606 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:42.548051  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.549044  1609 raft_consensus.cc:2393] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 14: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:42.538338  1647 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.551326  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.552807  1647 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.554315  6765 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.555099  6765 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.560093  6392 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.561079  6392 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:42.561616  6392 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.562063  6392 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.562592  6763 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.563345  6763 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:42.563694  6763 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.564044  6763 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:42.565878  6702 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.568095  6702 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.570951  6751 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:42.571420  1607 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:42.572350  6751 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.524595  6748 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:42.575202  5964 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.575837  5964 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.577759  6590 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.512104  6668 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:42.579077  6685 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.579591  1602 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:42.581077  6753 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.476293  6439 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:59:42.585935  6643 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:42.586119  6448 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:42.586796  6643 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:42.541990  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:42.588657  1532 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:42.588124  6643 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.592115  6521 raft_consensus.cc:3055] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:42.592566  6521 raft_consensus.cc:740] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:42.544178  6772 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:59:42.523195  6734 raft_consensus.cc:697] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:42.595626  6734 consensus_queue.cc:237] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.603277  6638 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:42.603927  6638 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.606580  6458 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:42.607097  6458 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:42.617940  6439 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.618664  6439 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.619752  6615 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.593387  6521 consensus_queue.cc:260] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.622304  6466 consensus_queue.cc:1059] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:42.628177  6521 raft_consensus.cc:3060] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:42.633234  6638 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.634222  1532 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:42.635130  1681 raft_consensus.cc:2468] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:42.643056  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:42.650135  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:42.651448  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.540321  1674 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:42.650156  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.646366  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.653864  2455 raft_consensus.cc:2393] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 12:59:42.657030  2342 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.658548  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.661710  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.663717  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.666486  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.667718  1607 raft_consensus.cc:1275] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:42.667065  2342 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:42.683689  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:42.659521  6685 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:42.708446  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:42.711565  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 223573us
I20260709 12:59:42.713932  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:42.714484  1527 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:42.656792  6458 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.674101  6765 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.717759  1497 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.685775  6527 raft_consensus.cc:2804] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:42.674777  6756 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:59:42.711782  6685 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.682405  6691 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.737387  1532 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 15. Current term is 16. Ops: []
W20260709 12:59:42.738318  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 185583us
I20260709 12:59:42.739856  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.740988  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:42.746289  1647 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:42.747949  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.731737  6343 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:42.721056  6344 consensus_queue.cc:1059] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:59:42.715750  6763 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.776254  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:42.759734  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:42.737373  6685 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:42.766482  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.767930  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.792742  1575 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.767403  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:42.801066  6643 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:42.753579  6770 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:42.794441  6746 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:42.812553  6458 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.786991  6439 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:42.752736  6527 raft_consensus.cc:697] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:42.818718  6527 consensus_queue.cc:237] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.824110  6763 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.795136  6343 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:42.827735  6343 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.755614  6735 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:42.830622  6735 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:42.831167  6735 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:42.758904  5964 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:42.770242  6748 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.772692  6765 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:42.836645  6748 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.786618  6668 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.840960  6668 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.842190  6536 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:42.843442  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50814.5us
I20260709 12:59:42.843048  6536 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.843564  6759 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.845727  6746 raft_consensus.cc:3055] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:42.846113  6746 raft_consensus.cc:740] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:42.846999  6746 consensus_queue.cc:260] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.848109  6638 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:59:42.850414  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 170076us
I20260709 12:59:42.853086  1527 raft_consensus.cc:2468] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:42.854317  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.855556  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.868209  1600 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:42.756253  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.766120  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555751dc108841d481db7da6ccbf13d5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.865227  1498 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.866839  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:42.867434  1606 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:42.882079  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.882824  1679 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:42.882156  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.884608  1531 raft_consensus.cc:1240] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:59:42.885334  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 130045us
I20260709 12:59:42.885426  2342 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.885437  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.886129  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.881309  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:42.881326  1680 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:42.893468  1498 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.885901  1649 leader_election.cc:400] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 15. Current term is 16.
I20260709 12:59:42.900545  1649 leader_election.cc:403] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:59:42.891148  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:42.905015  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:42.907639  1498 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:42.910072  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:42.854472  6668 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:42.848155  6746 raft_consensus.cc:3060] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:42.915632  1498 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:42.910321  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00f4dc45e904f49a3231fc0c487b88d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:42.913004  6668 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.914024  6458 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:42.923239  6668 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:42.923686  6458 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.914181  6590 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:42.927138  6505 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:42.927634  6505 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.927996  6505 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.904889  6375 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:42.929983  6375 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.930424  6375 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:42.889897  6537 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:42.938759  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 57281.6us
I20260709 12:59:42.888217  6392 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.897747  6439 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.905833  5964 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:42.898483  6773 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:42.952205  6691 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:42.948199  6521 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:42.958163  6521 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:42.962903  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.966667  6592 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:42.967217  6592 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 12:59:42.968245  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 77412.7us
I20260709 12:59:42.968089  6592 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:42.948364  6736 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:42.971659  6736 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:42.972210  1677 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:42.897892  6757 consensus_queue.cc:1048] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:59:42.969311  6592 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:42.949069  1649 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:42.980484  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.981361  1606 raft_consensus.cc:2368] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 13. Current term is 14.
I20260709 12:59:42.989480  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:42.997589  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:43.000283  1604 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:43.003199  2339 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:43.003243  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:43.005405  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:43.005810  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 56850.5us
I20260709 12:59:43.009774  6773 raft_consensus.cc:2804] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:43.010311  6773 raft_consensus.cc:697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:43.011312  6773 consensus_queue.cc:237] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:43.013914  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:43.014768  6439 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:43.018405  1600 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 16.
I20260709 12:59:43.019034  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:43.022697  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:42.966894  6521 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:43.024492  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:43.027431  1527 raft_consensus.cc:2368] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:43.025357  1675 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:43.038225  1675 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:43.023073  1572 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:43.006081  2455 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:43.026664  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:43.002873  6736 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:43.057812  1609 raft_consensus.cc:2410] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:59:43.075418  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 55628.7us
I20260709 12:59:43.078214  1607 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:43.054605  6691 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:43.060454  6746 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:43.086670  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 44149.1us
I20260709 12:59:43.074643  6536 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:43.056120  6375 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.095932  5964 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.073407  6736 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:43.114091  6782 log.cc:927] Time spent T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:59:43.119370  2451 raft_consensus.cc:2955] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:43.128681  1677 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:43.132148  6392 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:43.142313  6375 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:43.195021  1679 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 16.
I20260709 12:59:43.203735  1498 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:43.206178  1498 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:43.207376  1498 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:43.208166  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:43.208781  1607 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:43.209883  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:43.210501  1600 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:43.211938  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:43.212904  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 125284us
I20260709 12:59:43.213680  1572 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:43.198314  6763 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 15. Current term is 16.
I20260709 12:59:43.128293  5964 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:43.219532  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:43.209124  6458 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:43.228410  6527 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.210841  6343 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:43.229079  6527 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.232256  6527 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:43.212687  6521 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:43.220991  6792 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:43.213189  6685 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.233618  6521 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:43.237823  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:43.241133  1600 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:43.242388  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:43.243211  1527 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:43.245126  1600 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:43.245433  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:43.249104  1606 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:43.249997  1529 raft_consensus.cc:2368] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13.
I20260709 12:59:43.251519  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:43.254233  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:43.254873  1602 raft_consensus.cc:2468] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 7.
I20260709 12:59:43.257117  1607 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:43.217437  6505 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:43.252969  1498 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:43.268085  1527 raft_consensus.cc:2468] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
I20260709 12:59:43.276772  1532 raft_consensus.cc:2368] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 13. Current term is 14.
I20260709 12:59:43.268710  6343 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:59:43.278426  6685 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:43.279235  6736 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:43.280192  6505 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:43.283967  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:43.284564  1603 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:43.285760  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:43.286363  1604 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:43.290150  6521 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:43.282575  6785 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:43.294953  6785 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:43.296023  6785 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:43.296921  1604 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:43.302356  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:43.301290  1575 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:43.303076  2451 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:43.253352  6735 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.309815  2475 raft_consensus.cc:1240] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:43.318614  1603 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:43.314100  6731 raft_consensus.cc:2804] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:43.343276  1675 raft_consensus.cc:1240] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:43.306193  6757 consensus_queue.cc:1059] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:59:43.347370  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:43.349213  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:43.351357  2451 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 13.
I20260709 12:59:43.352695  1500 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:43.361119  1647 leader_election.cc:400] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 13. Current term is 14.
I20260709 12:59:43.361485  1647 leader_election.cc:403] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:59:43.362548  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:43.369233  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:43.370222  1604 raft_consensus.cc:2368] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:43.354375  6731 raft_consensus.cc:697] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:43.379004  6731 consensus_queue.cc:237] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.379923  6392 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:43.380592  6392 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:43.381696  5964 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:43.379189  6791 consensus_queue.cc:1059] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:59:43.364148  6773 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 13. Current term is 14.
I20260709 12:59:43.383419  1575 leader_election.cc:400] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13.
I20260709 12:59:43.385494  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:43.385748  1575 leader_election.cc:403] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:43.357306  6375 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:43.386314  1604 raft_consensus.cc:2368] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 14. Current term is 15.
I20260709 12:59:43.387574  6791 raft_consensus.cc:3055] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:43.366163  6736 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:43.365069  6765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34852 (request call id 2) took 2016 ms. Trace:
W20260709 12:59:43.473708  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 77950.8us
I20260709 12:59:43.474957  2339 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:43.396920  6791 raft_consensus.cc:740] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:43.470228  6795 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13.
I20260709 12:59:43.495431  6791 consensus_queue.cc:260] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.496994  6791 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:43.500946  6735 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:43.502610  6757 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.469286  6765 rpcz_store.cc:276] 0709 12:59:41.328752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.337574 (+  8822us) service_pool.cc:224] Handling call
0709 12:59:41.713508 (+375934us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b2c00000658. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d0291a11 00007f25d02a0a0a 00007f25d02a0693 00007f25d02a0631 00007f25d19d33f1 00007f25d190c9fe 00007f25d1993749 00007f25d199476a 00007f25d199391b 00007f25d199f03c 00007f25d199e6b3
0709 12:59:41.715769 (+  2261us) log.cc:844] Serialized 501 byte log entry
0709 12:59:41.884237 (+168468us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18004022e0. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce8ab3f3 00007f25ce8ad7c1 00007f25ce8ad779 00007f25ce8ad709 00007f25ce8ad6d1 00007f25ce8ac9cd 000000000038f354 000000000038f199 00007f25ce88e83a
0709 12:59:42.049920 (+165683us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b24001156b8. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7319c4 00007f25ce72facb 00007f25ce8eadc9 00007f25ce8eaa55 00007f25ce8ea09d 00007f25d151c10e 00007f25d153388c 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221
0709 12:59:43.344709 (+1294789us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5105,"raft.queue_time_us":12395,"raft.run_cpu_time_us":1747,"raft.run_wall_time_us":56623,"spinlock_wait_cycles":69407616,"thread_start_us":68195,"threads_started":1,"wal-append.queue_time_us":103123,"wal-append.run_cpu_time_us":6105,"wal-append.run_wall_time_us":1228568}
I20260709 12:59:43.381660  6392 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:43.542176  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 149340us
I20260709 12:59:43.570132  1647 leader_election.cc:400] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:43.570748  1647 leader_election.cc:403] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:59:43.571513  6735 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:43.571779  1647 leader_election.cc:400] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 14. Current term is 15.
I20260709 12:59:43.572124  1647 leader_election.cc:403] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:59:43.572719  6735 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 14. Current term is 15.
I20260709 12:59:43.573900  1681 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:43.600369   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:43.726132  1608 raft_consensus.cc:1275] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:43.716599  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:43.735945  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.739166  6802 log.cc:927] Time spent T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:59:43.736696  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:43.728657  6735 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:43.752703  6735 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:43.755203  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 118360us
I20260709 12:59:43.763106  6592 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:59:43.777351  6735 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:43.777941  6797 log.cc:927] Time spent T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.436s	user 0.008s	sys 0.003s
I20260709 12:59:43.782801  6756 consensus_queue.cc:1048] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:59:43.821990  6787 log.cc:927] Time spent T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.727s	user 0.006s	sys 0.006s
I20260709 12:59:43.823618  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:43.830638  6537 raft_consensus.cc:3055] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:43.831212  6537 raft_consensus.cc:740] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:43.832083  6537 consensus_queue.cc:260] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.833094  6537 raft_consensus.cc:3060] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:43.833417  1678 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:43.834350  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:43.835127  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:43.835425  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:43.835861  1681 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:43.843585  1649 leader_election.cc:400] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 10. Current term is 11.
I20260709 12:59:43.846771  6753 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:43.848960  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:43.850080  2475 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:43.851071  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:43.853216  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:43.853816  2428 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 16.
I20260709 12:59:43.854333  2451 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:43.872710  6812 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.877671  6735 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:43.880370  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 527711us
I20260709 12:59:43.880640  1649 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:43.882097  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34406 (request call id 1079) took 1064 ms. Trace:
I20260709 12:59:43.891768  6736 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:43.882566  1534 rpcz_store.cc:276] 0709 12:59:42.810440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.810563 (+   123us) service_pool.cc:224] Handling call
0709 12:59:42.810960 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:43.039638 (+228678us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:43.208152 (+168514us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.340018 (+131866us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:43.345079 (+  5061us) log.cc:844] Serialized 52 byte log entry
0709 12:59:43.345247 (+   168us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:43.345466 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.874724 (+529258us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180028f420. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce825c0a 00007f25d7f65219 00007f25ce8ada40 00007f25ce8a84e4 00007f25ce8a8455 00007f25d1990060 00007f25d19a2716 00007f25d19b3287 00007f25d19b3208
0709 12:59:43.874897 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.874976 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.875105 (+   129us) raft_consensus.cc:1685] finished
0709 12:59:43.875125 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.875270 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1265,"prepare.queue_time_us":208533,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":6294,"raft.queue_time_us":552404,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":2821,"spinlock_wait_cycles":6093184,"thread_start_us":451235,"threads_started":3,"wal-append.queue_time_us":147602}
I20260709 12:59:43.889822  6668 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:43.900246  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:43.902848  1419 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:43.903313  6736 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:43.903793  6736 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:43.903601  6392 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:43.904177  6736 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:43.873301  6812 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.920934  6668 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:43.950138  1602 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:43.951812  6392 consensus_queue.cc:1059] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:43.952672  6392 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:43.953022  6392 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:43.953869  6392 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:43.955097  6392 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:43.936378  6537 consensus_queue.cc:1059] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:59:43.957756  6777 raft_consensus.cc:3055] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:43.958214  6777 raft_consensus.cc:740] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:43.958011  6668 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.937191  6736 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.964581  6736 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:43.965531  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:43.966583  6812 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:43.953341  6781 log.cc:927] Time spent T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.866s	user 0.000s	sys 0.014s
I20260709 12:59:43.972505  6817 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:43.973222  6817 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:43.975558  6817 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:43.984572  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:43.992061  1531 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:43.996150  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:44.001274  6617 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.001914  6617 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.004089  6617 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:44.005888  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:44.010219  1679 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
I20260709 12:59:44.007943  6777 consensus_queue.cc:260] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:44.012516  6777 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:44.015561  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:44.016163  1675 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:44.018664  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:44.019683  1531 raft_consensus.cc:2410] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:59:44.037125  6733 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:44.037663  6733 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.038039  6733 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:44.054922  1680 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:44.062572  6733 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.065951  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:44.066622  1682 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:44.068537  1649 leader_election.cc:400] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Vote denied by peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197) with higher term. Message: Invalid argument: T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 13. Current term is 14.
I20260709 12:59:44.070744  2455 pending_rounds.cc:85] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 10
I20260709 12:59:44.071072  2455 pending_rounds.cc:107] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:59:44.071362  2455 raft_consensus.cc:2889] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.074824  1497 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:44.075238  6668 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.075816  6668 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:44.078788  6668 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:44.077538  2451 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 16.
I20260709 12:59:44.095721  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:44.096853  6735 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:44.100968  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:44.120373  1527 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:44.111331  1497 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:44.105317  1682 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 16.
I20260709 12:59:44.128793  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:44.129401  1533 raft_consensus.cc:3060] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:44.129748  1607 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:44.130581  6733 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:44.126905  1572 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:44.132946  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:44.139114  1607 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:44.140553  1527 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:44.097790  6735 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 16 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:44.156963  1529 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:44.146310  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:44.145277  1527 raft_consensus.cc:1275] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
W20260709 12:59:44.146967  2342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.147781  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:44.161273  1527 pending_rounds.cc:85] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 11
I20260709 12:59:44.161739  1527 pending_rounds.cc:107] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:59:44.162127  1527 raft_consensus.cc:2889] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.122548  6748 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:44.168864  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:44.170251  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:44.173019  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:44.174321  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:44.134042  6817 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.175580  1498 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:44.142935  6521 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:44.143888  6617 raft_consensus.cc:2804] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:44.178922  1529 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 16: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:44.180944  6466 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:44.183408  1603 raft_consensus.cc:1240] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:59:44.185417  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:44.187589  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:44.182097  2344 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:44.144626  6765 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:59:44.154752  6343 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:59:44.178671  6748 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:44.223992  1428 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.229662  1428 catalog_manager.cc:5697] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
W20260709 12:59:44.230312  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48362.5us
I20260709 12:59:44.231352  1428 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 11, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 11 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.232277  6343 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:44.232971  1428 catalog_manager.cc:5697] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
W20260709 12:59:44.234076  1429 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 319) took 33210 ms (client timeout 15000 ms). Trace:
I20260709 12:59:44.234766  6343 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:44.234265  1428 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:44.196029  6625 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:44.236877  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:44.192315  6772 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:59:44.227149  6785 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:44.237921  6617 raft_consensus.cc:697] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:44.250917  6617 consensus_queue.cc:237] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.255645  6785 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.222581  6736 consensus_queue.cc:1048] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:59:44.240115  1428 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 12, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.261250  1428 catalog_manager.cc:5697] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 10, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.264755  1533 raft_consensus.cc:2468] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 16.
I20260709 12:59:44.267370  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:44.234591  1429 rpcz_store.cc:269] 0709 12:59:11.024288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.024534 (+   246us) service_pool.cc:224] Handling call
0709 12:59:44.233986 (+33209452us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:42.378610 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:42.431253 (+ 52643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:42.431400 (+   147us) write_op.cc:435] Acquired schema lock
0709 12:59:42.431421 (+    21us) tablet.cc:662] Decoding operations
0709 12:59:42.432422 (+  1001us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:42.432523 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:42.432552 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:59:42.433403 (+   851us) tablet.cc:701] Row locks acquired
0709 12:59:42.433450 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:59:42.433634 (+   184us) write_op.cc:270] Start()
0709 12:59:42.433784 (+   150us) write_op.cc:276] Timestamp: P: 1783601982433545 usec, L: 0
0709 12:59:42.433823 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:59:42.434500 (+   677us) log.cc:844] Serialized 3611 byte log entry
0709 12:59:42.953374 (+518874us) op_driver.cc:464] REPLICATION: finished
0709 12:59:43.130165 (+176791us) write_op.cc:301] APPLY: starting
0709 12:59:43.150166 (+ 20001us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:43.505748 (+355582us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:43.505906 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:43.611451 (+105545us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:43.740763 (+129312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:59:43.740877 (+   114us) write_op.cc:312] APPLY: finished
0709 12:59:43.741348 (+   471us) log.cc:844] Serialized 89 byte log entry
0709 12:59:43.741587 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:43.746542 (+  4955us) write_op.cc:454] Released schema lock
0709 12:59:43.752278 (+  5736us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:43.752867 (+   589us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:43.752911 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3196951,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":136379,"apply.run_cpu_time_us":19155,"apply.run_wall_time_us":647841,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":372907,"prepare.run_cpu_time_us":165520,"prepare.run_wall_time_us":286748,"raft.queue_time_us":183911,"raft.run_cpu_time_us":7891,"raft.run_wall_time_us":99749,"replication_time_us":519376,"thread_start_us":676748,"threads_started":4,"wal-append.queue_time_us":275488}]]}
I20260709 12:59:44.268193  1609 raft_consensus.cc:2393] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 15: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:44.249770  6458 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:44.270153  6702 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:44.241808  6735 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:44.315923  1428 catalog_manager.cc:5697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 12, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.304222  6785 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:44.305871  6748 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.314994  6466 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:44.352741  1428 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:44.356681  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 168477us
I20260709 12:59:44.358078  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:44.366317  1428 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 9, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:44.377996  1428 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.379050  1609 raft_consensus.cc:1275] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:59:44.379968  1609 pending_rounds.cc:85] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Aborting all ops after (but not including) 5
I20260709 12:59:44.380584  1609 pending_rounds.cc:107] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:59:44.380859  1609 raft_consensus.cc:2889] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.391974  1680 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:44.391898  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:44.392828  1679 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:44.392915  1676 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:44.364375  6829 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:44.401918  1428 catalog_manager.cc:5697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 14, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.394271  6588 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:44.401296  6763 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:44.388645  6466 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.415140  6772 consensus_queue.cc:1048] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:59:44.538486  2475 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:44.468528  1609 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:44.482322  1525 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
W20260709 12:59:44.508904  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 115110us
I20260709 12:59:44.546300  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:44.546146  1428 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 12, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 12 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.556314  6736 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:44.572657  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:44.579252  1428 catalog_manager.cc:5697] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.581415  1609 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:44.455858  6588 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:44.603576  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 55820.3us
I20260709 12:59:44.586686  6792 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:44.644385  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 92456.8us
I20260709 12:59:44.583408  6817 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:59:44.609395  6828 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:44.557161  6763 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:44.647378  1428 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:44.658562  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 47457.5us
I20260709 12:59:44.609721  6765 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:59:44.672712  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 100137us
I20260709 12:59:44.674504  1649 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:44.632303  6829 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:59:44.676020  6736 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:44.658847  6828 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:44.703985  6828 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:44.708666  6763 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:44.678238  1428 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 12, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 12 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.710429  1428 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 9, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:44.712020  1428 catalog_manager.cc:5697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 6, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.721527  6588 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:44.713311  1428 catalog_manager.cc:5697] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:59:44.723414  6835 log.cc:927] Time spent T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:44.723161  1428 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.725266  1428 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 9, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:44.666599  6772 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.727042  1428 catalog_manager.cc:5697] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 12, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.727964  6772 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.728467  1428 catalog_manager.cc:5697] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 10, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.730494  6772 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:44.730644  6748 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:44.720885  6828 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.734597  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:44.757541  1683 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:59:44.743754  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 94654us
I20260709 12:59:44.647552  6792 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.786655  6753 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:44.686007  6736 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:44.801240  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 115130us
I20260709 12:59:44.800266  6536 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:44.730204  1428 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 9, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:44.821094  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:44.824885  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:44.825507  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:44.828287  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 243131us
I20260709 12:59:44.816129  6736 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:44.834502  1428 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 10, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:44.830139  6761 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.848361  6828 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:44.820626  6536 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.856145  6536 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:44.862829  6792 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:44.812064  6466 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:59:44.871686  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:44.872372  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:44.888993  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 50279us
I20260709 12:59:44.871868  1428 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 10, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:44.902418  1525 raft_consensus.cc:1275] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:44.891063  1428 catalog_manager.cc:5697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 12, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:44.879581  6375 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.955809  6375 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:44.957854  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:44.892081  6761 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:44.960906  6761 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:44.967969  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 97713.4us
W20260709 12:59:44.969904  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 79926.1us
I20260709 12:59:44.971097  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:44.972265  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:44.965672  6375 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:44.996909  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 97508.6us
I20260709 12:59:45.002542  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:44.996974  1428 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:45.003404  1677 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
W20260709 12:59:45.110273  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 167752us
W20260709 12:59:45.114454  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 84102.3us
I20260709 12:59:45.090952  1528 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:45.118635  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:45.120417  6343 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.121083  6731 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:45.121042  6343 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:45.121697  6731 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.122126  6731 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:45.130007  6590 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.130627  6590 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:45.133297  6590 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:45.136173  1428 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 9, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:45.137912  1428 catalog_manager.cc:5697] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 9, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:45.148252  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:45.149013  1678 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
I20260709 12:59:45.167264  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:45.169315  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:45.169763  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:45.170903  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:45.205281  1679 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:59:45.221393  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 319924us
I20260709 12:59:45.182132  6861 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:45.229185  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:45.208426  6839 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:45.301272   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:45.308408  1606 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:45.314947  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:45.315625  1607 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:45.234524  6861 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.318836  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:45.321743  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 113796us
I20260709 12:59:45.322633  1678 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:45.328368  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:45.330427  1497 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:45.335319  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:45.335731  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:45.336515  1525 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
I20260709 12:59:45.338083  6849 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:45.336644  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:45.337503  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:45.226902  6785 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:59:45.226418  6772 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:59:45.332226  6861 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:45.344545  6748 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:45.426017  6792 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:45.438750  6748 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:45.459470  6392 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:45.553284  6865 log.cc:927] Time spent T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 12:59:45.555693  6860 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:59:45.569972  6748 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:45.466557  6792 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:45.584034  6792 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:45.474298  6392 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:45.599354  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 271178us
I20260709 12:59:45.616413  6588 consensus_queue.cc:1048] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:45.617012  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:45.598023  6870 log.cc:927] Time spent T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 12:59:45.659673  6881 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.662911  6731 consensus_meta.cc:287] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.002s
I20260709 12:59:45.659202  6344 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:45.695291  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 156940us
I20260709 12:59:45.669529  6392 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:45.696981  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 366618us
I20260709 12:59:45.709489  1575 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:45.710927  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 84026.4us
I20260709 12:59:45.670444  6881 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:45.709946  6736 consensus_meta.cc:287] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.864s	user 0.011s	sys 0.002s
I20260709 12:59:45.694459  6731 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:45.718940  1601 raft_consensus.cc:2368] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 15. Current term is 16.
I20260709 12:59:45.720028  6731 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:45.707041  6854 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:45.721946  6854 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:45.724153  6854 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:45.726622  6869 log.cc:927] Time spent T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 12:59:45.730158  1498 leader_election.cc:400] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Vote denied by peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057) with higher term. Message: Invalid argument: T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 15. Current term is 16.
I20260709 12:59:45.731235  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:45.715245  6887 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.734956  6887 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:45.740463  1575 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:45.741740  6855 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.742272  6833 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:45.743561  2342 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:45.747129  6527 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:45.744305  6855 raft_consensus.cc:2749] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:45.747716  6527 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.750051  6527 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:45.737272  6887 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:45.756897  6881 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:45.758558  6736 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:45.766460  6864 log.cc:927] Time spent T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.433s	user 0.000s	sys 0.002s
I20260709 12:59:45.709810  6861 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:45.770525  1604 raft_consensus.cc:1240] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:45.771596  6861 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:45.784595  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:45.784689  6855 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:45.785673  6855 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:45.794486  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:45.803653  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:45.804453  1601 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:45.805022  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:45.807091  2451 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:45.808314  1647 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:45.808830  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:45.804222  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:45.810559  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:45.817631  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:45.819980  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:45.821630  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:45.761432  6736 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:45.832109  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:45.833209  1600 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:45.813374  6625 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.858922  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:45.823482  6881 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:45.835299  6748 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:45.938514  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 111372us
W20260709 12:59:45.938987  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 62018.9us
I20260709 12:59:45.859193  6795 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:45.965399  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:45.979192  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:45.876184  6736 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:45.877998  6881 raft_consensus.cc:493] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:45.974900  1647 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:46.038053  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 63209.8us
W20260709 12:59:46.059124  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 77446.8us
I20260709 12:59:46.064028  1675 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:46.063361  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:45.878616  6625 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:45.984604  6839 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:45.984851  6859 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:46.034467  6881 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:46.095986  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 281020us
W20260709 12:59:46.091604  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 232723us
I20260709 12:59:46.105947  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:46.106989  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:46.060477  6855 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:45.996574  6795 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.088424  6736 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.115599  6736 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.117396  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:46.118045  1676 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:46.119849  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:45.995996  6748 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.122175  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:46.124210  6743 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:46.124883  6885 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:46.125383  6885 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.125744  6885 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:46.127311  6748 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.131819  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:46.134234  6859 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:46.134826  6859 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:46.137003  6859 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:45.941175  6844 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.145s
I20260709 12:59:46.140535  2451 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:46.146486  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:46.147430  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:46.176440  1682 raft_consensus.cc:2393] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 14: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:46.165728  6839 raft_consensus.cc:493] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.149410  6439 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:46.182916  6863 log.cc:927] Time spent T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:59:46.198938  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 159550us
I20260709 12:59:46.097855  6527 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.236268  2455 raft_consensus.cc:2368] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 for earlier term 14. Current term is 15.
W20260709 12:59:46.237138  6904 log.cc:927] Time spent T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:59:46.240996  1708 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:38115 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:38115 timed out after 15.000s (SENT)
I20260709 12:59:46.214463  6887 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.180480  6839 raft_consensus.cc:515] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:46.260737  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 81116.5us
I20260709 12:59:46.237457  6911 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:46.211457  6439 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.241462  6343 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:46.344506  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 80749.3us
W20260709 12:59:46.356669  6915 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:46.356974  6625 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:46.358891  6839 leader_election.cc:290] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.358691  6881 raft_consensus.cc:515] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.359499  1527 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:46.360394  6912 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.359521  6839 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:46.360962  6912 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.303086  6887 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.363253  6912 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.363801  6887 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.351980  6911 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.361490  6839 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:46.361253  6881 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.416657  1605 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 15. Current term is 16. Ops: []
W20260709 12:59:46.417325  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 165721us
I20260709 12:59:46.418150  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:46.421763  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:46.365366  6527 leader_election.cc:290] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:46.380630  6911 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:46.375602  6887 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.513018  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:46.632237  6887 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.635421  6887 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.554435  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:46.639112  2474 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 16.
I20260709 12:59:46.424906  6912 raft_consensus.cc:493] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.641063  6921 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.640946  6912 raft_consensus.cc:515] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.641801  6921 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.643757  6912 leader_election.cc:290] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.644407  6921 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:46.491586  6625 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:46.646539  6625 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:46.560401  6882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.011s	sys 0.025s
I20260709 12:59:46.604374  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:46.649109  1682 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
W20260709 12:59:46.621090  6920 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:59:46.621698  6903 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 12:59:46.623656  6839 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:46.502449  6439 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.491941  6537 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:46.712536  6882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.012s	sys 0.025s
W20260709 12:59:46.756357  1676 consensus_meta.cc:287] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.638s	user 0.013s	sys 0.000s
I20260709 12:59:46.757635  1676 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 16.
W20260709 12:59:46.755318  6857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.074s	sys 0.098s
I20260709 12:59:46.738027  6912 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:46.771258  6857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.074s	sys 0.098s
I20260709 12:59:46.788590  1677 raft_consensus.cc:1240] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 15. Current term is 16. Ops: []
W20260709 12:59:46.780581  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 64763us
I20260709 12:59:46.759704  6343 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:46.760633  6867 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:46.805676  6785 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.065s	sys 0.160s
I20260709 12:59:46.773876  6839 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.744674  6537 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.774737  6344 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:46.775344  6922 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:46.774405  6736 raft_consensus.cc:493] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.780038  6392 raft_consensus.cc:493] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.778610  6887 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:46.811539  6785 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.065s	sys 0.160s
I20260709 12:59:46.823660  6908 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.824119  6926 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.823841  6392 raft_consensus.cc:515] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.823724  6736 raft_consensus.cc:515] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.833359  6392 leader_election.cc:290] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.834367  6736 leader_election.cc:290] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.842168  1498 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:46.813408  6857 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:46.831857  6926 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.842510  6625 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:46.809827  6808 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:46.788894  6912 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:46.814616  6343 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:46.890704  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48609.9us
I20260709 12:59:46.816702  6867 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.818006  6839 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.891623  6808 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:46.823376  6344 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.851822  6794 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:46.907660  2343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.016s	sys 0.064s
W20260709 12:59:46.908715  2343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.016s	sys 0.065s
I20260709 12:59:46.892995  6924 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:46.855127  6887 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:46.915269  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 154854us
I20260709 12:59:46.844679  6908 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.855329  6857 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:46.921875  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 147349us
I20260709 12:59:46.925426  6929 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:46.926218  6929 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:46.929814  6929 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:46.930388  6940 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.931218  6940 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.853202  6922 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.911715  6537 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:46.915411  6392 raft_consensus.cc:493] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.960610  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:46.961609  1600 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:46.962711  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:46.963521  1606 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:46.969961  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:46.973290  6343 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:46.977005  6908 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.978096  6929 raft_consensus.cc:493] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:46.978701  6929 raft_consensus.cc:515] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.979245  6922 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.979382  6344 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.980899  6929 leader_election.cc:290] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.981011  6932 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:46.981673  6932 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:46.984932  6867 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:46.955029  6392 raft_consensus.cc:515] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:46.987023  6926 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.987679  6392 leader_election.cc:290] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.988359  6857 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.987994  6936 consensus_queue.cc:1059] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:46.989457  6936 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:46.911144  6794 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:46.989816  6936 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:46.991505  6839 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:46.991098  6936 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:46.989652  6808 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:46.992720  6912 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:46.998759  6894 log.cc:927] Time spent T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 1.255s	user 0.018s	sys 0.011s
I20260709 12:59:47.005995  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38994 (request call id 2407) took 2166 ms. Trace:
I20260709 12:59:47.004649  6936 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:47.006431  1683 rpcz_store.cc:276] 0709 12:59:44.839987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.840099 (+   112us) service_pool.cc:224] Handling call
0709 12:59:44.840432 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.840772 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.840800 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.848100 (+  7300us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.574984 (+726884us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b18003d9e40. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d7773de1 00007f25d77805b1 00007f25ce88de07 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b 00007f25d1537d23 00007f25d15380d1 00007f25d1953a0f
0709 12:59:45.691816 (+116832us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:45.707514 (+ 15698us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.714012 (+  6498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.717722 (+  3710us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.997939 (+1280217us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:47.005773 (+  7834us) raft_consensus.cc:1685] finished
0709 12:59:47.005798 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.005920 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6152,"prepare.queue_time_us":15315,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":6396,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":5980,"spinlock_wait_cycles":76758272,"thread_start_us":116623,"threads_started":1,"wal-append.queue_time_us":868413}
I20260709 12:59:47.008355  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.008586  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:47.008927  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.009473  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.010071  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.000075  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:46.989856  6887 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:47.015091  6885 consensus_meta.cc:287] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: Time spent flushing consensus metadata: real 0.889s	user 0.007s	sys 0.003s
I20260709 12:59:47.015587  6885 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.016638  1678 raft_consensus.cc:2368] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13.
I20260709 12:59:47.017653  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.020704  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:47.021278  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.021870  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.023134  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c02c60c1a5490183c0690cd8c98176" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.023833  6924 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:47.024581  6795 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.024684  1525 raft_consensus.cc:1240] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Rejecting Update request from peer fc6fbca2eb8d4bec997c51003e277180 for earlier term 13. Current term is 14. Ops: []
W20260709 12:59:47.032230  6893 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 1.298s	user 0.021s	sys 0.033s
I20260709 12:59:46.991505  6794 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:47.036104  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.037911  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.038861  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.043066  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.047123  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.041483  1606 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 15.
I20260709 12:59:47.050033  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.041129  2342 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:47.037259  1601 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:47.052983  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.056023  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:46.983973  6932 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:47.060389  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.063014  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7340b50d876f414287d4fe7df22e3248" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.063628  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.064718  1649 leader_election.cc:304] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.065709  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.066938  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.068051  6772 raft_consensus.cc:2749] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:47.077180  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.081758  1649 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.021440  6885 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.088855  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:47.088778  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.092398  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.091540  1649 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:47.092523  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 140991us
I20260709 12:59:47.057754  6777 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:47.096544  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.095914  6772 raft_consensus.cc:2749] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:47.102125  6885 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:47.140513  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.101794  6777 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.147151  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.151649  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.156905  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.213052  1681 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:59:47.213450  1681 pending_rounds.cc:85] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: Aborting all ops after (but not including) 8
I20260709 12:59:47.152802  6777 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.214450  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.216361  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ee981b108d48998c03e57930745dce" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.217268  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ddaea2d1d945b78d8286cc74a41ff9" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.217535  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
W20260709 12:59:47.218076  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 59693.8us
I20260709 12:59:47.218518  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1760e23cca344b0a0ed3ed897bae95f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.218745  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.219694  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.224455  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.228211  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60884 (request call id 2327) took 1082 ms. Trace:
I20260709 12:59:47.228749  1527 rpcz_store.cc:276] 0709 12:59:46.146186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.147137 (+   951us) service_pool.cc:224] Handling call
0709 12:59:47.227946 (+1080809us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400198a54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:47.228099 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435826432}
I20260709 12:59:47.231631  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.232473  1530 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
W20260709 12:59:47.236299  6890 log.cc:927] Time spent T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 1.492s	user 0.005s	sys 0.032s
I20260709 12:59:47.162051  6938 consensus_queue.cc:1059] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:47.191537  6940 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.192116  6887 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.249212  6938 raft_consensus.cc:3055] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:47.249662  6938 raft_consensus.cc:740] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:47.249408  6887 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.250525  6938 consensus_queue.cc:260] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.252285  6938 raft_consensus.cc:3060] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:47.156628  6736 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.193801  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.146485  6772 raft_consensus.cc:493] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.253240  6736 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.195071  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.197615  1572 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.207628  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2696) took 1668 ms. Trace:
I20260709 12:59:47.209100  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.210990  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.253922  6772 raft_consensus.cc:515] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.255614  6736 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.255746  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.252492  6887 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.256644  6772 leader_election.cc:290] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.256870  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.211301  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.211655  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.257851  1682 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 9.
I20260709 12:59:47.258011  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 2695) took 1725 ms. Trace:
I20260709 12:59:47.258391  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.213690  1681 pending_rounds.cc:107] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:59:47.259456  1681 raft_consensus.cc:2889] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:47.238459  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.238755  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.239249  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.254544  1604 rpcz_store.cc:276] 0709 12:59:45.539161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.539272 (+   111us) service_pool.cc:224] Handling call
0709 12:59:45.549941 (+ 10669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.770923 (+220982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.207382 (+1436459us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54004065d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1998e01 00007f25d199783e 00007f25d695c419 00007f25cfed3bd4 00007f25cfed3b62 00007f25cfed3a91 00007f25cfed3a0c 00007f25cfed2cc2 00007f25cfcd348c 00007f25cfcd28c6
0709 12:59:47.207552 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506849664}
I20260709 12:59:47.258456  1603 rpcz_store.cc:276] 0709 12:59:45.532581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.533607 (+  1026us) service_pool.cc:224] Handling call
0709 12:59:45.533982 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.534339 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.534376 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.534852 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.687241 (+152389us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:45.687298 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.687370 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.234997 (+1547627us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25d153386e 00007f25d1532bb6 00007f25d15327d8 00007f25d153c221 00007f25d153c1d9 00007f25d153c169
0709 12:59:47.257721 (+ 22724us) raft_consensus.cc:1685] finished
0709 12:59:47.257747 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.257954 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1465,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":11609344,"thread_start_us":151932,"threads_started":1,"wal-append.queue_time_us":180502}
I20260709 12:59:47.262549  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:47.263127  1604 raft_consensus.cc:3060] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.262466  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.146727  6885 raft_consensus.cc:493] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.240522  6638 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:47.240804  2476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.241434  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.241499  2461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.250082  1500 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.241482  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.241851  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.242307  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:47.243031  6777 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.245007  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.248039  1497 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:47.268404  1679 raft_consensus.cc:3060] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:47.270579  2474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.271281  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.267066  6638 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.275803  2435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.269035  1609 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:47.280488  1500 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:47.285251  1500 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.286886  1500 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.266201  6885 raft_consensus.cc:515] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.291572  1604 raft_consensus.cc:2468] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
W20260709 12:59:47.294924  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 97405.8us
I20260709 12:59:47.296059  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.288275  6466 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:47.291549  6932 consensus_queue.cc:1059] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:59:47.298763  6932 raft_consensus.cc:3055] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:47.299139  6932 raft_consensus.cc:740] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:47.305087  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.307786  1497 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.308046  1575 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.292354  6829 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:47.294082  6924 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:47.314049  1679 raft_consensus.cc:2468] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 15.
I20260709 12:59:47.302100  6848 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:47.314170  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:47.320711  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.321362  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.321657  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.321991  1676 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
I20260709 12:59:47.325181  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.326050  1683 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:47.319697  6922 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:47.337076  6922 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:47.300367  6932 consensus_queue.cc:260] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.309638  6926 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:47.370585  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.314412  6829 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.309927  6930 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:47.337442  6922 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.319584  6466 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 12:59:47.390441  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 76354.6us
W20260709 12:59:47.392647  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 84664.3us
I20260709 12:59:47.353037  6617 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:59:47.392789  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 77229.2us
I20260709 12:59:47.396951  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.357005  6840 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:47.386382  6829 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.394035  6922 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:47.387776  6537 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:47.409675  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 110591us
I20260709 12:59:47.411609  1649 leader_election.cc:304] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.414944  1649 leader_election.cc:304] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.415197  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.407608  6932 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:47.419512  1649 leader_election.cc:304] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.422102  2342 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.423235  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.432444  1647 leader_election.cc:304] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.441639  1647 leader_election.cc:304] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.421051  6617 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:47.445339  6736 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:59:47.445477  6945 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:59:47.418962  6772 raft_consensus.cc:2749] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:47.418495  6537 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.402644  6466 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.437088  6887 raft_consensus.cc:2749] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:47.415040  6847 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:59:47.445550  6617 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.413784  6777 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:47.445839  6736 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:47.477541  6736 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.446219  6912 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:47.448170  6842 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:47.482538  6912 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.482842  6842 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.484560  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 1053) took 1665 ms. Trace:
I20260709 12:59:47.448406  6885 leader_election.cc:290] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.448082  6944 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.486514  6944 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:47.487967  2455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36908 (request call id 1052) took 1679 ms (client timeout 1961 ms). Trace:
I20260709 12:59:47.488617  6944 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:47.488408  2455 rpcz_store.cc:269] 0709 12:59:45.808343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.808456 (+   113us) service_pool.cc:224] Handling call
0709 12:59:47.487754 (+1679298us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54005267d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:47.487905 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970929024}
I20260709 12:59:47.450625  1572 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.455797  6763 raft_consensus.cc:2749] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.455587  6886 raft_consensus.cc:2749] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.484946  6912 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.467010  6867 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:47.495913  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 45391.3us
I20260709 12:59:47.497093  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.497614  6794 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:47.498111  6794 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:47.498509  6794 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.499440  6940 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:47.500286  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:47.501164  1609 raft_consensus.cc:2393] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 13: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:47.466459  6872 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:47.447429  6638 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:47.454136  6935 log.cc:927] Time spent T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:59:47.484949  2451 rpcz_store.cc:276] 0709 12:59:45.819453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.819635 (+   182us) service_pool.cc:224] Handling call
0709 12:59:47.484370 (+1664735us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b5400720e54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:47.484470 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734678400}
I20260709 12:59:47.507709  1572 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:47.513835  6931 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:47.514250  6931 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.514598  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
W20260709 12:59:47.512158  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38982 (request call id 2592) took 1410 ms (client timeout 1731 ms). Trace:
W20260709 12:59:47.466004  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 44011.4us
W20260709 12:59:47.515551  1678 rpcz_store.cc:269] 0709 12:59:46.102207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.105645 (+  3438us) service_pool.cc:224] Handling call
0709 12:59:47.511951 (+1406306us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54001c11d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:47.512080 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092477824}
I20260709 12:59:47.511067  6839 raft_consensus.cc:2749] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.517931  2342 leader_election.cc:304] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:47.518401  6866 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:47.519218  6866 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.520237  6911 raft_consensus.cc:2804] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:47.462661  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.522544  6839 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:47.522655  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 60074.5us
I20260709 12:59:47.523413  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5741b07c783e4193be39d19fba6c5cec" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.524488  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:47.525036  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.525346  6936 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:47.526700  6866 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.527078  6936 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:47.527536  6936 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:47.449934  6745 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:47.533713  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 92193.8us
I20260709 12:59:47.534328  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.514605  6931 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:47.534228  6745 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.536913  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.537142  6745 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.463533  6537 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.539232  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.467094  6466 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:47.485044  6842 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.541410  6842 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:47.541839  6842 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.542258  6842 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:47.544993  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.545912  6911 raft_consensus.cc:697] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:47.547887  6911 consensus_queue.cc:237] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.534519  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.553859  1647 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:47.554984  1647 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:47.563373  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:47.564050  1532 raft_consensus.cc:606] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.564431  1532 raft_consensus.cc:614] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:47.564675  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.565860  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.566071  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.552598  1608 raft_consensus.cc:2468] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:47.567891  1572 leader_election.cc:400] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13.
I20260709 12:59:47.568321  1572 leader_election.cc:403] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:47.568570  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.582315  6925 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.584931  1647 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.586604  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.587488  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be7685d9b14fe8a557b6d7572c0296" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.588709  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.594202  6759 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399) with higher term. Message: Invalid argument: T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for earlier term 12. Current term is 13.
I20260709 12:59:47.569937  6839 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:47.598927  6839 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.599357  6839 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:47.601069  6829 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.612469  6925 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:47.613134  6925 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.615669  6925 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.619076  6833 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:47.619617  6833 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.568603  6912 raft_consensus.cc:2804] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:47.651964  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:47.652685  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.652951  1529 raft_consensus.cc:606] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:47.653584  1529 raft_consensus.cc:614] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:47.655452  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 243423us
I20260709 12:59:47.657173  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.659996  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.660848  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.661237  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.659973  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.663848  1530 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.621709  6886 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:47.581283  6736 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.622394  6763 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:47.622870  6829 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.675500  1678 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
I20260709 12:59:47.675863  6772 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:47.676354  6772 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.678401  6772 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.680308  6909 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:47.680866  6909 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.682360  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:47.683401  6909 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.684491  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10aca507e378431ea54a6cce71c236fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:47.684870  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:47.685865  6772 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:47.669068  2344 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.688741  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf2cc020b14bb0b4aebbbdfd3e4a8d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.651899  6745 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.689465  6941 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:47.691431  6745 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:47.693710  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60668 (request call id 2388) took 1884 ms (client timeout 2198 ms). Trace:
W20260709 12:59:47.694139  1608 rpcz_store.cc:269] 0709 12:59:45.804706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.804815 (+   109us) service_pool.cc:224] Handling call
0709 12:59:47.514488 (+1709673us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b58000dfe98. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce873eee 0000000000375939 00007f25d68e71e0 00007f25d69b00c4 00007f25d69b0131 00007f25d695e0a0 00007f25d695d984 00007f25cfed86d4 00007f25cfed8662
0709 12:59:47.689097 (+174609us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b54004079d4. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d199c2fa 00007f25d695db17 00007f25cfed86d4 00007f25cfed8662 00007f25cfed8591 00007f25cfed850c 00007f25cfed77c2 00007f25cfcd348c 00007f25cfcd28c6 00007f25cfcd226f
0709 12:59:47.689189 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40022784}
I20260709 12:59:47.694664  6745 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.686251  1649 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.697793  6810 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:47.690464  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:47.697867  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 55164us
I20260709 12:59:47.702167  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.663884  6912 raft_consensus.cc:697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:47.705489  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.706588  6912 consensus_queue.cc:237] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.708807  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.709602  1647 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.710556  6877 raft_consensus.cc:2804] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:47.711077  6877 raft_consensus.cc:697] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:47.711205  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.711961  6877 consensus_queue.cc:237] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.668851  6932 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.721081  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.622064  6936 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.686306  6772 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.721874  6932 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.725366  6932 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.725984  6936 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.726356  6833 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.723654  6772 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.730136  1683 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.730284  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:47.723294  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 308137us
I20260709 12:59:47.727600  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:47.734867  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.734969  1527 raft_consensus.cc:606] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:47.723130  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.737170  6736 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.737458  1575 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.737841  6736 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:47.738934  6745 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.688925  6763 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.741789  6922 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.743201  6763 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.721819  6886 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:47.747058  6833 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:47.747576  6833 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.747500  6931 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.750587  6833 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:47.751384  6931 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.751479  1600 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:47.753800  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:47.754424  1533 raft_consensus.cc:606] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:47.754726  1533 raft_consensus.cc:614] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:47.757750  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:47.759792  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.744766  6922 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.762769  6908 raft_consensus.cc:493] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.763082  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.763386  6908 raft_consensus.cc:515] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.738161  6839 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.765360  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
mode: GRACEFUL
new_leader_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:46606
I20260709 12:59:47.766198  1533 raft_consensus.cc:606] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Received request to transfer leadership to TS fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.768939  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.696452  2344 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.773721   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:47.775418  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:47.780778  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 84413.3us
I20260709 12:59:47.786710  1649 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.786922  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:47.792269  1603 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 16: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:47.796564  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6bb2550d6a4cceaf445ac56633cf86" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.794930  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:47.796178  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:47.765036  6794 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:47.799765  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 64975.6us
I20260709 12:59:47.801827  2344 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.799926  1497 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.776734  6886 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:47.803508  1500 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.805380  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:47.806685  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:47.807102  1649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:46719 timed out after 1.961s (SENT)
I20260709 12:59:47.809382  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc9c2ff15b642d3b2b7f9e5317a1617" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:47.812331  1678 raft_consensus.cc:1240] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:47.816890  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.817298  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.818245  1533 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 16.
I20260709 12:59:47.820304  6839 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.791517  6885 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:47.823559  6761 consensus_queue.cc:1059] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:47.824615  6772 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.826454  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.827277  1605 raft_consensus.cc:1240] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.797158  6736 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:47.830157  6829 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:59:47.827898  6906 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.852392  6829 raft_consensus.cc:3055] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:47.853022  6829 raft_consensus.cc:740] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:47.833668  6842 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.854947  1679 raft_consensus.cc:1240] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:47.855746  6932 raft_consensus.cc:993] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:59:47.855463  6668 consensus_queue.cc:1059] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:47.856230  6932 raft_consensus.cc:1081] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Signalling peer fc6fbca2eb8d4bec997c51003e277180 to start an election
I20260709 12:59:47.856745  6842 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.828380  6466 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:47.800817  6745 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:47.859297  6745 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:47.859768  6745 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:47.863807  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
 from {username='slave'} at 127.0.0.1:60682
I20260709 12:59:47.864526  1605 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:47.864878  1605 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:47.867605  6761 raft_consensus.cc:3055] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:47.868011  6761 raft_consensus.cc:740] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:47.868790  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:47.801354  6868 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:47.872521  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 72014.1us
I20260709 12:59:47.873613  2344 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.875018  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.868849  6761 consensus_queue.cc:260] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.878340  6761 raft_consensus.cc:3060] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:47.878407  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:47.883879  6955 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:47.884814  6829 consensus_queue.cc:260] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.886459  6829 raft_consensus.cc:3060] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.799149  6911 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:47.888799  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 12:59:47.889931  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 94280.1us
I20260709 12:59:47.898327  1575 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.900789  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:47.891772  1605 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.888091  6868 consensus_queue.cc:1059] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:59:47.843938  6908 leader_election.cc:290] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.916491  6868 raft_consensus.cc:3055] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:47.916954  6868 raft_consensus.cc:740] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:47.907765  6955 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:47.921502  6794 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:47.922354  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:47.923401  1500 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:47.925597  1679 raft_consensus.cc:1240] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:47.927007  6772 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:47.874712  6866 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.929716  6949 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:47.933871  6908 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:47.938182  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.939252  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:47.929768  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:47.942950  1605 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:47.942970  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 135891us
I20260709 12:59:47.944001  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:47.944823  1604 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 14: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:47.948019  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:47.951881  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:47.952562  1525 raft_consensus.cc:3055] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:47.952888  1525 raft_consensus.cc:740] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:47.954347  1679 raft_consensus.cc:2393] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 14: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:47.917929  6868 consensus_queue.cc:260] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:47.960948  1603 raft_consensus.cc:1240] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Rejecting Update request from peer 5a2554c3dead4fcfa5f51708a9ecd5ac for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:47.957322  2339 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.959131   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:47.971798  1525 consensus_queue.cc:260] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:47.976255  1525 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:47.978526  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.982857  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:47.983631  1675 raft_consensus.cc:2393] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 13: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:47.985215  1649 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:47.988214  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1773d932be4bf48dbb9a17cd28bad4" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:47.988909  1678 raft_consensus.cc:3060] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:47.990607  1533 raft_consensus.cc:1240] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:47.991684  1649 leader_election.cc:304] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.975952  6895 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:47.995755  1649 leader_election.cc:304] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:47.989698  6868 raft_consensus.cc:3060] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:47.988840  6777 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.011045  1525 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
I20260709 12:59:47.994411  6772 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.016847  1649 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:48.022322  6876 consensus_queue.cc:1059] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:48.023569  6736 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:48.024869  6615 raft_consensus.cc:3055] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:48.025293  6615 raft_consensus.cc:740] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:47.996712  6881 raft_consensus.cc:2749] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:48.018404  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:48.003170  6925 raft_consensus.cc:2749] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:48.042631  6615 consensus_queue.cc:260] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:48.044000  6615 raft_consensus.cc:3060] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:48.048118  1678 raft_consensus.cc:2468] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
I20260709 12:59:48.039959  6772 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:48.064821  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:48.071084  1532 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:59:48.070245  1527 raft_consensus.cc:2468] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 12:59:48.071499  1532 pending_rounds.cc:85] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting all ops after (but not including) 10
I20260709 12:59:48.071769  1532 pending_rounds.cc:107] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:59:48.071921  1532 raft_consensus.cc:2889] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:48.077184  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:48.083933  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:48.085817  1676 raft_consensus.cc:2393] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in current term 10: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 12:59:48.090337  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c791dce8144e7886b1312c2b6200b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:48.092360  1572 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:48.093166  6536 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:48.095173  1572 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:48.097350  1649 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:48.097354  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:48.098318  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:48.100641  1649 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:48.104386  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:48.107100  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:48.104259  6938 raft_consensus.cc:2804] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:48.109120  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00631bb4062844edb73eb9b0810cc59c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:48.111835  6881 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:48.114441  6881 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:48.114823  6881 raft_consensus.cc:3060] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:48.103499  6772 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:48.087823  6745 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:48.105835  6925 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.117300  6938 raft_consensus.cc:697] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 15 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:48.126457  6938 consensus_queue.cc:237] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:48.127282  6745 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:48.130934  1600 raft_consensus.cc:1240] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:48.135927  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:48.137629  1604 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:48.156230  1497 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:48.156924  6954 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:48.157455  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:48.158463  6908 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.158586  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:48.159147  6908 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:48.159314  6785 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:48.159754  1497 leader_election.cc:304] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:48.163516  1683 raft_consensus.cc:1275] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:48.184010  6883 consensus_queue.cc:1048] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:59:48.195719  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d859537ee3eb49969dd821b3f75dd33e" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:48.197775  1527 raft_consensus.cc:2393] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 13: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:48.196758  6756 consensus_queue.cc:1059] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:59:48.184963  6932 raft_consensus.cc:2749] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:48.197837  1533 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Rejecting Update request from peer 3cabc5110903443ba3beb5cbb14afa91 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:48.198058  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:48.204164  1529 raft_consensus.cc:2393] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 10: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:48.208038  6756 raft_consensus.cc:3055] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:48.208536  6756 raft_consensus.cc:740] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:48.209489  6756 consensus_queue.cc:260] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:48.243438  6756 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:48.284868  1600 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:48.300590  6772 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:48.302500  6736 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:48.302919  6736 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:48.303681  6829 raft_consensus.cc:993] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:48.303905  6736 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:48.308539  6736 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:48.313683  6772 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:48.315754  1605 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:48.317353  6829 raft_consensus.cc:1081] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:48.323444  6881 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:48.336167  1676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38994
I20260709 12:59:48.337177  1676 raft_consensus.cc:493] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.338276  1676 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:48.345074  1675 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:48.355510  1525 raft_consensus.cc:1275] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:48.366080  2428 raft_consensus.cc:2468] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 14.
I20260709 12:59:48.366461  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:48.373687  6938 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:48.385423  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:48.383028  1676 raft_consensus.cc:515] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:48.352733  6772 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:59:48.412091  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 47600.6us
I20260709 12:59:48.433828  1575 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:48.451277  2428 raft_consensus.cc:1275] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:59:48.447608  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40874 (request call id 355) took 16713 ms (client timeout 15000 ms). Trace:
I20260709 12:59:48.418298  6536 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:48.463407  1649 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:48.463760  6536 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } attrs { replace: true } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:48.464373  6925 raft_consensus.cc:2804] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:48.464974  6925 raft_consensus.cc:697] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 14 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:48.467016  6536 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:48.466565  6925 consensus_queue.cc:237] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:48.470258  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:48.472368  6733 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:48.472937  6536 raft_consensus.cc:2804] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:48.480316  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:48.483057  1529 raft_consensus.cc:2468] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 16.
I20260709 12:59:48.483556  2423 raft_consensus.cc:2468] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:48.484758  2451 raft_consensus.cc:2468] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:48.488965  1649 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:48.494508  1676 leader_election.cc:290] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:48.498473  6842 raft_consensus.cc:2804] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:48.499038  6842 raft_consensus.cc:697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 16 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:48.499913  6842 consensus_queue.cc:237] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:48.500885  6912 consensus_queue.cc:1048] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:48.492226  6736 consensus_queue.cc:1048] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
W20260709 12:59:48.469844  1428 rpcz_store.cc:269] 0709 12:59:31.734082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.737365 (+  3283us) service_pool.cc:224] Handling call
0709 12:59:48.447493 (+16710128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:45.616176 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:45.616749 (+   573us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:45.616784 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:59:45.616802 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:45.620469 (+  3667us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:45.620589 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:45.620651 (+    62us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:59:45.669118 (+ 48467us) tablet.cc:701] Row locks acquired
0709 12:59:45.669138 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:45.669287 (+   149us) write_op.cc:270] Start()
0709 12:59:45.669406 (+   119us) write_op.cc:276] Timestamp: P: 1783601985669234 usec, L: 0
0709 12:59:45.669424 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:59:45.726166 (+ 56742us) log.cc:844] Serialized 11826 byte log entry
0709 12:59:46.200741 (+474575us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b4400022b4c. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce7d1c85 00007f25ce7d26a2 00007f25d15441db 00007f25d153faaf 00007f25ce88e0ac 00007f25d76e8ab9 00007f25ce8aa69b 00007f25ce8a893f 00007f25ce8aac02 00007f25d153220b
0709 12:59:46.933856 (+733115us) op_driver.cc:464] REPLICATION: finished
0709 12:59:47.065273 (+131417us) write_op.cc:301] APPLY: starting
0709 12:59:47.065351 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:47.185957 (+120606us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:47.185992 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:47.202187 (+ 16195us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b540012eb54. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25d1901571 00007f25d1993e28 00007f25d53ce581 00007f25d53cdd58 00007f25d53d29f1 00007f25d53d29a9 00007f25d53d2939 00007f25d53d2901 00007f25d53d1b2d 000000000038f354 000000000038f199
0709 12:59:47.753886 (+551699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:47.754280 (+   394us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 12:59:47.754327 (+    47us) write_op.cc:312] APPLY: finished
0709 12:59:47.754790 (+   463us) log.cc:844] Serialized 260 byte log entry
0709 12:59:47.754966 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:47.755191 (+   225us) write_op.cc:454] Released schema lock
0709 12:59:47.755267 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:47.767409 (+ 12142us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:47.772354 (+  4945us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85,"reported_tablets":47,"spinlock_wait_cycles":3968,"child_traces":[["op",{"apply.queue_time_us":131178,"apply.run_cpu_time_us":40578,"apply.run_wall_time_us":700142,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129347,"num_ops":30,"prepare.queue_time_us":168360,"prepare.run_cpu_time_us":49341,"prepare.run_wall_time_us":1586206,"raft.queue_time_us":144582,"raft.run_cpu_time_us":25300,"raft.run_wall_time_us":131137,"replication_time_us":1264223,"spinlock_wait_cycles":90108544,"thread_start_us":1429518,"threads_started":4,"wal-append.queue_time_us":648866}]]}
I20260709 12:59:48.518860  1649 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:48.396864  6881 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:48.534385  1649 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:48.539376  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:48.539680  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:48.540184  1529 raft_consensus.cc:3055] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:48.536492  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:48.540515  1529 raft_consensus.cc:740] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:48.542050  1605 raft_consensus.cc:2393] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 16: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:48.542524  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9ed6ddb0bc46ec944198e737aa5f57" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:48.543061  1603 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:48.545135  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:48.390373  6931 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:59:48.554924  6881 raft_consensus.cc:2804] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:48.555546  6972 raft_consensus.cc:2804] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:48.492766  6536 raft_consensus.cc:697] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:48.556170  6972 raft_consensus.cc:697] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:48.556680  6536 consensus_queue.cc:237] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:48.558828  6970 log.cc:927] Time spent T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:59:48.562213  6785 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.561996  1529 consensus_queue.cc:260] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:48.562680  6785 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:48.563258  1529 raft_consensus.cc:3060] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:48.564898  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 48568.7us
I20260709 12:59:48.555510  6881 raft_consensus.cc:697] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:48.575865  1575 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:48.580358  1529 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:48.557056  6972 consensus_queue.cc:237] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:48.590451  6790 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:48.614599  6881 consensus_queue.cc:237] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:48.643463  6785 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:48.655063  1425 catalog_manager.cc:5697] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.658629  1603 raft_consensus.cc:2468] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:48.656891  1425 catalog_manager.cc:5697] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 7 to 10, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
W20260709 12:59:48.710465  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 173096us
I20260709 12:59:48.741468  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:48.763953  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 229633us
I20260709 12:59:48.767243  1683 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:48.770166  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:48.739197  1647 leader_election.cc:304] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:48.773813  6925 raft_consensus.cc:2804] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:48.774320  6925 raft_consensus.cc:697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:48.775177  6925 consensus_queue.cc:237] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:48.845079  1526 raft_consensus.cc:1275] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:48.889313  1498 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:48.874461  1425 catalog_manager.cc:5697] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 4 to 5, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:48.863777  6790 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:59:48.901046  6829 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:48.997361   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:49.010741  6344 raft_consensus.cc:493] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.011323  6344 raft_consensus.cc:515] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 12:59:49.016543  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 127320us
I20260709 12:59:49.026052  1526 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:59:49.042415  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 147985us
W20260709 12:59:49.054797  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 173876us
W20260709 12:59:49.068953  6979 log.cc:927] Time spent T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:59:49.076156  6344 leader_election.cc:290] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:49.045455  6976 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 12:59:49.079190  6980 log.cc:927] Time spent T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:59:49.087706  6933 consensus_queue.cc:1048] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:49.094027  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:49.121248  6983 log.cc:927] Time spent T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:59:49.140762  1682 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:49.118430  1425 catalog_manager.cc:5697] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 9 to 12, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:49.149174  6988 log.cc:927] Time spent T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 12:59:49.156545  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a253835287048b3b4ce5ffeb6a4dd1f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:49.160734  1529 raft_consensus.cc:2410] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:59:49.179162  1425 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 7 to 11, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:49.191041  1532 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:49.192359  2451 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:59:49.192610  2428 raft_consensus.cc:1275] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:49.193895  2455 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:49.186528  1425 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 7 to 10, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:49.219925  6976 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:59:49.250684  1533 raft_consensus.cc:1275] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:49.269059  1575 leader_election.cc:304] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:49.222708  6736 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:59:49.229092  6772 consensus_queue.cc:1048] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:59:49.229431  6933 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:59:49.238821  6912 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:59:49.296483  1425 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 6 to 10, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.312188  6790 raft_consensus.cc:2749] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:49.333428  6976 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
W20260709 12:59:49.366479  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 97503.6us
I20260709 12:59:49.381824  1533 raft_consensus.cc:1275] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:59:49.355053  6976 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:49.388288  6976 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:49.317970  1425 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 7 to 11, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.404732  1526 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:49.417217  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:49.476150  2451 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
W20260709 12:59:49.476890  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 60413.4us
I20260709 12:59:49.478946  6772 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:59:49.481685  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 68041.5us
W20260709 12:59:49.500938  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 87293.1us
I20260709 12:59:49.476138  6976 consensus_queue.cc:1048] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:59:49.532658  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:49.546129  1425 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 11 to 13, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.551368  6973 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:49.552153  6973 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:49.552721  6973 raft_consensus.cc:3060] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:49.548316  1425 catalog_manager.cc:5697] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 5 to 8, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.598690  1425 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 13, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.628096  6973 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:49.646885  7016 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:49.680011  7016 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:49.682753  7016 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:49.689467  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" is_pre_election: true
I20260709 12:59:49.690431  1530 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 17: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:49.693691  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:49.694795  1682 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 17.
I20260709 12:59:49.697651  1425 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 8 to 10, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.706389  6973 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:49.722083  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:49.725996  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:49.727010  6948 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:49.727615  6948 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:49.728039  6948 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:49.728984  2423 raft_consensus.cc:2468] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 15.
I20260709 12:59:49.738166  1649 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:49.739601  6973 raft_consensus.cc:2804] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:49.740374  6973 raft_consensus.cc:697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:49.741324  6973 consensus_queue.cc:237] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:49.745033  6948 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:49.759791  1419 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 172d54128ab740c980d9c27aa0ff1761 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e45ac8b66854c2f905bf2c4114cb489 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 12:59:49.762899  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 256275us
I20260709 12:59:49.764384  6931 consensus_queue.cc:1048] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:49.770630  6948 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:49.771636  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:49.776566  1605 raft_consensus.cc:1275] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:49.778638  1604 raft_consensus.cc:1275] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:49.779578  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:49.780359  1606 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 15: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:49.781879  1606 raft_consensus.cc:1275] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:49.787617  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:49.788347  1604 raft_consensus.cc:2393] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 15: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 12:59:49.798660  6977 consensus_queue.cc:1048] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:49.800992  1676 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 17.
I20260709 12:59:49.805143  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:49.806070  6615 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:49.806695  6615 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:49.807687  6615 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:49.812247  6736 consensus_queue.cc:1048] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:49.812629  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:49.813395  1526 raft_consensus.cc:2393] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 17: Already voted for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in this term.
I20260709 12:59:49.818588  6977 consensus_queue.cc:1048] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:59:50.133502  1425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 320) took 17743 ms (client timeout 15000 ms). Trace:
W20260709 12:59:50.134091  1425 rpcz_store.cc:269] 0709 12:59:32.389675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.389904 (+   229us) service_pool.cc:224] Handling call
0709 12:59:50.133426 (+17743522us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:49.805846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:49.806405 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:49.806438 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:59:49.806457 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:49.807478 (+  1021us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:49.807556 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:49.807583 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:59:49.808656 (+  1073us) tablet.cc:701] Row locks acquired
0709 12:59:49.808674 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:59:49.808818 (+   144us) write_op.cc:270] Start()
0709 12:59:49.808920 (+   102us) write_op.cc:276] Timestamp: P: 1783601989808771 usec, L: 0
0709 12:59:49.808941 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:49.831219 (+ 22278us) log.cc:844] Serialized 4829 byte log entry
0709 12:59:50.010809 (+179590us) op_driver.cc:464] REPLICATION: finished
0709 12:59:50.037391 (+ 26582us) write_op.cc:301] APPLY: starting
0709 12:59:50.037476 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:50.079405 (+ 41929us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:50.079504 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:50.102378 (+ 22874us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:50.102640 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:59:50.102688 (+    48us) write_op.cc:312] APPLY: finished
0709 12:59:50.102988 (+   300us) log.cc:844] Serialized 113 byte log entry
0709 12:59:50.103204 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:50.103343 (+   139us) write_op.cc:454] Released schema lock
0709 12:59:50.103391 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:50.103789 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:50.104886 (+  1097us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":26278,"apply.run_cpu_time_us":17247,"apply.run_wall_time_us":66373,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54215,"num_ops":12,"prepare.queue_time_us":33500,"prepare.run_cpu_time_us":41682,"prepare.run_wall_time_us":84429,"raft.queue_time_us":54682,"raft.run_cpu_time_us":1750,"raft.run_wall_time_us":29796,"replication_time_us":196421,"thread_start_us":105274,"threads_started":4,"wal-append.queue_time_us":94779}]]}
I20260709 12:59:50.187537   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:50.207194  2428 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:50.215062  6973 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:50.223934  1604 raft_consensus.cc:1275] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:50.227519  6790 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.228084  6790 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.232319  6790 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:50.229312  1424 catalog_manager.cc:5697] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 14 to 15, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.236064  1424 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.240625  1424 catalog_manager.cc:5697] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 14 to 16, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 16 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.249614  1424 catalog_manager.cc:5697] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.251127  1424 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 12 to 14, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 14 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.252282  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:50.253429  1424 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 16, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 16 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.255196  1424 catalog_manager.cc:5697] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.285789  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062a0e40b92a4b4f9763c2dd8d13aa5f" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:50.298444  1572 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:50.300879  6753 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:50.286231  6977 consensus_queue.cc:1048] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:59:50.308174  1424 catalog_manager.cc:5697] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.313545  1424 catalog_manager.cc:5697] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 10, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.335489  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390bda9334de482bb1f2274e10fe5743"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:59:50.336098  1606 raft_consensus.cc:606] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:50.336422  1606 raft_consensus.cc:614] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:50.335039  1424 catalog_manager.cc:5697] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 12 to 14, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.337587  1424 catalog_manager.cc:5697] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 10, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:50.343439  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:59:50.344040  1606 raft_consensus.cc:606] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:50.344633  7003 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.345369  7003 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.347580  2423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:50.347908  7003 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:50.348153  2423 raft_consensus.cc:606] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:50.348559  2423 raft_consensus.cc:614] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:50.349768  1424 catalog_manager.cc:5697] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:50.350322  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:50.352511  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:59:50.353292  1606 raft_consensus.cc:606] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
W20260709 12:59:50.354702  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 58845.5us
I20260709 12:59:50.362551  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:50.363303  2428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:50.363279  1678 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 17.
I20260709 12:59:50.364154  2428 raft_consensus.cc:606] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:50.366372   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:50.370846   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:50.351362  1424 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: config changed from index 4 to 8, VOTER fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) evicted. New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.375322  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:50.376909  7003 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:50.377312  7003 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.377672  7003 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:50.405998  7003 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.409593  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:50.410239  1676 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:50.411494  7003 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 18 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:50.415114  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:50.391033  1424 catalog_manager.cc:5697] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 12 to 15, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.418889  1676 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 18.
I20260709 12:59:50.420084  1497 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489
I20260709 12:59:50.424201  6944 raft_consensus.cc:993] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:50.424769  6790 raft_consensus.cc:1081] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:50.425240  1532 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:50.431177  1532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:59:50.431770  1532 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:50.432111  1532 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:50.434049  1424 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.435930  6954 consensus_queue.cc:1059] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:50.436818  6954 raft_consensus.cc:3055] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:50.437202  6954 raft_consensus.cc:740] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:50.438099  6954 consensus_queue.cc:260] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.432075  1676 raft_consensus.cc:1240] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Rejecting Update request from peer 1e45ac8b66854c2f905bf2c4114cb489 for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:50.441368  6954 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:50.441390  1532 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.445523  1532 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:50.445990  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:50.446695  1604 raft_consensus.cc:3055] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:50.447024  1604 raft_consensus.cc:740] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:50.435708  1424 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 11, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.447789  1604 consensus_queue.cc:260] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.448231  1424 catalog_manager.cc:5697] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 6 to 9, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:50.449049  1604 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:50.450497  1424 catalog_manager.cc:5697] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.452256  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:50.452910  2428 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:50.462366  2428 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:50.464057  1500 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:50.472675  1604 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 10.
I20260709 12:59:50.472404  7003 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:50.475063  6466 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:50.480057  6466 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:50.481280  6466 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.452193  1424 catalog_manager.cc:5697] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 12, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 12 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.511866  1424 catalog_manager.cc:5697] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.513787  1424 catalog_manager.cc:5697] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 12, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.515272  1424 catalog_manager.cc:5697] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 12 to 14, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 14 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.517006  6536 raft_consensus.cc:993] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:50.523106  6536 raft_consensus.cc:1081] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:50.551573  1676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:59:50.552239  1676 raft_consensus.cc:493] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:50.552776  1676 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.517374  1424 catalog_manager.cc:5697] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.558717  1424 catalog_manager.cc:5697] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:50.571277  1676 raft_consensus.cc:515] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:50.576974  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:50.577675  1604 raft_consensus.cc:3055] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:50.578043  1604 raft_consensus.cc:740] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:50.578866  1604 consensus_queue.cc:260] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:50.580021  1604 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.587625  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2805f2fabf7471abe8442f6cbb32668" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:50.588347  1532 raft_consensus.cc:3060] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.589890  1676 leader_election.cc:290] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:50.592720  1604 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:50.593979  1647 leader_election.cc:304] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:50.604666  6736 raft_consensus.cc:2804] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:50.605280  6736 raft_consensus.cc:697] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:50.614775  1532 raft_consensus.cc:2468] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 9.
I20260709 12:59:50.618973  6736 consensus_queue.cc:237] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:50.560803  1424 catalog_manager.cc:5697] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 4 to 11, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.643427  1424 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.649742  7003 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 18 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:50.645081  1424 catalog_manager.cc:5697] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 5 to 7, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.652360  7003 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.652758  1424 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 11, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 11 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.709398  7040 raft_consensus.cc:993] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:50.710121  7015 raft_consensus.cc:1081] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:50.699235  1424 catalog_manager.cc:5697] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 12, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.715204  1424 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:50.717048  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:45362
I20260709 12:59:50.723372  1678 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:50.723785  1678 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:50.733301  1678 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.736070  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:50.736673  1532 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:50.736727  1678 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:50.737198  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32dbc3da8894f6cbbf52b501c537a5b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:50.740509  2423 raft_consensus.cc:3055] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:50.740841  2423 raft_consensus.cc:740] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:50.741590  2423 consensus_queue.cc:260] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.742659  2423 raft_consensus.cc:3060] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:50.755246  2423 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 12:59:50.756662  1649 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:50.758114  6973 raft_consensus.cc:2804] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:50.758646  6973 raft_consensus.cc:697] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:50.759632  6973 consensus_queue.cc:237] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:50.759160  1532 raft_consensus.cc:2468] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
W20260709 12:59:50.934199  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 52034.5us
I20260709 12:59:51.055423  2428 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:51.057596  6466 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:51.080513  1676 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:59:51.087399  6466 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:51.091539  1606 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:51.097232  6466 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:51.164561  1534 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:51.166478  6973 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:51.245431  1604 raft_consensus.cc:1275] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:51.247895  7046 consensus_queue.cc:1048] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:51.365963  2455 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:51.368829  2428 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 18 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:59:51.369318  2428 pending_rounds.cc:85] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Aborting all ops after (but not including) 13
I20260709 12:59:51.369675  2428 pending_rounds.cc:107] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:59:51.370018  2428 raft_consensus.cc:2889] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.411345  7070 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:51.439628  1534 raft_consensus.cc:1275] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:51.453438   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:51.474887  7003 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:59:51.489200  6772 consensus_queue.cc:1048] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:51.566589  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 46457.2us
W20260709 12:59:51.578502  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63184.6us
W20260709 12:59:51.715982  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 174014us
I20260709 12:59:51.891701  1427 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.895377  1427 catalog_manager.cc:5697] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.912585  1427 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 10 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.931741  1427 catalog_manager.cc:5697] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.942019  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 with delete_type TABLET_DATA_TOMBSTONED (TS fc6fbca2eb8d4bec997c51003e277180 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:60652
I20260709 12:59:51.952219  1424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40874 (request call id 356) took 3953 ms. Trace:
I20260709 12:59:51.952752  1424 rpcz_store.cc:276] 0709 12:59:47.998765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.006616 (+  7851us) service_pool.cc:224] Handling call
0709 12:59:51.952027 (+3945411us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:51.216074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:51.217219 (+  1145us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:51.217291 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:59:51.217343 (+    52us) tablet.cc:662] Decoding operations
0709 12:59:51.241438 (+ 24095us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:51.241584 (+   146us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:51.241615 (+    31us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:59:51.244511 (+  2896us) tablet.cc:701] Row locks acquired
0709 12:59:51.244564 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:59:51.244763 (+   199us) write_op.cc:270] Start()
0709 12:59:51.244962 (+   199us) write_op.cc:276] Timestamp: P: 1783601991244669 usec, L: 0
0709 12:59:51.245006 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:59:51.247502 (+  2496us) log.cc:844] Serialized 11883 byte log entry
0709 12:59:51.550217 (+302715us) op_driver.cc:464] REPLICATION: finished
0709 12:59:51.697159 (+146942us) write_op.cc:301] APPLY: starting
0709 12:59:51.697256 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:51.796139 (+ 98883us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:51.796312 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:51.857171 (+ 60859us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:51.857724 (+   553us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 12:59:51.857791 (+    67us) write_op.cc:312] APPLY: finished
0709 12:59:51.858405 (+   614us) log.cc:844] Serialized 260 byte log entry
0709 12:59:51.858614 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:51.858869 (+   255us) write_op.cc:454] Released schema lock
0709 12:59:51.858962 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:51.864609 (+  5647us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:51.864667 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20719,"reported_tablets":47,"spinlock_wait_cycles":6400,"child_traces":[["op",{"apply.queue_time_us":146554,"apply.run_cpu_time_us":41540,"apply.run_wall_time_us":162247,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129347,"num_ops":30,"prepare.queue_time_us":53776,"prepare.run_cpu_time_us":10937,"prepare.run_wall_time_us":33302,"raft.queue_time_us":173731,"raft.run_cpu_time_us":45835,"raft.run_wall_time_us":161812,"replication_time_us":304964,"thread_start_us":469422,"threads_started":4,"wal-append.queue_time_us":54029}]]}
I20260709 12:59:51.958729  7081 tablet_replica.cc:333] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 12:59:51.966583  7081 raft_consensus.cc:2243] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.974151  7081 raft_consensus.cc:2272] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.979931  7081 ts_tablet_manager.cc:1916] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:52.053841  7081 ts_tablet_manager.cc:1929] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 12:59:52.054968  7081 log.cc:1199] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P fc6fbca2eb8d4bec997c51003e277180: Deleting WAL directory at /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601802742860-431-0/minicluster-data/ts-1-root/wals/5297d7a3ab0a4faeaf7d74c4c5296b15
I20260709 12:59:52.057484  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
W20260709 12:59:52.058439  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41270 (request call id 230) took 27860 ms (client timeout 15000 ms). Trace:
W20260709 12:59:52.058997  1427 rpcz_store.cc:269] 0709 12:59:24.197723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.197951 (+   228us) service_pool.cc:224] Handling call
0709 12:59:24.371704 (+173753us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400002490. stack: 00007f25ce879343 00007f25ce879240 00007f25ce2081d4 00007f25d7f46304 00007f25d7f46299 00007f25ce733db1 00007f25ce873b71 00007f25ce8740b2 00007f25d77eda89 00007f25d7785da6 00007f25d7757088 00007f25d785537e 00007f25d5d162a4 00007f25d5d16232 00007f25d5d16161 00007f25d5d160dc
0709 12:59:51.966300 (+27594596us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:51.966338 (+    38us) write_op.cc:454] Released schema lock
0709 12:59:52.058346 (+ 92008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:51.946462 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:51.947048 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:51.947086 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:59:51.947105 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:51.947793 (+   688us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:51.947874 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:51.947902 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:51.948325 (+   423us) tablet.cc:701] Row locks acquired
0709 12:59:51.948345 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:51.948495 (+   150us) write_op.cc:270] Start()
0709 12:59:51.948615 (+   120us) write_op.cc:276] Timestamp: P: 1783601991948447 usec, L: 0
0709 12:59:51.948656 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:59:51.949356 (+   700us) log.cc:844] Serialized 1686 byte log entry
0709 12:59:51.951579 (+  2223us) op_driver.cc:464] REPLICATION: finished
0709 12:59:51.952083 (+   504us) write_op.cc:301] APPLY: starting
0709 12:59:51.952178 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:51.955050 (+  2872us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:51.955151 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:51.958747 (+  3596us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:51.958930 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:59:51.959005 (+    75us) write_op.cc:312] APPLY: finished
0709 12:59:51.959260 (+   255us) log.cc:844] Serialized 49 byte log entry
0709 12:59:51.960095 (+   835us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:51.960202 (+   107us) write_op.cc:454] Released schema lock
0709 12:59:51.960246 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":20031,"reported_tablets":40,"spinlock_wait_cycles":359616384,"child_traces":[["op",{"apply.queue_time_us":277,"apply.run_cpu_time_us":6915,"apply.run_wall_time_us":8463,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":10203,"prepare.run_cpu_time_us":3244,"prepare.run_wall_time_us":19279,"replication_time_us":2775,"thread_start_us":30069,"threads_started":1}]]}
I20260709 12:59:52.101284  1426 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.108274  1426 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 6 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.173290  1427 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 11 to 16, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:52.175326  1427 catalog_manager.cc:5697] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.180832  1427 catalog_manager.cc:5697] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:52.200506  1427 catalog_manager.cc:5697] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 14 to 15, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:52.256671  1427 catalog_manager.cc:5697] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 8 to 9, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:52.258737  1427 catalog_manager.cc:5697] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 12 to 13, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.260480  1427 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 9 to 10, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 10 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.349905  1427 catalog_manager.cc:5697] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 14 to 15, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:52.356690  1427 catalog_manager.cc:5697] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
I20260709 12:59:52.378189  1427 catalog_manager.cc:5697] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 7 to 10, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.397974  1427 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 11 to 18, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 18 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.399940  1427 catalog_manager.cc:5697] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 12 to 13, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } }
W20260709 12:59:52.428602  1426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 365) took 21387 ms (client timeout 15000 ms). Trace:
W20260709 12:59:52.429344  1426 rpcz_store.cc:269] 0709 12:59:31.041286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.041629 (+   343us) service_pool.cc:224] Handling call
0709 12:59:52.147626 (+21105997us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.147656 (+    30us) write_op.cc:454] Released schema lock
0709 12:59:52.428445 (+280789us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:52.135998 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:52.136569 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:52.136607 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:59:52.136626 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:52.137018 (+   392us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:52.137077 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:52.137109 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:52.137432 (+   323us) tablet.cc:701] Row locks acquired
0709 12:59:52.137451 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:52.137632 (+   181us) write_op.cc:270] Start()
0709 12:59:52.137748 (+   116us) write_op.cc:276] Timestamp: P: 1783601992137545 usec, L: 0
0709 12:59:52.137773 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:59:52.138533 (+   760us) log.cc:844] Serialized 919 byte log entry
0709 12:59:52.140212 (+  1679us) op_driver.cc:464] REPLICATION: finished
0709 12:59:52.140644 (+   432us) write_op.cc:301] APPLY: starting
0709 12:59:52.140862 (+   218us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:52.142115 (+  1253us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:52.142198 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:52.143581 (+  1383us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:52.143961 (+   380us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:59:52.144033 (+    72us) write_op.cc:312] APPLY: finished
0709 12:59:52.144244 (+   211us) log.cc:844] Serialized 33 byte log entry
0709 12:59:52.144407 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.144489 (+    82us) write_op.cc:454] Released schema lock
0709 12:59:52.144526 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":16272,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":4151,"apply.run_wall_time_us":4158,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":4906,"prepare.run_cpu_time_us":2830,"prepare.run_wall_time_us":2850,"replication_time_us":2340}]]}
W20260709 12:59:52.625021  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41270 (request call id 229) took 52696 ms (client timeout 15000 ms). Trace:
W20260709 12:59:52.630740  1432 rpcz_store.cc:269] 0709 12:58:59.967490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.967926 (+   436us) service_pool.cc:224] Handling call
0709 12:59:52.624787 (+52656861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2986988,"reported_tablets":36}
I20260709 12:59:52.627321  1428 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 14 to 16, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.634486  1428 catalog_manager.cc:5697] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.663609  1428 catalog_manager.cc:5697] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 6 to 11, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.671083  1428 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 11, leader changed from 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.675109  1428 catalog_manager.cc:5697] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 13, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.677477  1428 catalog_manager.cc:5697] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.698457  1428 catalog_manager.cc:5697] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.700027  1428 catalog_manager.cc:5697] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 11 to 12, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.703361  1428 catalog_manager.cc:5697] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 11, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.706043  1428 catalog_manager.cc:5697] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.858752   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:52.933518  1429 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 13 to 14, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:52.937531  1591 tablet_service.cc:1558] Processing DeleteTablet for tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:60652
I20260709 12:59:52.981691  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40888 (request call id 321) took 3881 ms. Trace:
I20260709 12:59:52.982148  1428 rpcz_store.cc:276] 0709 12:59:49.100144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.100587 (+   443us) service_pool.cc:224] Handling call
0709 12:59:52.981625 (+3881038us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:52.712138 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:52.712746 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:52.712789 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:59:52.712811 (+    22us) tablet.cc:662] Decoding operations
0709 12:59:52.713916 (+  1105us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:52.713974 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:52.714011 (+    37us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:59:52.714932 (+   921us) tablet.cc:701] Row locks acquired
0709 12:59:52.714949 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:52.715127 (+   178us) write_op.cc:270] Start()
0709 12:59:52.715252 (+   125us) write_op.cc:276] Timestamp: P: 1783601992715067 usec, L: 0
0709 12:59:52.715271 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:59:52.725516 (+ 10245us) log.cc:844] Serialized 3980 byte log entry
0709 12:59:52.729986 (+  4470us) op_driver.cc:464] REPLICATION: finished
0709 12:59:52.730558 (+   572us) write_op.cc:301] APPLY: starting
0709 12:59:52.730648 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:52.769617 (+ 38969us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:52.769707 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:52.792545 (+ 22838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:52.792755 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:59:52.792801 (+    46us) write_op.cc:312] APPLY: finished
0709 12:59:52.793087 (+   286us) log.cc:844] Serialized 97 byte log entry
0709 12:59:52.807972 (+ 14885us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.808097 (+   125us) write_op.cc:454] Released schema lock
0709 12:59:52.808147 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:52.808526 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.808555 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5758,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":365,"apply.run_cpu_time_us":12843,"apply.run_wall_time_us":77909,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41740,"num_ops":10,"prepare.queue_time_us":154,"prepare.run_cpu_time_us":4222,"prepare.run_wall_time_us":17659,"replication_time_us":14571}]]}
I20260709 12:59:52.989810  1429 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:53.034144  1417 catalog_manager.cc:5028] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): tablet 5297d7a3ab0a4faeaf7d74c4c5296b15 (table test-workload [id=6db8cd385acd4c179f73a367faaa61c1]) successfully deleted
I20260709 12:59:53.213711  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 366) took 5759 ms. Trace:
I20260709 12:59:53.214105  1429 rpcz_store.cc:276] 0709 12:59:47.454690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.454876 (+   186us) service_pool.cc:224] Handling call
0709 12:59:53.213627 (+5758751us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:53.058035 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:53.058605 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:53.058644 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:59:53.058662 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:53.059067 (+   405us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:53.059124 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:53.059165 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:53.059509 (+   344us) tablet.cc:701] Row locks acquired
0709 12:59:53.059530 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:59:53.059722 (+   192us) write_op.cc:270] Start()
0709 12:59:53.059836 (+   114us) write_op.cc:276] Timestamp: P: 1783601993059666 usec, L: 0
0709 12:59:53.059864 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:59:53.060527 (+   663us) log.cc:844] Serialized 919 byte log entry
0709 12:59:53.065631 (+  5104us) op_driver.cc:464] REPLICATION: finished
0709 12:59:53.066920 (+  1289us) write_op.cc:301] APPLY: starting
0709 12:59:53.067006 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:53.068382 (+  1376us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:53.068484 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:53.129330 (+ 60846us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:53.129505 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:59:53.129576 (+    71us) write_op.cc:312] APPLY: finished
0709 12:59:53.129803 (+   227us) log.cc:844] Serialized 33 byte log entry
0709 12:59:53.129966 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:53.130054 (+    88us) write_op.cc:454] Released schema lock
0709 12:59:53.130098 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:53.130453 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:53.130481 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31334,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1014,"apply.run_cpu_time_us":4106,"apply.run_wall_time_us":63505,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":453,"prepare.run_cpu_time_us":2764,"prepare.run_wall_time_us":2764,"replication_time_us":5632}]]}
I20260709 12:59:53.218559  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:59:53.219362  1603 raft_consensus.cc:606] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:53.223187  2455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:53.223817  2455 raft_consensus.cc:606] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:53.227788  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:59:53.228380  1603 raft_consensus.cc:606] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:53.231405  2455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77f1e53da9e94a8e8859328c4a06b68a"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:53.231969  2455 raft_consensus.cc:606] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:53.232275  2455 raft_consensus.cc:614] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:53.255836  2455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0"
dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:47496
I20260709 12:59:53.256603  2455 raft_consensus.cc:606] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:53.261068   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:53.313088   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:53.321388  6790 raft_consensus.cc:993] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:53.326710  6790 raft_consensus.cc:1081] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:53.330780  1428 catalog_manager.cc:5697] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 13 to 14, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:53.332990  1428 catalog_manager.cc:5697] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 14 to 15, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 12:59:53.336302  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:59:53.344497  1526 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:53.344945  1526 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:53.354336  1526 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:53.356734  1526 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:53.357904  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:53.358341  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:53.358716  1603 raft_consensus.cc:3055] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:53.359088  1603 raft_consensus.cc:740] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:53.359170  1682 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:53.359946  1603 consensus_queue.cc:260] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:53.361173  1603 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:53.379223  7063 raft_consensus.cc:993] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:53.379854  7063 raft_consensus.cc:1081] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:53.381759  1676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:45362
I20260709 12:59:53.382346  1676 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:53.382678  1676 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:53.407989  1676 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:53.416734  1603 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 17.
I20260709 12:59:53.418752  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:53.432730  2455 raft_consensus.cc:3055] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:53.433074  2455 raft_consensus.cc:740] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:53.434226  1682 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 17.
I20260709 12:59:53.434145  2455 consensus_queue.cc:260] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:53.426764  1676 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:53.436097  1498 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:53.446233  7059 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:53.446813  7059 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:53.447696  7059 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:53.450368  2455 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:53.442330  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa902e4626a464fabe120fcad834ad0" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:53.454185  1603 raft_consensus.cc:3060] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:53.472779  1603 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
W20260709 12:59:53.479707  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40900 (request call id 364) took 42071 ms (client timeout 15000 ms). Trace:
W20260709 12:59:53.482514  1430 rpcz_store.cc:269] 0709 12:59:11.408358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.408599 (+   241us) service_pool.cc:224] Handling call
0709 12:59:53.479479 (+42070880us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99869,"reported_tablets":46}
I20260709 12:59:53.485198  2455 raft_consensus.cc:2468] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
W20260709 12:59:53.496351  1431 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41270 (request call id 231) took 11463 ms (client timeout 15000 ms). Trace:
I20260709 12:59:53.496663  1649 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:53.497004  1431 rpcz_store.cc:269] 0709 12:59:42.033297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.042549 (+  9252us) service_pool.cc:224] Handling call
0709 12:59:53.496073 (+11453524us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105106,"reported_tablets":40}
I20260709 12:59:53.500514  7087 raft_consensus.cc:2804] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:53.514870  7087 raft_consensus.cc:697] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:53.514292  1430 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 16 to 17, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 17 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.519322  7087 consensus_queue.cc:237] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:53.570708  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 65012.9us
I20260709 12:59:53.635324  7077 raft_consensus.cc:993] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:53.635871  7063 raft_consensus.cc:1081] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:53.637709  1527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:34406
I20260709 12:59:53.638279  1527 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:53.638644  1527 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:53.675823  1430 catalog_manager.cc:5697] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 11 to 12, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.679157  1527 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:53.700344  1527 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Requested vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:53.700577  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:53.701344  2455 raft_consensus.cc:3055] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:53.701687  2455 raft_consensus.cc:740] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:53.702467  2455 consensus_queue.cc:260] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:53.703526  2455 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:53.711987  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:53.712704  1682 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:53.721407  1682 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:53.717200  2455 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 11.
I20260709 12:59:53.726329  1500 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:53.727907  7059 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:53.728490  7059 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:53.729444  7059 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:53.769176  1430 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 10 to 11, leader changed from 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 11 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.812742  7082 raft_consensus.cc:993] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:53.813316  7082 raft_consensus.cc:1081] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:53.861927  1604 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:53.865811  7038 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:59:53.914583  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 93702.1us
I20260709 12:59:53.935993  1527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:59:53.936832  1527 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:53.937183  1527 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:53.963762  1527 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:53.966516  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:53.967103  1606 raft_consensus.cc:3055] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:53.967406  1606 raft_consensus.cc:740] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:53.968190  1606 consensus_queue.cc:260] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:53.970145  1606 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:53.987248  1606 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:54.003666  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:54.004280  2455 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:54.015933  2455 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:54.020172  1500 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:54.022367  7038 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:54.023489  7038 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:54.024477  7038 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:54.025547  1527 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:54.038201  1682 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:54.052595  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:54.053520  1682 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:54.067240  7095 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:54.074018  1682 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 12.
I20260709 12:59:54.098969  1606 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:54.132184  1430 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 11 to 12, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 12 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.137941  7089 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:59:54.142136  2455 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:54.152316  7096 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:54.161391  1682 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:54.163512  7095 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:54.185206  2451 raft_consensus.cc:1275] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:54.200222  7089 consensus_queue.cc:1048] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:59:54.314419   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:54.389398  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 150745us
I20260709 12:59:54.593284  2455 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:59:54.598299  7105 log.cc:927] Time spent T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:59:54.653796  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 71328.8us
I20260709 12:59:54.686846  7096 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 12:59:54.733760  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 76907.1us
W20260709 12:59:54.798118  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 59521.9us
W20260709 12:59:54.850215  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 325044us
I20260709 12:59:54.864545  1682 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:54.907652  1604 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:59:54.930795  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 51008.1us
I20260709 12:59:54.969381  7125 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:54.997776  1500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 255789us
W20260709 12:59:55.011541  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 206441us
I20260709 12:59:55.028741  7119 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:59:55.211037  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 61463.2us
I20260709 12:59:55.460668   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:55.741722  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 54618.9us
W20260709 12:59:55.746780  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 91522.5us
I20260709 12:59:55.876727  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:59:55.877861  1603 raft_consensus.cc:606] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:55.882653  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:59:55.883605  1603 raft_consensus.cc:606] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Received request to transfer leadership to TS 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:55.897127  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
mode: GRACEFUL
new_leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:41268
I20260709 12:59:55.897905  1603 raft_consensus.cc:606] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Received request to transfer leadership to TS 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:55.986927  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 57720.1us
I20260709 12:59:56.000380   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:56.002166   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:56.018877  7124 raft_consensus.cc:993] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:56.019539  7124 raft_consensus.cc:1081] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:56.060154  1527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d08227f27afa422683d506a582939c6d"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:59:56.060801  1527 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.061184  1527 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:56.074226  1527 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:56.092288  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:56.092914  1603 raft_consensus.cc:3055] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:56.093215  1603 raft_consensus.cc:740] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:56.093952  1603 consensus_queue.cc:260] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:56.095189  1603 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:56.132951  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:56.133618  2475 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:56.168008  1527 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:56.188459  1603 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:56.189252  2475 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 14.
I20260709 12:59:56.192590  1498 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:56.200402  7109 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:56.208667  7109 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:56.209697  7109 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:56.241125  1429 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 13 to 14, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 14 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.247260  7093 raft_consensus.cc:993] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:56.253744  7093 raft_consensus.cc:1081] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Signalling peer 3cabc5110903443ba3beb5cbb14afa91 to start an election
I20260709 12:59:56.256214  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8"
dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:59:56.256919  1681 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.257310  1681 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:56.262563  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 56446.4us
I20260709 12:59:56.271319  1681 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:56.280366  1681 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:56.287474  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
I20260709 12:59:56.288089  1527 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:56.290086  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:56.290696  1604 raft_consensus.cc:3055] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:56.291007  1604 raft_consensus.cc:740] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:56.291743  1604 consensus_queue.cc:260] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:56.292979  1604 raft_consensus.cc:3060] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:56.300832  1527 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:56.304028  1604 raft_consensus.cc:2468] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:56.307468  1647 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:56.308784  7089 raft_consensus.cc:2804] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:56.309473  7089 raft_consensus.cc:697] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:56.311034  7089 consensus_queue.cc:237] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:56.378147  1431 catalog_manager.cc:5697] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 10 to 11, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.446565  7124 raft_consensus.cc:993] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: : Instructing follower 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:56.447121  7093 raft_consensus.cc:1081] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Signalling peer 5a2554c3dead4fcfa5f51708a9ecd5ac to start an election
I20260709 12:59:56.451901  1532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616"
dest_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac"
 from {username='slave'} at 127.0.0.1:60876
I20260709 12:59:56.452478  1532 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.452829  1532 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.471122  1532 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:56.494180  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:56.494426  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:56.494823  1606 raft_consensus.cc:3055] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:56.495062  1681 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.495173  1606 raft_consensus.cc:740] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:56.496150  1606 consensus_queue.cc:260] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:56.497223  1606 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.503228  1681 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:56.494218  1532 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:56.511142  1497 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 
I20260709 12:59:56.512753  7096 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:56.513245  7096 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 LEADER]: Becoming Leader. State: Replica: 5a2554c3dead4fcfa5f51708a9ecd5ac, State: Running, Role: LEADER
I20260709 12:59:56.514269  7096 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:56.527880  1606 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a2554c3dead4fcfa5f51708a9ecd5ac in term 15.
I20260709 12:59:56.590787  1431 catalog_manager.cc:5697] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac reported cstate change: term changed from 14 to 15, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193). New cstate: current_term: 15 leader_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.707209  1606 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:56.709156  7089 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:56.725553  1604 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:59:56.727213  7130 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:56.731540  2455 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:59:56.734783  7130 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:56.803958  1527 raft_consensus.cc:1275] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:56.811472  7128 consensus_queue.cc:1048] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:56.942902  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 84684.3us
I20260709 12:59:57.018807   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:57.056902  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 135743us
W20260709 12:59:57.073649  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 112124us
I20260709 12:59:57.098812  1605 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:59:57.179601  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 71729.9us
I20260709 12:59:57.212198  7175 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:57.253427  1678 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Refusing update from remote peer 5a2554c3dead4fcfa5f51708a9ecd5ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:57.297005   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:59:57.302366  7096 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:57.343538  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 201558us
W20260709 12:59:57.346279  1649 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:57.435600  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 85801.3us
W20260709 12:59:57.453054  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 45805.6us
W20260709 12:59:57.504033  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.548460  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.554960  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.570612  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.645764  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 299471us
W20260709 12:59:57.647953  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 120078us
W20260709 12:59:57.680711  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.685859  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 67647.9us
W20260709 12:59:57.741362  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.742452  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.746192  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.743412  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.749374  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.751681  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.752266  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.752780  1649 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.750801  1575 consensus_peers.cc:597] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.774571  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.753746  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.777484  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.778239  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.757884  1575 consensus_peers.cc:597] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.779563  1575 consensus_peers.cc:597] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.780375  1575 consensus_peers.cc:597] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.780987  1575 consensus_peers.cc:597] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.781713  1575 consensus_peers.cc:597] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.782327  1575 consensus_peers.cc:597] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.782994  1575 consensus_peers.cc:597] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.796872  1575 consensus_peers.cc:597] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.806262  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.831063  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.837430  1575 consensus_peers.cc:597] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.852321  1575 consensus_peers.cc:597] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.863683  1575 consensus_peers.cc:597] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:57.867312  1575 consensus_peers.cc:597] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:57.913394   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:57.919553   431 tablet_replica.cc:333] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:57.926520   431 raft_consensus.cc:2243] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.927235   431 raft_consensus.cc:2272] T 57ee981b108d48998c03e57930745dce P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.941366   431 tablet_replica.cc:333] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:57.943173   431 raft_consensus.cc:2243] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.943820   431 raft_consensus.cc:2272] T b00f4dc45e904f49a3231fc0c487b88d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.946929   431 tablet_replica.cc:333] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:57.948056   431 raft_consensus.cc:2243] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.948755   431 raft_consensus.cc:2272] T e1760e23cca344b0a0ed3ed897bae95f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.952353   431 tablet_replica.cc:333] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:57.953346   431 raft_consensus.cc:2243] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.954667   431 raft_consensus.cc:2272] T 9df8036dd002479a8e558d2ce8e13e9b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.957713   431 tablet_replica.cc:333] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:57.958853   431 raft_consensus.cc:2243] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.959756   431 raft_consensus.cc:2272] T 10ddaea2d1d945b78d8286cc74a41ff9 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.963014   431 tablet_replica.cc:333] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:57.963943   431 raft_consensus.cc:2243] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.965129   431 raft_consensus.cc:2272] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.972685   431 tablet_replica.cc:333] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:57.973610   431 raft_consensus.cc:2243] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.974623   431 raft_consensus.cc:2272] T 9b381ac61d4149f096c7f58d4c53f925 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.978432   431 tablet_replica.cc:333] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:57.981447   431 raft_consensus.cc:2243] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.009806   431 raft_consensus.cc:2272] T 5a253835287048b3b4ce5ffeb6a4dd1f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.025954  7161 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:58.026556  7161 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:58.028770  7161 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:58.029624  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.032225  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831f9b0847f7413f9c00a2e4c5101ba5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.038375  1497 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.048182  7130 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:58.068504   431 tablet_replica.cc:333] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.075455   431 raft_consensus.cc:2243] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.081856   431 raft_consensus.cc:2272] T ae1773d932be4bf48dbb9a17cd28bad4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.103797  7130 raft_consensus.cc:493] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:58.106261  7130 raft_consensus.cc:515] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:58.108439  7130 leader_election.cc:290] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:58.109529  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.124038  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1466701b8a43e09c464cd804cf55c6" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.151700   431 tablet_replica.cc:333] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.152697   431 raft_consensus.cc:2243] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.156358  1497 leader_election.cc:304] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.157470  7161 raft_consensus.cc:2749] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:58.193825   431 raft_consensus.cc:2272] T d08227f27afa422683d506a582939c6d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.195732  7161 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:58.196986  7161 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:58.199117  7161 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:58.200336  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.201476  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd192848be4940efa1406c590f3d2e31" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.225147  1497 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.230588   431 tablet_replica.cc:333] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.233475  7161 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:58.231520   431 raft_consensus.cc:2243] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.249185   431 raft_consensus.cc:2272] T 1d5c791dce8144e7886b1312c2b6200b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.258328   431 tablet_replica.cc:333] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.259186   431 raft_consensus.cc:2243] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.259748   431 raft_consensus.cc:2272] T d859537ee3eb49969dd821b3f75dd33e P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.292326   431 tablet_replica.cc:333] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.293164   431 raft_consensus.cc:2243] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.299757   431 raft_consensus.cc:2272] T 9d6bb2550d6a4cceaf445ac56633cf86 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.312021  7161 raft_consensus.cc:493] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:58.312600  7161 raft_consensus.cc:515] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.315781  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.316911  7161 leader_election.cc:290] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:58.319022  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8085a85190ed479aa2fc71cd75382085" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.321465  1498 leader_election.cc:304] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.322541  7161 raft_consensus.cc:2749] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:58.335804   431 tablet_replica.cc:333] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.336724   431 raft_consensus.cc:2243] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.337852   431 raft_consensus.cc:2272] T 1bcbd7c7333145a3836ea9b6def4d286 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.343677  7163 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:58.344287  7163 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:58.346571  7163 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:58.348706  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.350246  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61da57488ec46278703e8204e8ab905" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.351686  1498 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.352690  7161 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:58.359055  7161 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:58.359972  7161 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.362716  7161 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:58.363498  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.367693  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b55a7fa2a04544a73c2fa785686919" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.367983  7163 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:58.368654  7163 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.370329  1498 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.371424  7130 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:58.375613  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.378489  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e38d8589e334785b807e494aae5aea4" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.378856   431 tablet_replica.cc:333] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.379976   431 raft_consensus.cc:2243] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.380048  1497 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:58.380890   431 raft_consensus.cc:2272] T a61da57488ec46278703e8204e8ab905 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.381040  7130 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:58.383327  7163 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:58.393708   431 tablet_replica.cc:333] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.401754   431 raft_consensus.cc:2243] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.402922   431 raft_consensus.cc:2272] T 22d7b940a3774b7fbb80a3a69355356b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.405787   431 tablet_replica.cc:333] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.406585   431 raft_consensus.cc:2243] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.407639   431 raft_consensus.cc:2272] T a349b676466f492aac774f89c8e55e48 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.415707   431 tablet_replica.cc:333] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.416515   431 raft_consensus.cc:2243] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.417207   431 raft_consensus.cc:2272] T 10aca507e378431ea54a6cce71c236fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.420054   431 tablet_replica.cc:333] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.420871   431 raft_consensus.cc:2243] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.421444   431 raft_consensus.cc:2272] T 8085a85190ed479aa2fc71cd75382085 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.446390   431 tablet_replica.cc:333] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.447162   431 raft_consensus.cc:2243] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.454319   431 raft_consensus.cc:2272] T 9e38d8589e334785b807e494aae5aea4 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.483610   431 tablet_replica.cc:333] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.484612   431 raft_consensus.cc:2243] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.485327   431 raft_consensus.cc:2272] T d2805f2fabf7471abe8442f6cbb32668 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.504755   431 tablet_replica.cc:333] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.506285   431 raft_consensus.cc:2243] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.508462   431 raft_consensus.cc:2272] T a2b55a7fa2a04544a73c2fa785686919 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.517957   431 tablet_replica.cc:333] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.518967   431 raft_consensus.cc:2243] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.520787   431 raft_consensus.cc:2272] T 1b1466701b8a43e09c464cd804cf55c6 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.528702   431 tablet_replica.cc:333] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.532387   431 raft_consensus.cc:2243] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.536141   431 raft_consensus.cc:2272] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.548812   431 tablet_replica.cc:333] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.549744   431 raft_consensus.cc:2243] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.550177  7161 raft_consensus.cc:493] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:58.550539   431 raft_consensus.cc:2272] T 16be7685d9b14fe8a557b6d7572c0296 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.554687   431 tablet_replica.cc:333] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.555667   431 raft_consensus.cc:2243] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.556995   431 raft_consensus.cc:2272] T 049eb4ac8c3a4cb896b8b236a384b04d P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.561092   431 tablet_replica.cc:333] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.566747   431 raft_consensus.cc:2243] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.570631   431 raft_consensus.cc:2272] T f32dbc3da8894f6cbbf52b501c537a5b P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.561651  7163 raft_consensus.cc:493] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:58.572440  7163 raft_consensus.cc:515] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:58.574554  7163 leader_election.cc:290] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:58.575053  7163 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:58.575611   431 tablet_replica.cc:333] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.576573   431 raft_consensus.cc:2243] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.575562  7163 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.580482  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.581509   431 raft_consensus.cc:2272] T 32b6ee54d0d6479194b8ac687bbb1754 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.582743  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.580547  7163 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:58.587900  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b6b7dd0e6c4ab2911c8b5fffbdf68c" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.588128  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954aeabfbeda41f39cf0433b861851fc" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.590523   431 tablet_replica.cc:333] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.591418   431 raft_consensus.cc:2243] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.550803  7161 raft_consensus.cc:515] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.595695  7161 leader_election.cc:290] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:58.598034  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.600122   431 raft_consensus.cc:2272] T fd192848be4940efa1406c590f3d2e31 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.603101   431 tablet_replica.cc:333] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.603981   431 raft_consensus.cc:2243] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.604652   431 raft_consensus.cc:2272] T 555751dc108841d481db7da6ccbf13d5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.613025  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7a515ee1ef4faca822cc4e1083ab3a" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.617617  1498 leader_election.cc:304] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.618602  7163 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:58.619197  7163 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.620245  7161 raft_consensus.cc:2749] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:58.620365  1497 leader_election.cc:304] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.621610  1497 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:58.622145  7130 raft_consensus.cc:2749] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:58.631166  7161 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:58.645641  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.633688   431 tablet_replica.cc:333] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.648157   431 raft_consensus.cc:2243] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.648835   431 raft_consensus.cc:2272] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.634204  7130 raft_consensus.cc:493] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:58.638506  7198 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 12:59:58.640370  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5fb2214fbb40f0a702dbf5aa32966f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.649715  7130 raft_consensus.cc:515] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:58.650496  7198 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:58.652472  7198 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:58.642151  7163 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:58.653542  7130 leader_election.cc:290] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:58.656311   431 tablet_replica.cc:333] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.658265  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.660861  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.665941  1498 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.668551  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2184d3b5e64d249be4c7045975f9a8" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.670346   431 raft_consensus.cc:2243] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.668612  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c0ebcbabe4464da9ad5ec0e0bffd73" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.671458   431 raft_consensus.cc:2272] T b3a9e9cba0fe4487a6b7c88de6410770 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.672580  7197 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:58.678201   431 tablet_replica.cc:333] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.679629  7197 raft_consensus.cc:493] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:58.680233  7197 raft_consensus.cc:515] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.683427  7197 leader_election.cc:290] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:58.684286  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.686101   431 raft_consensus.cc:2243] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.686757   431 raft_consensus.cc:2272] T 831f9b0847f7413f9c00a2e4c5101ba5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.688225  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e050081dd8c146df92c3ba8d2500e7f0" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.690300  1498 leader_election.cc:304] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.692490  7197 raft_consensus.cc:2749] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:58.691660  1497 leader_election.cc:304] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.693341  7197 raft_consensus.cc:2749] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:58.689548   431 tablet_replica.cc:333] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.698066   431 raft_consensus.cc:2243] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.698736   431 raft_consensus.cc:2272] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.701676   431 tablet_replica.cc:333] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.702489   431 raft_consensus.cc:2243] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.703070   431 raft_consensus.cc:2272] T 0d7a515ee1ef4faca822cc4e1083ab3a P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.704507  7197 raft_consensus.cc:493] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e45ac8b66854c2f905bf2c4114cb489)
I20260709 12:59:58.705034  7197 raft_consensus.cc:515] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.708230  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.709477  1497 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.709868  7197 leader_election.cc:290] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:58.710676  1497 raft_consensus.cc:2686] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 5a2554c3dead4fcfa5f51708a9ecd5ac: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:59:58.726307   431 tablet_replica.cc:333] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.727288   431 raft_consensus.cc:2243] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.728622   431 raft_consensus.cc:2272] T 1805a53fe3fc412094cd75832a6e1208 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.731596   431 tablet_replica.cc:333] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.732524   431 raft_consensus.cc:2243] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.733247   431 raft_consensus.cc:2272] T cd2184d3b5e64d249be4c7045975f9a8 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.733536  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525f0b170c13486a8942f69d40971d8f" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.736558  7197 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 12:59:58.737210  7197 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:58.741297  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:58.744395  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:58.767382  1500 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:58.768887  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3ea752cffa4a138dd2984b56316ae5" candidate_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:58.774467  1497 leader_election.cc:304] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a2554c3dead4fcfa5f51708a9ecd5ac; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91
I20260709 12:59:58.775678  7130 raft_consensus.cc:2749] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:58.781940  7130 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.777498   431 tablet_replica.cc:333] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.787235   431 raft_consensus.cc:2243] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.788318   431 raft_consensus.cc:2272] T 95ab1b1d42384792aa38ad0afd616616 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.766558  7197 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:58.800393   431 tablet_replica.cc:333] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.801347   431 raft_consensus.cc:2243] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.801980   431 raft_consensus.cc:2272] T 7c5fb2214fbb40f0a702dbf5aa32966f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.805181   431 tablet_replica.cc:333] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.818140   431 raft_consensus.cc:2243] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.818818   431 raft_consensus.cc:2272] T e050081dd8c146df92c3ba8d2500e7f0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.821663   431 tablet_replica.cc:333] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.823339   431 raft_consensus.cc:2243] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.824548   431 raft_consensus.cc:2272] T cdb1450b85664ac0a6fa149c1f105679 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.843451   431 tablet_replica.cc:333] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.844357   431 raft_consensus.cc:2243] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.845187   431 raft_consensus.cc:2272] T 7c3ea752cffa4a138dd2984b56316ae5 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.848800   431 tablet_replica.cc:333] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.873543   431 raft_consensus.cc:2243] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.874502   431 raft_consensus.cc:2272] T 954aeabfbeda41f39cf0433b861851fc P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.888867   431 tablet_replica.cc:333] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.898957   431 raft_consensus.cc:2243] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.902166   431 raft_consensus.cc:2272] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.905037   431 tablet_replica.cc:333] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.915123   431 raft_consensus.cc:2243] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.916474   431 raft_consensus.cc:2272] T 172d54128ab740c980d9c27aa0ff1761 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.928246   431 tablet_replica.cc:333] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.930688   431 raft_consensus.cc:2243] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.931777   431 raft_consensus.cc:2272] T 525f0b170c13486a8942f69d40971d8f P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.952670   431 tablet_replica.cc:333] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac: stopping tablet replica
I20260709 12:59:58.955586   431 raft_consensus.cc:2243] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.961589   431 raft_consensus.cc:2272] T 6a1b737426124612a1ea1599be6115a0 P 5a2554c3dead4fcfa5f51708a9ecd5ac [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:59.041813  7196 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.042507  7196 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.045074  7196 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:59.046903  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
W20260709 12:59:59.050992  2344 leader_election.cc:336] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.051424  2344 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.077443  7141 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:59.113590  7196 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.114239  7196 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:59.123349  2344 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.140271  7141 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.140935  7141 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.143249  7141 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:59.159687  2344 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.165715  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:59.171007  7196 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:59.186128  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:59.195348  7199 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:59.177858  7185 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.197432  7185 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:59.203900  1649 leader_election.cc:336] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.212327  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:59.209348  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:59.215926  2455 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 18.
I20260709 12:59:59.218137  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.219345  7141 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:59.205919  7185 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.238138  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.241504  7202 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:59.243505  7202 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.249622  7202 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:59.263465  7202 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:59.271093  1649 leader_election.cc:336] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.272972  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df8036dd002479a8e558d2ce8e13e9b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:59.273873  2455 raft_consensus.cc:3060] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:59.284529  2455 raft_consensus.cc:2468] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 19.
I20260709 12:59:59.285714  1649 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.287510  7202 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.287725  7182 raft_consensus.cc:2804] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:59.288345  7182 raft_consensus.cc:697] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 19 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:59.289224  7182 consensus_queue.cc:237] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.294580  7185 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.295197  7185 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.297592  7185 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.301491  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
W20260709 12:59:59.303653  1649 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.311002  2455 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 10.
I20260709 12:59:59.318651  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.320055  7171 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:59.320477  7171 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.320879  7171 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:59.325181  7187 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.325754  7187 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.328104  7187 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:59.333325  1575 leader_election.cc:336] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.336782  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:59.329013  7171 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.338297  1575 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.342461  7187 raft_consensus.cc:2749] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:59.344766  7171 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.346705  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5297d7a3ab0a4faeaf7d74c4c5296b15" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:59.347399  2455 raft_consensus.cc:3060] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:59.348068  1649 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.353379  7187 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.353951  7187 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.360095  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:59.360720  2451 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 10.
I20260709 12:59:59.355997  7187 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.363902  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
W20260709 12:59:59.364782  1575 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.365248  7187 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:59.366160  7187 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.366601  7187 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:59.370141  1430 catalog_manager.cc:5697] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 18 to 19, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.376470  7187 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:59.384526  1575 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.378953  2455 raft_consensus.cc:2468] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:59.385957  1649 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.389302  7185 raft_consensus.cc:2804] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:59.393312  7141 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.396358  7141 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.389811  7185 raft_consensus.cc:697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:59.425212  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:59.398612  7141 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 12:59:59.448027  2344 leader_election.cc:336] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.452271  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b381ac61d4149f096c7f58d4c53f925" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:59.442118  7187 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.452924  2451 raft_consensus.cc:3060] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:59.458019  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.476450  7196 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:59.499675  7199 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.506932  7199 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.452842  7185 consensus_queue.cc:237] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.529112  2451 raft_consensus.cc:2468] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 11.
I20260709 12:59:59.534193  1575 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.538347  7170 raft_consensus.cc:2804] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:59.541847  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:59.543843  1604 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 12:59:59.544570  7170 raft_consensus.cc:697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 12:59:59.545804  7170 consensus_queue.cc:237] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.532588  7199 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:59.555452  2342 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:59.562263  7201 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:59.562676  7201 raft_consensus.cc:493] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.563032  7201 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:59.570941  2344 leader_election.cc:336] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:59.571631  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:59.623257  7201 raft_consensus.cc:515] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.631394  7201 leader_election.cc:290] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:59.629284  7213 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.632107  7213 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.633308  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08227f27afa422683d506a582939c6d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:59.633926  1604 raft_consensus.cc:3060] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:59.634414  7213 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 12:59:59.638533  2344 leader_election.cc:336] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.642063  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:59.624096  1431 catalog_manager.cc:5697] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 10 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.642753  2455 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 16.
I20260709 12:59:59.645774  7187 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.651026  7187 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:59.653420  7187 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:59.654197  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 12:59:59.655515  1649 leader_election.cc:336] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.656621  1604 raft_consensus.cc:2468] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 15.
I20260709 12:59:59.657009  7185 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:59.657413  7185 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.658010  7185 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:59.658641  7187 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.659164  7187 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:59.660204  2342 leader_election.cc:304] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.661365  7187 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:59.661302  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:59.662503  7199 raft_consensus.cc:2804] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:59.663100  7199 raft_consensus.cc:697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:59.664125  7199 consensus_queue.cc:237] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:59.667080  1575 leader_election.cc:336] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.670099  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:59.673118  1572 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.674212  7187 raft_consensus.cc:2749] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:59.670521  1430 catalog_manager.cc:5697] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 10 to 11, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:59.678455  1575 leader_election.cc:336] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.681761  1575 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.683992  7187 raft_consensus.cc:2749] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:59.691392  7185 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.694801  7207 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.695456  7207 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.696369  7185 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.698449  7207 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.708581  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcbd7c7333145a3836ea9b6def4d286" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 12:59:59.709266  2451 raft_consensus.cc:3060] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:59.709929  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:59.716353  1429 catalog_manager.cc:5697] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 14 to 15, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.722121  2451 raft_consensus.cc:2468] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 17.
I20260709 12:59:59.732582  1649 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:59.733386  7207 raft_consensus.cc:2804] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:59.733999  7207 raft_consensus.cc:697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 12:59:59.735011  7207 consensus_queue.cc:237] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.738860  7185 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.739414  7185 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:59.742580  7185 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:59.744057  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:59.755688  1649 leader_election.cc:336] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:59.757261  1649 leader_election.cc:336] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:59.758728  1649 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.759923  7210 raft_consensus.cc:2749] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:59.776865  7185 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.778110  7185 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:59.780382  7185 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:59.779434  1429 catalog_manager.cc:5697] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 16 to 17, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.784816  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 12:59:59.802405  1649 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 12:59:59.803009  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:59.804033  7210 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:59.805339  7199 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.806051  7199 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.811133  7199 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:59.811331  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:59.812568  1682 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 12:59:59.814009  2339 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:59.815080  7199 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:59.815850  7199 raft_consensus.cc:493] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.817819  7199 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:59.826116  2451 raft_consensus.cc:1275] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 19 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:59:59.830994  7210 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.831749  7210 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:59.834132  7210 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:59.836668  7185 consensus_queue.cc:1048] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:59:59.843485  7187 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.844117  7187 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.848212  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:59.848929  1604 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 12:59:59.849932  7187 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 12:59:59.861258  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:59.862948  7185 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:59.863345  7185 raft_consensus.cc:493] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.861347  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 12:59:59.863373  7199 raft_consensus.cc:515] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:59.864363  1649 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 12:59:59.864814  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:59.863862  7185 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:59.866882  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d7b940a3774b7fbb80a3a69355356b" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 12:59:59.867453  1682 raft_consensus.cc:3060] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:59.875046  1682 raft_consensus.cc:2468] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 12:59:59.876454  2339 leader_election.cc:304] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 12:59:59.876988  7213 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:59.877632  7201 raft_consensus.cc:2804] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:59.878177  7201 raft_consensus.cc:697] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 12:59:59.878914  7199 leader_election.cc:290] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:59.879127  7201 consensus_queue.cc:237] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 12:59:59.887321  1575 consensus_peers.cc:597] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:59.888063  1575 consensus_peers.cc:597] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:59.888588  1575 leader_election.cc:336] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 12:59:59.889140  1575 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 12:59:59.890710  1575 consensus_peers.cc:597] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:59.891875  7187 raft_consensus.cc:2749] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:59.885975  7185 raft_consensus.cc:515] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:59.908087  7196 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.908876  7196 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 12:59:59.909787  7185 leader_election.cc:290] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 12:59:59.911921  7196 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:59.913856  2344 leader_election.cc:336] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 12:59:59.924810  2344 leader_election.cc:336] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 12:59:59.926151  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:59.926674  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:59.927083  1649 leader_election.cc:336] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 12:59:59.927361  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:59.934780  1429 catalog_manager.cc:5697] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 11 to 12, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.939352  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a349b676466f492aac774f89c8e55e48" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 12:59:59.940105  1600 raft_consensus.cc:3060] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:59.949275  7187 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.949996  7187 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:59.952850  7187 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 12:59:59.955183  7185 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 12:59:59.955653  1575 consensus_peers.cc:597] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:59.955741  7185 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 12:59:59.956398  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 12:59:59.960361  1681 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 16.
W20260709 12:59:59.956903  1649 leader_election.cc:336] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 12:59:59.959287  7185 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 12:59:59.970271  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:59.970077  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 12:59:59.974618  1600 raft_consensus.cc:2468] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
W20260709 12:59:59.976797  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:59.977299  2344 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 12:59:59.977732  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 12:59:59.981909  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 12:59:59.982595  1604 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
I20260709 12:59:59.974395  7187 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:59.989172  7187 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 12:59:59.989630  7187 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:59.990819  1647 leader_election.cc:304] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 12:59:59.985352  7201 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:59.999095  1647 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 13:00:00.000022  7206 raft_consensus.cc:2804] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:00.000533  7206 raft_consensus.cc:697] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 13:00:00.000689  7207 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:00.001210  7207 raft_consensus.cc:493] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.001654  7207 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:00.001381  7206 consensus_queue.cc:237] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:00.011296  1649 leader_election.cc:336] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:00.026254  7170 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.026935  7170 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.031629  7170 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:00.032490  7205 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 13:00:00.033214  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:00.035390  1575 consensus_peers.cc:597] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.035856  1575 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:00.032997  7205 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:00.047149  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:00.047856  2455 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 13:00:00.038215  7187 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:00.067441  7187 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:00.064983  7207 raft_consensus.cc:515] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:00.069933  7205 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:00.073216  7207 leader_election.cc:290] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:00.077456  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.082121  1649 leader_election.cc:336] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:00.083493  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 13:00:00.086390  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:00.087874  1678 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 15.
I20260709 13:00:00.086136  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a9e9cba0fe4487a6b7c88de6410770" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 13:00:00.088752  1681 raft_consensus.cc:3060] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:00.092636  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.096387  1681 raft_consensus.cc:2468] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 17.
W20260709 13:00:00.098762  1575 consensus_peers.cc:597] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:00.102228  7187 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:00.104282  7187 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.104686  7187 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:00.103291  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 13:00:00.116534  7170 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:00.116660  1572 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 13:00:00.116999  7170 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.117378  1429 catalog_manager.cc:5697] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 12 to 13, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.117677  7214 raft_consensus.cc:2804] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:00.125319  7214 raft_consensus.cc:697] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 17 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 13:00:00.117401  7170 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.126263  7214 consensus_queue.cc:237] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:00.129783  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.135327  7233 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.136009  7233 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.133224  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0b30c9de3e4d5d8160a5cc3d2e1a9c" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 13:00:00.138744  1605 raft_consensus.cc:3060] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:00.144117  7233 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:00.146673  7201 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
W20260709 13:00:00.142899  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.152645  7206 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.150239  7201 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.153262  7206 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.156512  7206 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:00.165985  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:00.166721  1682 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 13:00:00.169376  7199 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.170157  7199 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.172959  7199 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:00.178975  7201 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:00.189073  7200 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.189654  7200 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.192353  7200 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:00.198596  7187 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.200240  1605 raft_consensus.cc:2468] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 13:00:00.203775  2451 raft_consensus.cc:1275] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:00.206813  7170 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:00.209678  7170 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:00.199229  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.210384  2344 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:00.201108  7187 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:00.212694  2451 raft_consensus.cc:1275] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:00:00.216027  2344 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:00.218616  2451 raft_consensus.cc:1275] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:00:00.221014  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:00.226892  2455 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
W20260709 13:00:00.230399  2344 leader_election.cc:336] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:00.229987  1429 catalog_manager.cc:5697] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 16 to 17, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:00.231072  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:00.236968  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:00.237746  2455 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
W20260709 13:00:00.257825  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.258034  7214 consensus_queue.cc:1048] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:00.260371  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 13:00:00.262622  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab1b1d42384792aa38ad0afd616616" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 13:00:00.263288  1682 raft_consensus.cc:3060] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.268877  7214 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:00.269407  7214 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.269887  7214 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:00.281929  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.285465  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
W20260709 13:00:00.304832  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.305022  1682 raft_consensus.cc:2468] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 16.
I20260709 13:00:00.323454  2455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b6ee54d0d6479194b8ac687bbb1754" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 13:00:00.324158  2455 raft_consensus.cc:3060] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:00.334583  1647 leader_election.cc:304] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:00.336037  7182 raft_consensus.cc:2804] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:00.336585  7182 raft_consensus.cc:697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 13:00:00.337482  7182 consensus_queue.cc:237] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:00.332055  7214 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.352602  7214 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:00.355273  2455 raft_consensus.cc:2468] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 14.
W20260709 13:00:00.353864  1575 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:00.360229  1575 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:00.360977  1575 consensus_peers.cc:597] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.361374  1575 consensus_peers.cc:597] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.362668  1575 consensus_peers.cc:597] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.364084  7206 consensus_queue.cc:1048] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:00.366724  7206 consensus_queue.cc:1048] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:00:00.363075  1575 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:00.376156  7170 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.376174  1572 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 13:00:00.378957  7187 raft_consensus.cc:2804] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:00.383947  7187 raft_consensus.cc:697] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 13:00:00.384487  7214 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.384979  7187 consensus_queue.cc:237] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:00.385146  7214 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:00.376775  7170 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.388779  7170 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:00.393546  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 13:00:00.394270  1604 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 12.
I20260709 13:00:00.391970  1429 catalog_manager.cc:5697] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 11 to 12, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.396183  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 13:00:00.396675  7214 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:00.397004  1604 raft_consensus.cc:2393] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 13: Already voted for candidate fc6fbca2eb8d4bec997c51003e277180 in this term.
I20260709 13:00:00.400947  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:00.401636  1678 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 12.
W20260709 13:00:00.401326  1649 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:00.403273  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.403762  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.408691  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:00.409730  1683 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 17.
W20260709 13:00:00.416196  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:00.416687  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.417168  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.417748  1649 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.418769  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 13:00:00.419572  7233 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:00.420127  7233 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.420637  7233 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:00.424710  1683 raft_consensus.cc:1275] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:00.438784  1604 raft_consensus.cc:1275] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:00:00.442601  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180" is_pre_election: true
I20260709 13:00:00.443374  1604 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 13:00:00.440037  7200 consensus_queue.cc:1048] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:00:00.482728  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:00.458702  1429 catalog_manager.cc:5697] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 15 to 16, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.488226  1647 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:00.493319  7213 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:00.495841  1575 consensus_peers.cc:597] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.496353  1575 consensus_peers.cc:597] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.496762  1575 consensus_peers.cc:597] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.497128  1575 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:00.494831  7233 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:00.589486  7211 log.cc:927] Time spent T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: Append to log took a long time: real 0.089s	user 0.009s	sys 0.000s
W20260709 13:00:00.597992  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 107919us
W20260709 13:00:00.600682  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 103562us
W20260709 13:00:00.601337  1575 consensus_peers.cc:597] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.601855  1575 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:00.613385  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:00.618085  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:00.622535  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1805a53fe3fc412094cd75832a6e1208" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 13:00:00.625151  2475 raft_consensus.cc:3060] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:00.627496  2342 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:00.631379  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:00.644326  7200 consensus_queue.cc:1048] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:00.633086  7199 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:00.703912  7199 raft_consensus.cc:493] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.734576  7199 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:00.741364  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:00.756088  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 115730us
I20260709 13:00:00.757484  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:00.764961  1575 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:00.769711  2475 raft_consensus.cc:2468] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 13.
I20260709 13:00:00.776003  7247 raft_consensus.cc:2804] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:00.767020  7200 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:00.772080  7201 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:00.795728  7247 raft_consensus.cc:697] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 13:00:00.799948  2475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:00.802438  1681 raft_consensus.cc:1275] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:00:00.808218   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1555)
I20260709 13:00:00.786441  7200 raft_consensus.cc:493] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5a2554c3dead4fcfa5f51708a9ecd5ac)
I20260709 13:00:00.797523  7247 consensus_queue.cc:237] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.849766  7200 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:00.874851  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 100817us
I20260709 13:00:00.886929  7233 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 18 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:00.895800  1605 raft_consensus.cc:1275] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:00:00.921362  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 83425.5us
W20260709 13:00:00.926949  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 76242.9us
I20260709 13:00:00.912781  7199 raft_consensus.cc:515] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:00.942378  2475 raft_consensus.cc:2393] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc6fbca2eb8d4bec997c51003e277180 in current term 13: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
I20260709 13:00:00.945672  7199 leader_election.cc:290] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:00.958437  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 13:00:00.965209  7243 consensus_queue.cc:1048] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:00:00.969331  1681 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:00.954478  7200 raft_consensus.cc:515] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:01.002068  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1b737426124612a1ea1599be6115a0" candidate_uuid: "fc6fbca2eb8d4bec997c51003e277180" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 13:00:01.002856  1682 raft_consensus.cc:3060] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:00.979079  1681 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 13:00:01.013669  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172d54128ab740c980d9c27aa0ff1761" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 13:00:01.014520  1604 raft_consensus.cc:3060] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:01.021780  1682 raft_consensus.cc:2468] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6fbca2eb8d4bec997c51003e277180 in term 18.
I20260709 13:00:01.025720  1604 raft_consensus.cc:2468] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 13.
I20260709 13:00:01.027890  7200 leader_election.cc:290] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Requested vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:01.083264  1575 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:01.087677  1575 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:01.129005  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 84564.1us
I20260709 13:00:01.123209  1429 catalog_manager.cc:5697] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 13 to 14, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.155459  7213 consensus_queue.cc:1048] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:01.206388  2344 leader_election.cc:336] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:01.207613  2344 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:01.225244  1572 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 
I20260709 13:00:01.226785  7247 raft_consensus.cc:2804] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:01.227684  7247 raft_consensus.cc:697] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 18 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 13:00:01.230165  7247 consensus_queue.cc:237] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:01.267726  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 128673us
I20260709 13:00:01.390734  1575 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:01.425649  1682 raft_consensus.cc:1275] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:01.431326  7252 raft_consensus.cc:2804] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:01.432899  7252 raft_consensus.cc:697] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Becoming Leader. State: Replica: fc6fbca2eb8d4bec997c51003e277180, State: Running, Role: LEADER
I20260709 13:00:01.447875  7252 consensus_queue.cc:237] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:01.452379  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 81406.6us
W20260709 13:00:01.479045  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:01.486281  1605 raft_consensus.cc:1275] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:01.488673  7188 consensus_queue.cc:1048] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:01.502003  2342 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:01.504084  7199 raft_consensus.cc:2804] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:01.504662  7199 raft_consensus.cc:697] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
I20260709 13:00:01.506085  7199 consensus_queue.cc:237] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:01.558254  1429 catalog_manager.cc:5697] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 12 to 13, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:01.574503  1575 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:01.576021  1575 leader_election.cc:336] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:01.576535  1575 leader_election.cc:304] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:01.577534  7252 raft_consensus.cc:2749] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:01.607007  1575 consensus_peers.cc:597] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:01.643422  1431 catalog_manager.cc:5697] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 17 to 18, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.645458  1431 catalog_manager.cc:5697] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 reported cstate change: term changed from 12 to 13, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "fc6fbca2eb8d4bec997c51003e277180" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.678125  2455 raft_consensus.cc:1275] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:01.681689  7268 consensus_queue.cc:1048] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:00:01.692943  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb1450b85664ac0a6fa149c1f105679" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fc6fbca2eb8d4bec997c51003e277180"
I20260709 13:00:01.698760  1681 raft_consensus.cc:1275] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:00:01.707809  1575 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:01.713987  1605 raft_consensus.cc:3060] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:01.714222  1575 consensus_peers.cc:597] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:01.715214  1575 consensus_peers.cc:597] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:01.720036  7188 consensus_queue.cc:1048] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:01.774041  1605 raft_consensus.cc:2468] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 14.
I20260709 13:00:01.784251  7252 consensus_queue.cc:1048] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:00:01.809084   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:01.816439  1575 consensus_peers.cc:597] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:01.817880  2342 leader_election.cc:304] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:01.819511  7201 raft_consensus.cc:2804] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:01.820078  7201 raft_consensus.cc:697] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Becoming Leader. State: Replica: 1e45ac8b66854c2f905bf2c4114cb489, State: Running, Role: LEADER
W20260709 13:00:01.837531  7284 log.cc:927] Time spent T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:00:01.842711  1575 consensus_peers.cc:597] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:01.821120  7201 consensus_queue.cc:237] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:01.891861  1429 catalog_manager.cc:5697] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: term changed from 13 to 14, leader changed from 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) to 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "1e45ac8b66854c2f905bf2c4114cb489" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:01.961977  1681 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:01.968351  7246 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:00:01.989636  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:02.012147  2428 raft_consensus.cc:1275] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer fc6fbca2eb8d4bec997c51003e277180: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:00:02.046978  7247 consensus_queue.cc:1048] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:02.059283  1608 raft_consensus.cc:1275] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:00:02.079524  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 148402us
I20260709 13:00:02.101583  7201 consensus_queue.cc:1048] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:02.161831  1575 consensus_peers.cc:597] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:02.250097  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:02.323596  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.352267  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.357661  1649 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111) [suppressed 378 similar messages]
I20260709 13:00:02.412070  1605 raft_consensus.cc:1275] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Refusing update from remote peer 1e45ac8b66854c2f905bf2c4114cb489: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:02.420491  7196 consensus_queue.cc:1048] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:02.424247  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.460072  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:02.548277  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.582736  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.636193  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.681734  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.701215  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.704516  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.727190  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:02.809628   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:02.850680  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:02.865337  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.898049  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.911088  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.916479  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:02.999670  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.000396  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.034603  1575 consensus_peers.cc:597] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.160353  1575 consensus_peers.cc:597] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.162850  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.207980  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:03.260051  1575 consensus_peers.cc:597] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.262495  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.264134  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:03.300695  1649 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.302258  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:03.315779  1575 consensus_peers.cc:597] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.326704  1575 consensus_peers.cc:597] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.387873  1575 consensus_peers.cc:597] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.424640  1575 consensus_peers.cc:597] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.451900  1575 consensus_peers.cc:597] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.475557  1575 consensus_peers.cc:597] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:03.628849  1575 consensus_peers.cc:597] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.638962  1575 consensus_peers.cc:597] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.740823  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.748749  1575 consensus_peers.cc:597] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:03.769410  1575 consensus_peers.cc:597] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.783227  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:03.801496  1575 consensus_peers.cc:597] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:03.810191   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:04.071862  1575 consensus_peers.cc:597] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:04.238901  1575 consensus_peers.cc:597] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:04.239521  1575 consensus_peers.cc:597] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:04.423240  1575 consensus_peers.cc:597] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:04.474318  1575 consensus_peers.cc:597] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:04.567449  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:04.684018  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:04.728989  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 83396.2us
W20260709 13:00:04.771106  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:04.810670   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:04.832569  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:04.862190  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:04.900031  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 73263.5us
W20260709 13:00:05.026616  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.077708  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.229861  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:05.244524  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.253355  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.286785  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.295897  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.372407  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.418823  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.450541  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.468959  1575 consensus_peers.cc:597] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.471462  1575 consensus_peers.cc:597] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.503635  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.552102  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.552701  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:05.570446  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:05.573010  1575 consensus_peers.cc:597] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.604264  1575 consensus_peers.cc:597] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.626672  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:05.654395  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.662075  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.681737  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.721446  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:05.780769  1575 consensus_peers.cc:597] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.811265   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:05.811414  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.814118  1575 consensus_peers.cc:597] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.844898  1649 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.898838  1575 consensus_peers.cc:597] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:05.916402  1575 consensus_peers.cc:597] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:05.932207  1575 consensus_peers.cc:597] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:05.980870  1575 consensus_peers.cc:597] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:06.076817  1575 consensus_peers.cc:597] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:06.313277  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:06.418727  1575 consensus_peers.cc:597] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:06.424661  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:06.535368  1575 consensus_peers.cc:597] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:06.548171  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 63401.6us
W20260709 13:00:06.682355  1575 consensus_peers.cc:597] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:06.811904   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:06.846838  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 49882us
W20260709 13:00:06.946398  1575 consensus_peers.cc:597] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:06.954362  1575 consensus_peers.cc:597] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:06.975560  1575 consensus_peers.cc:597] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:06.950541  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:07.166199  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:07.167083  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.167716  1575 consensus_peers.cc:597] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:07.299832  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.355756  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:07.362931  2344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111) [suppressed 465 similar messages]
W20260709 13:00:07.368952  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.476042  1575 consensus_peers.cc:597] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:07.593858  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.697818  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.701092  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:07.764376  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.769528  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.771608  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.792646  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.812647   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:07.843703  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.873925  1575 consensus_peers.cc:597] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:07.901608  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:07.931651  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.016096  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.021453  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:08.053663  2339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 67979.7us
W20260709 13:00:08.073521  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.074203  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.148772  1649 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.168335  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:08.184885  1575 consensus_peers.cc:597] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.189007  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.227389  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.269984  1575 consensus_peers.cc:597] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.421867  1575 consensus_peers.cc:597] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.434131  1575 consensus_peers.cc:597] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.544219  1575 consensus_peers.cc:597] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.574815  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35399, user_credentials={real_user=slave}} blocked reactor thread for 130674us
W20260709 13:00:08.632949  1575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 58458.9us
W20260709 13:00:08.647063  1575 consensus_peers.cc:597] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.659857  1575 consensus_peers.cc:597] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:08.673476  1575 consensus_peers.cc:597] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.762881  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 262681us
W20260709 13:00:08.783095  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.802747  1575 consensus_peers.cc:597] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.813650   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:08.833169  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 102471us
W20260709 13:00:08.871275  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:08.921089  1575 consensus_peers.cc:597] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.967818  1575 consensus_peers.cc:597] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:08.969364  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:09.001293  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:09.006703  1575 consensus_peers.cc:597] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:09.117856  1575 consensus_peers.cc:597] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:09.127225  1575 consensus_peers.cc:597] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:09.227175  1575 consensus_peers.cc:597] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:09.392616  1575 consensus_peers.cc:597] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:09.453358  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:09.459019  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:09.640553  1575 consensus_peers.cc:597] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:09.688476  1575 consensus_peers.cc:597] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:09.762372  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:09.814129   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:10.005183  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:10.013747  1682 consensus_queue.cc:237] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:10.031632  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:00:10.042284  2475 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:10.042601  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:10.049842  1603 raft_consensus.cc:1275] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:10.055410  7307 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:10.064196  7307 consensus_queue.cc:1048] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:10.094786  7313 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 4 to 8, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 13:00:10.096581  2475 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 4 to 8, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
I20260709 13:00:10.146777  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c3ea752cffa4a138dd2984b56316ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:00:10.152071  1431 catalog_manager.cc:5697] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 reported cstate change: config changed from index 4 to 8, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New cstate: current_term: 7 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 13:00:10.217332  1575 consensus_peers.cc:597] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.230990  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:10.236205  1605 raft_consensus.cc:2955] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 4 to 8, VOTER 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } } }
W20260709 13:00:10.255446  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.294886  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.304037  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:10.318910  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.347687  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.386221  1419 catalog_manager.cc:4755] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c3ea752cffa4a138dd2984b56316ae5: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:10.423326  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.466251  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.495692  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.529009  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.535316  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.554692  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:10.582038  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.589597  1575 consensus_peers.cc:597] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.620304  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.655298  1575 consensus_peers.cc:597] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.695530  1575 consensus_peers.cc:597] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.721493  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.760835  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:10.793344  1575 consensus_peers.cc:597] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.814639   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:10.862655  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:10.868578  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.960858  1575 consensus_peers.cc:597] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:10.994182  1575 consensus_peers.cc:597] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:11.064999  1575 consensus_peers.cc:597] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:11.097502  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:11.192727  1575 consensus_peers.cc:597] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:11.210685  1575 consensus_peers.cc:597] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:11.337973  1575 consensus_peers.cc:597] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:11.410815  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:11.478227  1575 consensus_peers.cc:597] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:11.542321  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:11.601159  1575 consensus_peers.cc:597] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:11.686370  1419 catalog_manager.cc:4755] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c3ea752cffa4a138dd2984b56316ae5: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:11.711690  1575 consensus_peers.cc:597] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:11.735920  1575 consensus_peers.cc:597] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:11.752715  1575 consensus_peers.cc:597] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:11.815374   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1555)
W20260709 13:00:11.900626  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:11.987385  1575 consensus_peers.cc:597] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:12.038491  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:12.375443  2344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111) [suppressed 444 similar messages]
W20260709 13:00:12.734974  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:12.740280  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:12.799933  1419 catalog_manager.cc:4755] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c3ea752cffa4a138dd2984b56316ae5: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:12.887112  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:12.925699  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:12.928130  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:12.980516  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:12.983510  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:12.992179   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:00:13.183256  1575 consensus_peers.cc:597] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:13.189688  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 55121.1us
I20260709 13:00:13.191174   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:00:13.202531  1575 consensus_peers.cc:597] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:13.216360  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:13.217940  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.281140  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.284192  2342 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.285920  2342 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.290900  1647 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.291915  1647 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.310261  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.322981  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:13.331393  2342 consensus_peers.cc:597] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.331393  1647 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.332497  2342 consensus_peers.cc:597] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.333258  2342 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.351922  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.357839  1575 consensus_peers.cc:597] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.358994  1647 consensus_peers.cc:597] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.359607  1647 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.360153  1647 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.379750  2342 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.404157  2342 consensus_peers.cc:597] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.436192  2342 consensus_peers.cc:597] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.449550  2342 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.451164  1647 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.502626  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.508937  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.532763  2342 consensus_peers.cc:597] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.535113  1647 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.544013  1647 consensus_peers.cc:597] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.551888  1575 consensus_peers.cc:597] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:13.571235   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:00:13.575202  1647 consensus_peers.cc:597] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.583503   431 tablet_replica.cc:333] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.584635   431 raft_consensus.cc:2243] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:00:13.586153  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:13.599498   431 raft_consensus.cc:2272] T b00f4dc45e904f49a3231fc0c487b88d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:13.606616  1647 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.625494  1647 consensus_peers.cc:597] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.629184   431 tablet_replica.cc:333] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
W20260709 13:00:13.634016  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.630467  1575 consensus_peers.cc:597] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:13.639590   431 raft_consensus.cc:2243] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.650422   431 raft_consensus.cc:2272] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.669020   431 tablet_replica.cc:333] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.669906   431 raft_consensus.cc:2243] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.671649   431 raft_consensus.cc:2272] T bf4ba581fa344d64b772795f456096bf P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.674873   431 tablet_replica.cc:333] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.675814   431 raft_consensus.cc:2243] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.676783   431 raft_consensus.cc:2272] T 7340b50d876f414287d4fe7df22e3248 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.681928   431 tablet_replica.cc:333] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.682866   431 raft_consensus.cc:2243] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.684271   431 raft_consensus.cc:2272] T 9b381ac61d4149f096c7f58d4c53f925 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.688266   431 tablet_replica.cc:333] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.689301   431 raft_consensus.cc:2243] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.690236   431 raft_consensus.cc:2272] T 00631bb4062844edb73eb9b0810cc59c P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.693871   431 tablet_replica.cc:333] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.696172   431 raft_consensus.cc:2243] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.698295   431 raft_consensus.cc:2272] T d08227f27afa422683d506a582939c6d P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.701686   431 tablet_replica.cc:333] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.702554   431 raft_consensus.cc:2243] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.703291   431 raft_consensus.cc:2272] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.706738   431 tablet_replica.cc:333] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.707638   431 raft_consensus.cc:2243] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.708933   431 raft_consensus.cc:2272] T 9d6bb2550d6a4cceaf445ac56633cf86 P fc6fbca2eb8d4bec997c51003e277180 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.712396   431 tablet_replica.cc:333] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.713583   431 raft_consensus.cc:2243] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.715247   431 raft_consensus.cc:2272] T a61da57488ec46278703e8204e8ab905 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.718441   431 tablet_replica.cc:333] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.719940   431 raft_consensus.cc:2243] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:00:13.720760  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:13.721638   431 raft_consensus.cc:2272] T 555751dc108841d481db7da6ccbf13d5 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:13.723986  2342 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.726218   431 tablet_replica.cc:333] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.727368   431 raft_consensus.cc:2243] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.728912   431 raft_consensus.cc:2272] T 32b6ee54d0d6479194b8ac687bbb1754 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:13.729671  1647 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.732239  2342 consensus_peers.cc:597] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.740814   431 tablet_replica.cc:333] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.741863   431 raft_consensus.cc:2243] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.743269   431 raft_consensus.cc:2272] T fd192848be4940efa1406c590f3d2e31 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.754890   431 tablet_replica.cc:333] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.756016   431 raft_consensus.cc:2243] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.757388   431 raft_consensus.cc:2272] T a2b55a7fa2a04544a73c2fa785686919 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.761497   431 tablet_replica.cc:333] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.762534   431 raft_consensus.cc:2243] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.763278   431 raft_consensus.cc:2272] T 1b1466701b8a43e09c464cd804cf55c6 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.767001   431 tablet_replica.cc:333] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.767884   431 raft_consensus.cc:2243] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.768905   431 raft_consensus.cc:2272] T 74265c5d23584d47a1a5cca905a68876 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.772276   431 tablet_replica.cc:333] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.773164   431 raft_consensus.cc:2243] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.782452   431 raft_consensus.cc:2272] T a349b676466f492aac774f89c8e55e48 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.785326   431 tablet_replica.cc:333] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.786294   431 raft_consensus.cc:2243] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.789484   431 raft_consensus.cc:2272] T 10aca507e378431ea54a6cce71c236fc P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.792846   431 tablet_replica.cc:333] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.793895   431 raft_consensus.cc:2243] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.794924   431 raft_consensus.cc:2272] T 8085a85190ed479aa2fc71cd75382085 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.802914   431 tablet_replica.cc:333] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.804003   431 raft_consensus.cc:2243] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.805051   431 raft_consensus.cc:2272] T 6d9ed6ddb0bc46ec944198e737aa5f57 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.810359   431 tablet_replica.cc:333] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.811327   431 raft_consensus.cc:2243] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.813005   431 raft_consensus.cc:2272] T b3a9e9cba0fe4487a6b7c88de6410770 P fc6fbca2eb8d4bec997c51003e277180 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.819486   431 tablet_replica.cc:333] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.826555   431 raft_consensus.cc:2243] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.828172   431 raft_consensus.cc:2272] T 16be7685d9b14fe8a557b6d7572c0296 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:13.840211  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:13.866367  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:13.877799   431 tablet_replica.cc:333] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.894279   431 raft_consensus.cc:2243] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.897346   431 raft_consensus.cc:2272] T 049eb4ac8c3a4cb896b8b236a384b04d P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:13.916318  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:13.928751   431 tablet_replica.cc:333] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.931380   431 raft_consensus.cc:2243] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.932214   431 raft_consensus.cc:2272] T d2805f2fabf7471abe8442f6cbb32668 P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.935443   431 tablet_replica.cc:333] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.936651   431 raft_consensus.cc:2243] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:13.938422   431 raft_consensus.cc:2272] T 831f9b0847f7413f9c00a2e4c5101ba5 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.942695   431 tablet_replica.cc:333] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.955207   431 raft_consensus.cc:2243] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.957304   431 raft_consensus.cc:2272] T 71c02c60c1a5490183c0690cd8c98176 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.964689   431 tablet_replica.cc:333] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.965701   431 raft_consensus.cc:2243] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.966933   431 raft_consensus.cc:2272] T 062a0e40b92a4b4f9763c2dd8d13aa5f P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.971330   431 tablet_replica.cc:333] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.972242   431 raft_consensus.cc:2243] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.972927   431 raft_consensus.cc:2272] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P fc6fbca2eb8d4bec997c51003e277180 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.976293   431 tablet_replica.cc:333] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.977890   431 raft_consensus.cc:2243] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.978641   431 raft_consensus.cc:2272] T 172d54128ab740c980d9c27aa0ff1761 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.982738   431 tablet_replica.cc:333] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.983985   431 raft_consensus.cc:2243] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.985036   431 raft_consensus.cc:2272] T 7aa902e4626a464fabe120fcad834ad0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.994851   431 tablet_replica.cc:333] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:13.996081   431 raft_consensus.cc:2243] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.997136   431 raft_consensus.cc:2272] T e050081dd8c146df92c3ba8d2500e7f0 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.001822   431 tablet_replica.cc:333] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.003176   431 raft_consensus.cc:2243] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.004592   431 raft_consensus.cc:2272] T cdb1450b85664ac0a6fa149c1f105679 P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.007761   431 tablet_replica.cc:333] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.014061   431 raft_consensus.cc:2243] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.015200   431 raft_consensus.cc:2272] T 7c3ea752cffa4a138dd2984b56316ae5 P fc6fbca2eb8d4bec997c51003e277180 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.036191   431 tablet_replica.cc:333] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
W20260709 13:00:14.039769  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:14.085880  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 46158.3us
I20260709 13:00:14.040105   431 raft_consensus.cc:2243] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.101141   431 raft_consensus.cc:2272] T 5741b07c783e4193be39d19fba6c5cec P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.126444   431 tablet_replica.cc:333] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.139751   431 raft_consensus.cc:2243] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:00:14.142263   431 raft_consensus.cc:2272] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.183390   431 tablet_replica.cc:333] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.184446   431 raft_consensus.cc:2243] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.187567   431 raft_consensus.cc:2272] T 0d7a515ee1ef4faca822cc4e1083ab3a P fc6fbca2eb8d4bec997c51003e277180 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.195134   431 tablet_replica.cc:333] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.203612   431 raft_consensus.cc:2243] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.204447   431 raft_consensus.cc:2272] T 390bda9334de482bb1f2274e10fe5743 P fc6fbca2eb8d4bec997c51003e277180 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.216461   431 tablet_replica.cc:333] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.217334   431 raft_consensus.cc:2243] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:14.218742   431 raft_consensus.cc:2272] T 1805a53fe3fc412094cd75832a6e1208 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.221837   431 tablet_replica.cc:333] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.222715   431 raft_consensus.cc:2243] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.223415   431 raft_consensus.cc:2272] T 77f1e53da9e94a8e8859328c4a06b68a P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.226615   431 tablet_replica.cc:333] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.227479   431 raft_consensus.cc:2243] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.228204   431 raft_consensus.cc:2272] T cd2184d3b5e64d249be4c7045975f9a8 P fc6fbca2eb8d4bec997c51003e277180 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.231218   431 tablet_replica.cc:333] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.232076   431 raft_consensus.cc:2243] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:00:14.233847   431 raft_consensus.cc:2272] T 95ab1b1d42384792aa38ad0afd616616 P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.237079   431 tablet_replica.cc:333] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.238165   431 raft_consensus.cc:2243] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:14.247565   431 raft_consensus.cc:2272] T 7c5fb2214fbb40f0a702dbf5aa32966f P fc6fbca2eb8d4bec997c51003e277180 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.262871   431 tablet_replica.cc:333] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.263803   431 raft_consensus.cc:2243] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.265200   431 raft_consensus.cc:2272] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P fc6fbca2eb8d4bec997c51003e277180 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.268778   431 tablet_replica.cc:333] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.269600   431 raft_consensus.cc:2243] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:00:14.270892   431 raft_consensus.cc:2272] T ae1773d932be4bf48dbb9a17cd28bad4 P fc6fbca2eb8d4bec997c51003e277180 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.273736   431 tablet_replica.cc:333] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.275602   431 raft_consensus.cc:2243] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:14.276437   431 raft_consensus.cc:2272] T 5a253835287048b3b4ce5ffeb6a4dd1f P fc6fbca2eb8d4bec997c51003e277180 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:14.279407   431 tablet_replica.cc:333] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180: stopping tablet replica
I20260709 13:00:14.280150   431 raft_consensus.cc:2243] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:00:14.281348   431 raft_consensus.cc:2272] T 6a1b737426124612a1ea1599be6115a0 P fc6fbca2eb8d4bec997c51003e277180 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:14.384491  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:14.446331  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:14.511651  1647 connection.cc:769] client connection to 127.0.107.194:35057 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 13:00:14.522249  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:14.698354  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:14.744234  7354 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:14.745014  7354 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:14.752470  7354 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:14.758314  2344 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:14.759342  2342 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:14.759745  2342 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:14.760978  7354 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:14.843014  7354 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:14.843665  7354 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:14.846364  7354 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:14.851354  7367 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:14.852103  7367 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:14.860880  7354 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 13:00:14.861936  2344 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:14.862601  7355 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:14.869645  7355 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:14.872051  7355 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:14.871868  2342 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:14.862656  7354 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:14.874918  7354 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:14.874991  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:14.880868  2344 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:14.877846  1647 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:14.866199  7367 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:14.882210  7330 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:14.886360  1649 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:14.889636  1649 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:14.887509  1647 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:14.890300  7354 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:14.891970  7354 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:14.894371  7367 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:14.895081  1649 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:14.898871  1649 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:14.902683  7370 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:14.899601  2342 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:14.903823  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:14.903903  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:14.904536  7354 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:14.907490  7330 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:14.914721  2342 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:14.915345  2342 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:14.916239  7354 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:14.928740  1419 catalog_manager.cc:4755] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c3ea752cffa4a138dd2984b56316ae5: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:14.933009  7370 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:14.933712  7370 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:14.938212  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:14.938810  2451 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 16.
I20260709 13:00:14.940186  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 13:00:14.940995  7367 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:14.941341  7367 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:14.941691  7367 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:14.945787  7370 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 13:00:14.952812  1647 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:14.956826  7367 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:14.972286  7370 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:14.972831  7367 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:14.973946  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4ba581fa344d64b772795f456096bf" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 13:00:14.974573  2451 raft_consensus.cc:3060] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:14.982285  7370 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:15.003124  1649 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.004940  7370 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:15.006620  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:15.010458  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:15.011512  7367 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:15.008162  2451 raft_consensus.cc:2468] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 17.
I20260709 13:00:15.018819  1649 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
W20260709 13:00:15.020143  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:15.021715  7370 raft_consensus.cc:2804] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:15.023169  7370 raft_consensus.cc:697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 17 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 13:00:15.024283  7370 consensus_queue.cc:237] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:15.032361  1647 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.037889  7330 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.069630  7330 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:15.072711  7330 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:15.079118  2344 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:15.080449  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 48125.8us
W20260709 13:00:15.097775  1647 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:15.098179  2342 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.109887  2342 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.102530  7374 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.116684  7374 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:15.117234  7354 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:15.118459  7354 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.120345  7354 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:15.124400  7354 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:15.127225  2344 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.129500  7374 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:15.137758  2344 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.144488  1431 catalog_manager.cc:5697] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 16 to 17, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:15.155705  2342 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.156512  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.157755  7367 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 13:00:15.158771  2342 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.159308  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.157795  7374 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:15.160470  7374 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:15.158419  7367 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:15.167876  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:00:15.172901  7370 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.173883  7370 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:15.176469  7370 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:15.168607  7367 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:15.184039  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:15.185240  1680 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 13:00:15.229101  7355 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.229806  7355 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:15.233530  7355 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:15.285933  7374 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.286672  7374 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:15.289353  7374 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:15.297847  2342 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:15.312896  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:00:15.316213  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:15.316953  2451 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 13:00:15.346576  1649 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:15.347404  1649 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:15.365545  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:00:15.366415  7355 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.367069  7355 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:15.369302  7355 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:15.371371  7367 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.371989  7367 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:15.374914  7367 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:15.386106  7370 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.389058  7370 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:15.391827  7370 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:15.386766  7355 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.396018  7355 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:15.412484  7355 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:15.413674  7379 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.414373  7379 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:15.416743  7379 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:15.421198  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:15.422039  1680 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
W20260709 13:00:15.426736  1647 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.427415  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:15.429034  1647 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.429070  1649 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 13:00:15.430951  7379 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:15.430842  1647 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.431466  7379 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.433355  7379 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.433866  7377 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:15.429746  7355 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:15.436115  1647 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.446617  7379 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:15.445304  1647 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:15.448814  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:15.448895  7379 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:15.462406  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.463356  7374 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:15.463771  7374 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.464179  7374 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.473404  7374 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:15.481004  1647 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:15.481514  1647 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:15.481976  1647 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.482622  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 13:00:15.483474  2423 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cabc5110903443ba3beb5cbb14afa91 in current term 12: Already voted for candidate 1e45ac8b66854c2f905bf2c4114cb489 in this term.
W20260709 13:00:15.490851  2342 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.492180  7379 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.492820  7379 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:15.482681  1647 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.495345  7379 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:15.498266  1649 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.498772  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:15.499060  1647 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:15.499591  1647 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:15.499801  1649 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:15.500316  1647 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:15.500720  1647 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.500839  1649 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.501108  7379 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:15.502218  7380 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:15.504252  1649 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.504825  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:15.505345  1647 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.510720  7374 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:15.511428  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91"
I20260709 13:00:15.512163  1680 raft_consensus.cc:2393] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e45ac8b66854c2f905bf2c4114cb489 in current term 12: Already voted for candidate 3cabc5110903443ba3beb5cbb14afa91 in this term.
I20260709 13:00:15.513096  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.514348  7374 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:15.514636  7379 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:15.515945  1649 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.516366  1649 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.517082  7379 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:15.518213  1649 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.518623  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.519281  7379 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:15.525239  1649 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 1e45ac8b66854c2f905bf2c4114cb489, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.525990  7379 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:15.528218  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:15.531517   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1630)
W20260709 13:00:15.540184  1649 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.540711  1649 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.542476  7379 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:15.550195  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:15.552467  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:15.559710  7354 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.560328  7354 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:15.562620  7354 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:15.570492  2342 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:15.573495  2344 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.573995  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.574708  7330 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:15.580732  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:15.610185  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:15.612540  2342 consensus_peers.cc:597] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:15.624709  7354 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.625293  7354 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:15.627311  7354 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:15.629494  1647 consensus_peers.cc:597] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:15.632697  2423 raft_consensus.cc:1275] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:00:15.634141  2344 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:15.634511  7380 consensus_queue.cc:1048] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:00:15.662415  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:15.689911  1647 consensus_peers.cc:597] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:15.708312  1647 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:15.728057  1647 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:15.758037  7380 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:15.758659  7380 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:15.765049  1649 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:15.772123  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:00:15.772823  7380 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:15.775487  1647 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:15.778697  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:15.781183  7380 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:15.823449  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:15.891763  1647 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:15.934880  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:15.964766  1647 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:15.968322  1647 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:15.994858  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:16.035638  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:16.037273  1647 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.040161  1647 consensus_peers.cc:597] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.113889  1647 consensus_peers.cc:597] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.176064  1647 consensus_peers.cc:597] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.192488  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:16.251420  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:16.305230  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:16.320122  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:16.411654  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:00:16.499063  7354 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:16.499774  7354 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:16.505223  7354 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:16.507833  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:16.508080  2344 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:16.533209   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1630)
I20260709 13:00:16.652472  7354 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:16.653204  7354 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:16.666227  7354 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:16.660157  2342 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:16.684931  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 90510.4us
I20260709 13:00:16.789315  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:16.801820  7354 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:16.802739  2342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 142589us
W20260709 13:00:16.819621  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:16.829952  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:16.834771  2344 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:16.838747  2342 consensus_peers.cc:597] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.839365  2342 consensus_peers.cc:597] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.841048  2342 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.845181  2342 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.847407  2342 consensus_peers.cc:597] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.849327  2342 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.853456  2342 consensus_peers.cc:597] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.854064  2342 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.857019  2342 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.859261  2342 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:16.859917  2342 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:16.860419  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:16.861285  7392 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:16.871081  2342 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:16.871650  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:16.872932  7392 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:16.877256  7393 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:16.877925  7393 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:16.891288  1649 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:16.892446  7393 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:16.898662  1647 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:16.899307  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:16.900332  7393 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:16.947317  7392 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:16.947947  7392 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:16.954486  7392 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:16.961419  2344 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:16.962185  2342 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:16.962610  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:16.965306  7391 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:16.982651  7391 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:16.983354  7391 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:16.990877  2344 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:16.994831  7391 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:16.998021  2342 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:16.998603  2342 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.000351  7391 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:17.010767  7391 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.014321  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:17.014977  1680 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
I20260709 13:00:17.013410  7391 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:17.031334  2344 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.044193  7391 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:17.044885  7393 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.045537  7393 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:17.046056  2342 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.046497  2342 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.047513  7354 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:17.047786  7393 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:17.052963  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:17.059195  1649 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.063957  7380 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.064561  7380 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:17.066705  7380 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:17.079921  1649 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.102841  7393 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.103546  7393 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:17.104861  7389 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.106585  7389 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:17.108865  7389 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:17.112303  7393 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:17.127897  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:17.128799  2451 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 12.
I20260709 13:00:17.141281  1649 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 13:00:17.147130  7393 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:17.147720  7393 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.148360  7393 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:17.154589  1647 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.158178  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.159099  7380 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.159786  7380 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:17.162108  7380 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:17.163383  7380 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:17.171782  1647 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.177811  1647 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:17.170751  1649 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.193878  7389 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:17.205536  2342 consensus_peers.cc:597] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:17.239063  7393 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:17.253650  7380 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.260987  7380 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:17.246204  1649 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.267831  7380 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:17.279633  1647 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:17.281119  1647 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.290752  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.289526  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74265c5d23584d47a1a5cca905a68876" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489"
I20260709 13:00:17.295011  2451 raft_consensus.cc:3060] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:17.269722  7393 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Requested vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:17.303994  2451 raft_consensus.cc:2468] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 13.
I20260709 13:00:17.306761  7388 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:17.329532  7388 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.330250  7388 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:17.332532  7388 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:17.339119  1649 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 
I20260709 13:00:17.348219  7388 raft_consensus.cc:2804] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:17.348758  7388 raft_consensus.cc:697] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Becoming Leader. State: Replica: 3cabc5110903443ba3beb5cbb14afa91, State: Running, Role: LEADER
I20260709 13:00:17.349840  7388 consensus_queue.cc:237] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:17.347313  1647 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.355334  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.358121  7393 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:17.357553  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:17.364952  1649 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.368790  7330 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.369375  7330 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:17.371476  7330 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:17.377507  2342 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:17.379518  2344 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.379979  2344 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:17.380836  1649 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.381114  7330 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:17.400290  1431 catalog_manager.cc:5697] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 reported cstate change: term changed from 11 to 13, leader changed from fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194) to 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "3cabc5110903443ba3beb5cbb14afa91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:17.411578  1649 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111) [suppressed 567 similar messages]
I20260709 13:00:17.431330  7388 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.432469  7388 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:17.435057  7388 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:17.443583  1647 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.448189  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.517002  7389 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:17.521767  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 78215.1us
W20260709 13:00:17.522361  1647 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:17.526546  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:17.533787   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1630)
I20260709 13:00:17.542735  7380 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.544546  7380 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:17.553769  7380 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:17.567973  1649 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.569142  7388 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.570869  7388 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:17.573009  7388 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:17.593284  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:17.597070  1647 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.600868  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.603572  7380 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:17.600353  1649 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:17.606849  1649 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:17.610391  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:00:17.631187  1647 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.633067  7388 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:17.638823  7388 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:17.642000  7388 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:17.643308  1647 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:17.648736  1647 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.653225  1647 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.649298  7388 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:17.669090  1649 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:17.669804  7393 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:17.683215  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080035c2a0 after lost signal to thread 434
W20260709 13:00:17.684451  1463 debug-util.cc:398] Leaking SignalData structure 0x7b080013f9a0 after lost signal to thread 1466
W20260709 13:00:17.685932  1463 debug-util.cc:398] Leaking SignalData structure 0x7b0800034360 after lost signal to thread 1707
W20260709 13:00:17.687260  1463 debug-util.cc:398] Leaking SignalData structure 0x7b08000358a0 after lost signal to thread 2510
W20260709 13:00:17.744549  1647 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.748833  1647 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.753012  7388 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:17.799175  7354 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 13:00:17.799697  1647 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:17.799736  7354 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:17.802147  1647 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.802541  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:17.803431  7354 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:17.807925  2344 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:17.809787  2342 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:17.810283  2342 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:17.810556  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:00:17.811571  7354 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:17.821797  7388 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:17.827560  1647 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:17.888516  2451 raft_consensus.cc:1275] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Refusing update from remote peer 3cabc5110903443ba3beb5cbb14afa91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:17.890888  7388 consensus_queue.cc:1048] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:00:17.910282  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:17.916889  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:17.986234  1647 consensus_peers.cc:597] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:17.999845  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.025516  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.053447  1647 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.082993  1647 consensus_peers.cc:597] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:18.140457  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.146283  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.164286  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:18.232438  1647 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.264145  1647 consensus_peers.cc:597] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.282732  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.361675  1647 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.365091  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.393693  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.409333  1647 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.432634  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.439254  1647 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.494221  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.499837  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.534267   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1630)
W20260709 13:00:18.577970  1647 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.594015  1647 consensus_peers.cc:597] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:18.606128  7330 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:18.606731  7330 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:18.608803  7330 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:18.613416  1647 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.625700  2344 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:18.654963  2342 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:18.655947  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:18.657603  7330 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:18.722193  2342 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.725693  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:18.766459  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:00:18.771906  7330 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:18.772473  7330 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:18.774463  7330 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:18.788128  7380 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:18.788702  7380 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:18.790813  7380 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:18.793876  7389 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:18.794431  7389 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:18.796470  7389 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:18.805239  2342 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:18.809337  1647 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:18.809818  2344 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:18.810262  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:18.811901  7392 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:18.820744  1647 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:18.823817  1649 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:18.824400  1649 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:18.825344  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:18.826537  1649 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:18.825946  7389 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:18.828131  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:18.836185  7389 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:18.838399  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:00:18.861331  7389 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:18.862216  7389 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:18.871248  7389 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
W20260709 13:00:18.878265  1647 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:18.880023  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:18.881584  2423 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 13:00:18.882797  1649 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:18.883962  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:18.885861  7389 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:18.912235  1647 consensus_peers.cc:597] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:18.931077  7380 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:18.931607  7380 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:18.933682  7380 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:18.946790  2342 consensus_peers.cc:597] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.944968  1649 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:18.948199  1647 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:18.949266  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:18.950785  7380 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:18.959941  7380 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:18.960474  7380 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:18.962831  7380 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:18.970283  1649 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:18.980867  1647 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:18.981577  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:18.995354  2342 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:18.995904  2342 consensus_peers.cc:597] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:18.996078  7389 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:19.090835  1419 catalog_manager.cc:4755] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c3ea752cffa4a138dd2984b56316ae5: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:19.117020  2342 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:19.124298  2342 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:19.133759  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:00:19.143757  7389 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:19.144508  7389 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:19.146795  7389 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:19.172890  2342 consensus_peers.cc:597] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:19.199971  1649 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:19.218696  1647 consensus_peers.cc:597] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:19.224956  1647 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:19.226109  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:19.236492  2342 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:19.241276  7389 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:19.254851  2342 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:19.309788  2342 consensus_peers.cc:597] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:19.339062  7389 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:19.339654  7389 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:19.341856  7389 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:19.347987  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:19.351486  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:19.365211  1647 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:19.366477  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:19.376885  1649 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:19.377715  1649 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:19.378490  7389 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:19.397977  7389 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:19.398712  7389 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:19.423990  1649 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:19.431603  7389 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:19.440256  1647 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:19.440991  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:19.443356  7389 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:19.480532  2342 consensus_peers.cc:597] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:19.534852   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1630)
I20260709 13:00:19.576941  7389 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:19.579617  7389 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:19.582767  7389 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:19.615278  1647 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:19.655592  2342 consensus_peers.cc:597] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:19.671896  1649 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:19.676550  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:19.677584  7380 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:19.690001  7404 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:19.690701  7404 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:19.694109  7404 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:19.698032  2344 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:19.706218  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:00:19.714797  7389 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:19.715512  7389 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:19.717808  7389 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:19.724802  1647 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:19.725169  2342 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:19.733341  2342 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:19.734300  7404 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:19.761188  1649 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:19.767023  1649 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:19.768103  7389 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:19.779582  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:00:19.925895  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:00:19.946638  7380 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:19.947378  7380 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:19.949811  7380 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:19.959621  1647 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:19.960394  1649 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:19.960919  1649 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:19.961652  7380 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:19.996402  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:00:20.052230  7380 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:20.052829  7380 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:20.055399  7380 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:20.066689  1647 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:20.069337  1649 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:20.069851  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:20.071722  7389 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:20.102250  7330 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:20.103012  7330 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:20.126997  2344 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:20.139513  1647 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:00:20.140357  7330 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:20.260613  2342 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:20.262354  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:20.264472  7404 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:20.307571  7404 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:20.308208  7404 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:20.310587  7404 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:20.312657  7404 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 13:00:20.319175  2344 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:20.313436  7404 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:20.324136  7404 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:20.335565  2344 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:20.346274  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:46719, user_credentials={real_user=slave}} blocked reactor thread for 55249.9us
W20260709 13:00:20.358255  2342 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:20.361585  2342 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:20.362432  7404 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:20.363703  2342 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:20.364293  2342 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:20.365242  7404 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:20.386538  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:20.391757  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:00:20.425282  7409 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:20.426084  7409 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:20.427423  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:00:20.446291  7409 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:20.447991  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:20.449095  2423 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 13:00:20.472659  1649 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:20.473976  1647 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:20.474992  1647 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489, 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:20.476125  7409 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:20.535521   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1630)
W20260709 13:00:20.540016  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:20.545289  1647 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:20.552381  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:00:20.575810  7330 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:20.576345  7330 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:20.578786  7330 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:20.592634  2342 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:20.595273  2344 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:20.599864  2344 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:20.600654  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:00:20.602425  7330 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:20.610512  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:20.623050  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:20.715042  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:20.720903  1647 consensus_peers.cc:597] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:20.751842  1647 consensus_peers.cc:597] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:20.772872  1647 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:20.829694  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:20.830084  1647 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:20.853039  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:20.853744  1647 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:20.894591  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:20.900015  1647 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:20.950140  1647 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:20.980362  1647 consensus_peers.cc:597] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:21.000972  1647 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.005508  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:21.035287  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:21.059561  2342 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.064002  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:21.069941  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:21.091887  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:21.146787  2342 consensus_peers.cc:597] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:00:21.268029  7330 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:21.268673  7330 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:21.271692  7330 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:21.279668  2342 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:21.282526  2344 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:21.283035  2344 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:21.285010  7330 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:21.336484  1647 consensus_peers.cc:597] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:00:21.352953  7380 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:21.353488  7380 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:21.356133  7380 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:21.371479  1647 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:21.395640  1649 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:21.398007  1649 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:21.401929  7380 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:21.439162  1647 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.446247  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 50500.2us
W20260709 13:00:21.447672  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:00:21.462209  7409 raft_consensus.cc:493] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:21.464103  7409 raft_consensus.cc:515] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:21.480913  7409 leader_election.cc:290] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:21.487565  1649 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:21.496981  7416 raft_consensus.cc:493] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:21.498814  7416 raft_consensus.cc:515] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:21.503067  7416 leader_election.cc:290] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:21.522334  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:21.529207  2342 consensus_peers.cc:597] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.530376  2342 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.532028  1649 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:21.539604   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1630)
W20260709 13:00:21.543759  1647 leader_election.cc:336] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:21.544423  1647 leader_election.cc:304] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:21.545502  1647 leader_election.cc:336] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:21.546029  1647 leader_election.cc:304] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:21.546219  7413 raft_consensus.cc:2749] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:21.546933  7416 raft_consensus.cc:2749] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:21.568405  2342 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.572940  2342 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.591280  2342 consensus_peers.cc:597] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:00:21.608002  7416 raft_consensus.cc:493] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:21.609027  7416 raft_consensus.cc:515] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:21.614566  2342 consensus_peers.cc:597] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:00:21.616026  7416 leader_election.cc:290] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:21.620133  1647 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:21.621407  1649 leader_election.cc:336] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:21.621964  1649 leader_election.cc:304] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:21.624302  7416 raft_consensus.cc:2749] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:21.633348  1647 consensus_peers.cc:597] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.657433  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:21.667793  1647 consensus_peers.cc:597] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:00:21.682417  7416 raft_consensus.cc:493] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:21.683665  7416 raft_consensus.cc:515] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:21.703608  7416 leader_election.cc:290] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:21.721215  1649 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:21.731484  1647 leader_election.cc:336] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:21.732126  1647 leader_election.cc:304] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:21.733939  7413 raft_consensus.cc:2749] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:21.758909  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:21.796319  2342 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:21.846818  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:21.896713  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:21.922254  2342 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:22.130702  2342 consensus_peers.cc:597] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:22.193500  2342 consensus_peers.cc:597] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:00:22.267064  7416 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:22.267807  7416 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:22.272774  7416 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:22.279660  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:22.281217  1649 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:22.284471  1647 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:22.284919  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:22.285466  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:00:22.286401  7416 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:22.415807  1649 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111) [suppressed 603 similar messages]
I20260709 13:00:22.433495  7416 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:22.434897  7416 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
W20260709 13:00:22.449013  1649 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:22.452488  7416 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:22.453128  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:22.474383  1647 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:22.474983  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:22.476646  7416 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:22.502322  7418 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:22.503129  7418 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:22.507733  7418 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719)
I20260709 13:00:22.509747  2451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "3cabc5110903443ba3beb5cbb14afa91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e45ac8b66854c2f905bf2c4114cb489" is_pre_election: true
I20260709 13:00:22.511716  2451 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cabc5110903443ba3beb5cbb14afa91 in term 11.
W20260709 13:00:22.513816  1647 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:22.515384  1649 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:22.517437  1649 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:22.521302  7416 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:22.540117   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1630)
W20260709 13:00:22.540057  1647 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:22.757000  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:22.937345  1647 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:22.944104  7416 raft_consensus.cc:493] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:22.944828  7416 raft_consensus.cc:515] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:22.947278  7416 leader_election.cc:290] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:22.955179  1649 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:22.962154  1647 leader_election.cc:336] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:22.962757  1647 leader_election.cc:304] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:22.963261  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:00:22.963634  7416 raft_consensus.cc:2749] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:22.966290  7410 raft_consensus.cc:493] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:22.967060  7410 raft_consensus.cc:515] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:22.969530  7410 leader_election.cc:290] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:22.978374  2342 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:22.983929  2344 leader_election.cc:336] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:22.986585  2344 leader_election.cc:304] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:22.988430  1649 consensus_peers.cc:597] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:00:23.004993  7410 raft_consensus.cc:2749] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:23.018865  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:00:23.031183  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:23.086210  1649 consensus_peers.cc:597] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:23.107930  1649 consensus_peers.cc:597] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:23.125322  1647 consensus_peers.cc:597] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:23.145046  1647 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.157199  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:00:23.210451  7418 raft_consensus.cc:493] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:23.211329  7418 raft_consensus.cc:515] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:23.213727  7418 leader_election.cc:290] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:23.221522  1649 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:23.225198  1647 leader_election.cc:336] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:23.227813  1647 leader_election.cc:304] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:23.229305  7416 raft_consensus.cc:2749] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:23.240846  1649 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:23.272171  1649 consensus_peers.cc:597] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:23.283730  1647 consensus_peers.cc:597] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.342793  1647 consensus_peers.cc:597] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:23.343358  1647 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.359051  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:23.367182  1647 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.371398  1647 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:23.374845  7410 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:23.375655  7410 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:23.378317  7410 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:23.389072  2344 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:23.402237  2342 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:23.405608  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:00:23.402864  2342 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:23.410215  7330 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:23.432191  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:23.441949  1647 consensus_peers.cc:597] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.454138  2342 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.474323  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:23.489954  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:23.499842  1649 consensus_peers.cc:597] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:23.540752   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1630)
W20260709 13:00:23.541010  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:23.593708  1649 consensus_peers.cc:597] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:23.595346  2342 consensus_peers.cc:597] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:23.724553  7416 raft_consensus.cc:493] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
W20260709 13:00:23.727483  1647 consensus_peers.cc:597] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:23.725243  7416 raft_consensus.cc:515] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:23.742583  7416 leader_election.cc:290] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:23.764866  2342 consensus_peers.cc:597] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.765468  2342 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.819573  1647 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:23.868197  2342 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.870344  2342 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:23.871943  1649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 126892us
W20260709 13:00:23.913410  1649 leader_election.cc:336] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:23.913986  1649 leader_election.cc:304] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:23.915099  7418 raft_consensus.cc:2749] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:23.946539  1649 consensus_peers.cc:597] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:00:23.976541  7410 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:23.977516  7410 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:23.987022  7410 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:23.992046  2344 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:23.994488  1649 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:24.009774  1649 consensus_peers.cc:597] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:24.014333  2342 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:24.014925  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:24.015652  7410 raft_consensus.cc:2749] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:24.017364  7410 raft_consensus.cc:493] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:24.018042  7410 raft_consensus.cc:515] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:24.020404  1647 consensus_peers.cc:597] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:24.025954  2344 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:24.027226  7410 leader_election.cc:290] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:24.036319  2342 leader_election.cc:336] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:24.036890  2342 leader_election.cc:304] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:24.039068  7410 raft_consensus.cc:2749] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:24.097440  1649 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:24.099654  2342 consensus_peers.cc:597] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:24.122915  7420 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:24.123669  7420 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:24.132007  7420 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:24.142675  2342 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:24.145406  1649 consensus_peers.cc:597] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:00:24.160924  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049eb4ac8c3a4cb896b8b236a384b04d" candidate_uuid: "1e45ac8b66854c2f905bf2c4114cb489" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3cabc5110903443ba3beb5cbb14afa91" is_pre_election: true
I20260709 13:00:24.161553  1682 raft_consensus.cc:2468] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e45ac8b66854c2f905bf2c4114cb489 in term 11.
W20260709 13:00:24.169368  2344 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:24.180018  2344 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:24.188138  7420 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:24.224210  1647 consensus_peers.cc:597] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:24.225788  7416 raft_consensus.cc:493] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:24.226506  7416 raft_consensus.cc:515] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:24.229455  7416 leader_election.cc:290] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:24.236972  1647 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:24.243624  1649 leader_election.cc:336] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:24.244050  1649 leader_election.cc:304] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:24.244776  7418 raft_consensus.cc:2749] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:24.262369  1647 consensus_peers.cc:597] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:24.385166  2342 consensus_peers.cc:597] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:24.395174  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35057, user_credentials={real_user=slave}} blocked reactor thread for 56210.5us
I20260709 13:00:24.408507  7410 raft_consensus.cc:493] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:24.409897  7410 raft_consensus.cc:515] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:24.423570  2342 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:24.433710  7410 leader_election.cc:290] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:24.448918  2344 leader_election.cc:336] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:24.452719  2344 leader_election.cc:304] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:24.456830  1647 consensus_peers.cc:597] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:24.458741  7420 raft_consensus.cc:2749] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:24.523296  1649 consensus_peers.cc:597] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:24.528750  2342 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:24.612504  7416 raft_consensus.cc:493] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:24.613730  7416 raft_consensus.cc:515] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:24.617087  7416 leader_election.cc:290] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:24.620728  2342 consensus_peers.cc:597] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:00:25.269858   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:00:25.272195  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800288c40 after lost signal to thread 434
W20260709 13:00:25.273494  1704 debug-util.cc:398] Leaking SignalData structure 0x7b0800396440 after lost signal to thread 1466
W20260709 13:00:25.275334  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08001913c0 after lost signal to thread 1707
W20260709 13:00:25.277015  1704 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8a60 after lost signal to thread 2510
I20260709 13:00:25.380563  7431 raft_consensus.cc:493] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:25.383181  7431 raft_consensus.cc:515] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:25.399793  7431 leader_election.cc:290] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:25.409282  7425 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:25.419539  7425 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:25.421954  7425 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:25.496830  7427 raft_consensus.cc:493] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:25.497963  7427 raft_consensus.cc:515] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } }
I20260709 13:00:25.501231  7427 leader_election.cc:290] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:25.527726  1649 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:25.535737  1649 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:25.537338  2344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40197, user_credentials={real_user=slave}} blocked reactor thread for 63543.9us
W20260709 13:00:25.564689  2342 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:25.565598  2342 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:25.566107  2342 consensus_peers.cc:597] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:00:25.570781  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:25.571619  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:00:25.572151  2344 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:25.572670  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:25.574066  1649 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:00:25.574693  7447 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:25.581629  2344 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:00:25.594786  1647 leader_election.cc:336] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:25.598315  1647 leader_election.cc:304] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:25.602751  7433 raft_consensus.cc:2749] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:25.601823  1649 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:25.613920  1647 consensus_peers.cc:597] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:25.614583  1647 leader_election.cc:336] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:25.615131  1647 leader_election.cc:304] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:25.616156  7433 raft_consensus.cc:2749] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:25.617789  1647 leader_election.cc:336] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:25.618346  1647 leader_election.cc:304] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cabc5110903443ba3beb5cbb14afa91; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:25.619277  7433 raft_consensus.cc:2749] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:25.734751   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:00:25.818886   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:25.820911   431 tablet_replica.cc:333] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.823022   431 raft_consensus.cc:2243] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.823995   431 raft_consensus.cc:2272] T 57ee981b108d48998c03e57930745dce P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.826977   431 tablet_replica.cc:333] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.827632   431 raft_consensus.cc:2243] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.829547   431 raft_consensus.cc:2272] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.833475   431 tablet_replica.cc:333] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.834753   431 raft_consensus.cc:2243] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.836709   431 raft_consensus.cc:2272] T 10ddaea2d1d945b78d8286cc74a41ff9 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.841218   431 tablet_replica.cc:333] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.842278   431 raft_consensus.cc:2243] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.843700   431 raft_consensus.cc:2272] T bf4ba581fa344d64b772795f456096bf P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.847014   431 tablet_replica.cc:333] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.847978   431 raft_consensus.cc:2243] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.848804   431 raft_consensus.cc:2272] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.851794   431 tablet_replica.cc:333] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.852814   431 raft_consensus.cc:2243] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:00:25.853753  2344 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:00:25.854095   431 raft_consensus.cc:2272] T 9df8036dd002479a8e558d2ce8e13e9b P 3cabc5110903443ba3beb5cbb14afa91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.857200   431 tablet_replica.cc:333] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.858510   431 raft_consensus.cc:2243] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:00:25.859066  2339 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:25.859920   431 raft_consensus.cc:2272] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.863183   431 tablet_replica.cc:333] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.864089   431 raft_consensus.cc:2243] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.865402   431 raft_consensus.cc:2272] T 5a253835287048b3b4ce5ffeb6a4dd1f P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.868438   431 tablet_replica.cc:333] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
W20260709 13:00:25.868686  1649 consensus_peers.cc:597] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:00:25.869410   431 raft_consensus.cc:2243] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.870628   431 raft_consensus.cc:2272] T ae1773d932be4bf48dbb9a17cd28bad4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.874594   431 tablet_replica.cc:333] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.876510   431 raft_consensus.cc:2243] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.878111   431 raft_consensus.cc:2272] T 9e38d8589e334785b807e494aae5aea4 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.881515   431 tablet_replica.cc:333] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.882613   431 raft_consensus.cc:2243] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.883976   431 raft_consensus.cc:2272] T d2805f2fabf7471abe8442f6cbb32668 P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:25.887458  1647 consensus_peers.cc:597] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:25.888499   431 tablet_replica.cc:333] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.890599   431 raft_consensus.cc:2243] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.891541   431 raft_consensus.cc:2272] T 7340b50d876f414287d4fe7df22e3248 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.895002   431 tablet_replica.cc:333] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.896689   431 raft_consensus.cc:2243] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.898376   431 raft_consensus.cc:2272] T 00631bb4062844edb73eb9b0810cc59c P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.901537   431 tablet_replica.cc:333] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.902626   431 raft_consensus.cc:2243] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.903426   431 raft_consensus.cc:2272] T 1d5c791dce8144e7886b1312c2b6200b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.907994   431 tablet_replica.cc:333] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.908938   431 raft_consensus.cc:2243] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.910462   431 raft_consensus.cc:2272] T d859537ee3eb49969dd821b3f75dd33e P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.914148   431 tablet_replica.cc:333] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.915184   431 raft_consensus.cc:2243] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.916337   431 raft_consensus.cc:2272] T 1b1466701b8a43e09c464cd804cf55c6 P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.920446   431 tablet_replica.cc:333] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.921393   431 raft_consensus.cc:2243] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.938756   431 raft_consensus.cc:2272] T 1bcbd7c7333145a3836ea9b6def4d286 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.943758   431 tablet_replica.cc:333] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.944809   431 raft_consensus.cc:2243] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.945714   431 raft_consensus.cc:2272] T 9d6bb2550d6a4cceaf445ac56633cf86 P 3cabc5110903443ba3beb5cbb14afa91 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.948768   431 tablet_replica.cc:333] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.950222   431 raft_consensus.cc:2243] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.951077   431 raft_consensus.cc:2272] T a61da57488ec46278703e8204e8ab905 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.953902   431 tablet_replica.cc:333] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.954749   431 raft_consensus.cc:2243] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.955528   431 raft_consensus.cc:2272] T 22d7b940a3774b7fbb80a3a69355356b P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:25.958755  2339 consensus_peers.cc:597] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:25.959620   431 tablet_replica.cc:333] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.960618   431 raft_consensus.cc:2243] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.963013   431 raft_consensus.cc:2272] T cd0b30c9de3e4d5d8160a5cc3d2e1a9c P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.966131   431 tablet_replica.cc:333] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.967316  7447 raft_consensus.cc:493] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:25.967275   431 raft_consensus.cc:2243] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.967986  7447 raft_consensus.cc:515] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:25.969278   431 raft_consensus.cc:2272] T 74265c5d23584d47a1a5cca905a68876 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.972538   431 tablet_replica.cc:333] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.973583   431 raft_consensus.cc:2243] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:25.974947   431 raft_consensus.cc:2272] T a349b676466f492aac774f89c8e55e48 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.977818  7447 leader_election.cc:290] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:25.978001   431 tablet_replica.cc:333] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:25.979017   431 raft_consensus.cc:2243] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.979949   431 raft_consensus.cc:2272] T 10aca507e378431ea54a6cce71c236fc P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:25.982018  2344 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:00:25.985335  2339 consensus_peers.cc:597] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:25.986009  2339 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:25.989428   431 tablet_replica.cc:333] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
W20260709 13:00:25.989756  2339 consensus_peers.cc:597] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:25.994259   431 raft_consensus.cc:2243] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:00:25.997809  2344 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:26.000548  2339 consensus_peers.cc:597] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.001493   431 raft_consensus.cc:2272] T 33c0ebcbabe4464da9ad5ec0e0bffd73 P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:26.005446  2342 leader_election.cc:336] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:26.006055  2342 leader_election.cc:304] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:26.006789   431 tablet_replica.cc:333] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.006812  7447 raft_consensus.cc:2749] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:26.007817   431 raft_consensus.cc:2243] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.010713   431 raft_consensus.cc:2272] T 049eb4ac8c3a4cb896b8b236a384b04d P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.017429   431 tablet_replica.cc:333] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.018546   431 raft_consensus.cc:2243] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.019556   431 raft_consensus.cc:2272] T 16be7685d9b14fe8a557b6d7572c0296 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.024693   431 tablet_replica.cc:333] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
W20260709 13:00:26.026273  2339 consensus_peers.cc:597] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.027441   431 raft_consensus.cc:2243] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:00:26.029361  2339 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:26.030018  2339 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:26.030609  2339 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.032416   431 raft_consensus.cc:2272] T 831f9b0847f7413f9c00a2e4c5101ba5 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.036592   431 tablet_replica.cc:333] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.038305   431 raft_consensus.cc:2243] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.039072   431 raft_consensus.cc:2272] T 71c02c60c1a5490183c0690cd8c98176 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.042043   431 tablet_replica.cc:333] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
W20260709 13:00:26.046751  1647 consensus_peers.cc:597] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:26.046306   431 raft_consensus.cc:2243] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.048413   431 raft_consensus.cc:2272] T f32dbc3da8894f6cbbf52b501c537a5b P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.051522   431 tablet_replica.cc:333] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.052449   431 raft_consensus.cc:2243] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.053200   431 raft_consensus.cc:2272] T fd192848be4940efa1406c590f3d2e31 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.058770   431 tablet_replica.cc:333] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.060038   431 raft_consensus.cc:2243] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.061342   431 raft_consensus.cc:2272] T 6d9ed6ddb0bc46ec944198e737aa5f57 P 3cabc5110903443ba3beb5cbb14afa91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.064944   431 tablet_replica.cc:333] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.065819   431 raft_consensus.cc:2243] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.066490   431 raft_consensus.cc:2272] T b3a9e9cba0fe4487a6b7c88de6410770 P 3cabc5110903443ba3beb5cbb14afa91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.069317   431 tablet_replica.cc:333] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.070181   431 raft_consensus.cc:2243] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.071432   431 raft_consensus.cc:2272] T 954aeabfbeda41f39cf0433b861851fc P 3cabc5110903443ba3beb5cbb14afa91 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.074235   431 tablet_replica.cc:333] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.075057   431 raft_consensus.cc:2243] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.076189   431 raft_consensus.cc:2272] T 7c3ea752cffa4a138dd2984b56316ae5 P 3cabc5110903443ba3beb5cbb14afa91 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.078742   431 tablet_replica.cc:333] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.079468   431 raft_consensus.cc:2243] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.080205   431 raft_consensus.cc:2272] T e1760e23cca344b0a0ed3ed897bae95f P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.086266   431 tablet_replica.cc:333] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.087196   431 raft_consensus.cc:2243] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.088160   431 raft_consensus.cc:2272] T 172d54128ab740c980d9c27aa0ff1761 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:26.090535  2339 consensus_peers.cc:597] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.091378   431 tablet_replica.cc:333] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.092195   431 raft_consensus.cc:2243] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.093533   431 raft_consensus.cc:2272] T 24b6b7dd0e6c4ab2911c8b5fffbdf68c P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.096521   431 tablet_replica.cc:333] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.097385   431 raft_consensus.cc:2243] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.098634   431 raft_consensus.cc:2272] T 7aa902e4626a464fabe120fcad834ad0 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.101392   431 tablet_replica.cc:333] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.102306   431 raft_consensus.cc:2243] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.103544   431 raft_consensus.cc:2272] T 77f1e53da9e94a8e8859328c4a06b68a P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.106724   431 tablet_replica.cc:333] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.107556   431 raft_consensus.cc:2243] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.108333   431 raft_consensus.cc:2272] T 390bda9334de482bb1f2274e10fe5743 P 3cabc5110903443ba3beb5cbb14afa91 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:26.108917  2339 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.111032   431 tablet_replica.cc:333] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.111908   431 raft_consensus.cc:2243] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:00:26.112404  2339 consensus_peers.cc:597] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.113103   431 raft_consensus.cc:2272] T cd2184d3b5e64d249be4c7045975f9a8 P 3cabc5110903443ba3beb5cbb14afa91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.115770   431 tablet_replica.cc:333] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.116717   431 raft_consensus.cc:2243] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.117713   431 raft_consensus.cc:2272] T 95ab1b1d42384792aa38ad0afd616616 P 3cabc5110903443ba3beb5cbb14afa91 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.120466   431 tablet_replica.cc:333] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.121245   431 raft_consensus.cc:2243] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.122495   431 raft_consensus.cc:2272] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 3cabc5110903443ba3beb5cbb14afa91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.125608   431 tablet_replica.cc:333] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.126480   431 raft_consensus.cc:2243] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.127282   431 raft_consensus.cc:2272] T 6a1b737426124612a1ea1599be6115a0 P 3cabc5110903443ba3beb5cbb14afa91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.130014   431 tablet_replica.cc:333] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.130734   431 raft_consensus.cc:2243] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.131489   431 raft_consensus.cc:2272] T 525f0b170c13486a8942f69d40971d8f P 3cabc5110903443ba3beb5cbb14afa91 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.134524   431 tablet_replica.cc:333] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91: stopping tablet replica
I20260709 13:00:26.135195   431 raft_consensus.cc:2243] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.136260   431 raft_consensus.cc:2272] T 5741b07c783e4193be39d19fba6c5cec P 3cabc5110903443ba3beb5cbb14afa91 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:26.357368  2507 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3c60 after lost signal to thread 434
W20260709 13:00:26.358675  2507 debug-util.cc:398] Leaking SignalData structure 0x7b080034dd80 after lost signal to thread 1466
W20260709 13:00:26.359978  2507 debug-util.cc:398] Leaking SignalData structure 0x7b0800312400 after lost signal to thread 1707
W20260709 13:00:26.361166  2507 debug-util.cc:398] Leaking SignalData structure 0x7b08003690a0 after lost signal to thread 2510
W20260709 13:00:26.414243  2344 consensus_peers.cc:597] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:00:26.421501  2342 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:26.452448  2344 consensus_peers.cc:597] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:00:26.468762  2344 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:00:26.476857  2344 consensus_peers.cc:597] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:00:26.577193  2342 consensus_peers.cc:597] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:26.580132  2344 consensus_peers.cc:597] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:00:26.602434  2342 consensus_peers.cc:597] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:26.636077  2344 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:00:26.663645  2344 consensus_peers.cc:597] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:00:26.668860  7449 raft_consensus.cc:493] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:26.669507  7449 raft_consensus.cc:515] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:26.671967  7449 leader_election.cc:290] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:26.679867  2342 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:26.684660  2344 leader_election.cc:336] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:26.685312  2344 leader_election.cc:304] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:26.686223  7449 raft_consensus.cc:2749] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:26.866256  2342 consensus_peers.cc:597] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:26.886531  2342 consensus_peers.cc:597] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:26.937937  2342 consensus_peers.cc:597] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:26.961333  2342 consensus_peers.cc:597] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:27.046619  7428 raft_consensus.cc:493] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.047232  7428 raft_consensus.cc:515] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.049485  7434 raft_consensus.cc:493] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.050359  7434 raft_consensus.cc:515] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.052898  7434 leader_election.cc:290] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:27.054159  7434 raft_consensus.cc:493] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.055778  7434 raft_consensus.cc:515] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.068063  7434 leader_election.cc:290] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:27.065866  7449 raft_consensus.cc:493] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.070209  7449 raft_consensus.cc:515] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.072638  7449 leader_election.cc:290] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:27.076846  7428 leader_election.cc:290] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.086866  2342 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:27.069738  7434 raft_consensus.cc:493] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.090422  7455 raft_consensus.cc:493] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.099727  7455 raft_consensus.cc:515] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.098096  7449 raft_consensus.cc:493] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.102831  7455 leader_election.cc:290] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:27.099771  7434 raft_consensus.cc:515] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:27.112107  2344 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:27.102720  7449 raft_consensus.cc:515] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
W20260709 13:00:27.114135  2342 leader_election.cc:336] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:27.114322  2344 leader_election.cc:336] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:27.116896  7434 leader_election.cc:290] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.115507  2344 leader_election.cc:336] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:27.116976  7449 leader_election.cc:290] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.124797  2339 leader_election.cc:336] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.125382  2339 leader_election.cc:304] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:27.126248  7449 raft_consensus.cc:2749] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:27.129083  2344 leader_election.cc:336] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:27.129774  2344 leader_election.cc:336] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:27.154253  2339 leader_election.cc:336] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.157591  2339 leader_election.cc:304] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:27.161031  7449 raft_consensus.cc:2749] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:27.162081  2339 leader_election.cc:336] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.162942  2339 leader_election.cc:304] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:27.163779  7449 raft_consensus.cc:2749] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:27.164921  2339 leader_election.cc:336] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.165355  2339 leader_election.cc:304] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:27.166155  7449 raft_consensus.cc:2749] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:27.167235  2339 leader_election.cc:336] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.167706  2339 leader_election.cc:304] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:27.168466  7449 raft_consensus.cc:2749] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:27.169533  2339 leader_election.cc:336] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.170074  2339 leader_election.cc:304] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:27.170848  7449 raft_consensus.cc:2749] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:27.171813  2339 leader_election.cc:336] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.172274  2339 leader_election.cc:304] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:27.173012  7449 raft_consensus.cc:2749] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:27.258297   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1704)
W20260709 13:00:27.341759  1419 catalog_manager.cc:4755] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c3ea752cffa4a138dd2984b56316ae5: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:27.351576  7449 raft_consensus.cc:493] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.352200  7449 raft_consensus.cc:515] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.358551  7449 leader_election.cc:290] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.361950  2342 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:27.366837  2339 leader_election.cc:336] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.367573  2339 leader_election.cc:304] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:27.368891  7449 raft_consensus.cc:2749] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:27.405251  7454 raft_consensus.cc:493] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.405922  7454 raft_consensus.cc:515] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.408349  7454 leader_election.cc:290] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.419440  2342 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111) [suppressed 482 similar messages]
W20260709 13:00:27.432910  2342 leader_election.cc:336] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:27.433601  7454 raft_consensus.cc:493] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.434576  7454 raft_consensus.cc:515] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.436821  7454 leader_election.cc:290] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.437976  2339 leader_election.cc:336] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.441071  2339 leader_election.cc:304] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:27.451551  7454 raft_consensus.cc:2749] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:27.450750  2342 leader_election.cc:336] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:27.453151  2342 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:27.455812  7454 raft_consensus.cc:493] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:27.466552  7454 raft_consensus.cc:515] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } attrs { replace: true } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.469619  7454 leader_election.cc:290] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.476552  2344 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:27.511840  7454 raft_consensus.cc:493] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.512586  7454 raft_consensus.cc:515] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.520076  7454 leader_election.cc:290] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399), 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197)
I20260709 13:00:27.520745  7449 raft_consensus.cc:493] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.524351  7449 raft_consensus.cc:515] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.527060  7449 leader_election.cc:290] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
I20260709 13:00:27.521421  7453 raft_consensus.cc:493] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.527967  7453 raft_consensus.cc:515] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.530440  7453 leader_election.cc:290] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.531212  2344 leader_election.cc:336] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:27.533517  2339 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.537829  2339 leader_election.cc:304] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 13:00:27.542012  2342 consensus_peers.cc:597] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:27.546586  2342 leader_election.cc:336] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:27.547257  2344 leader_election.cc:336] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:27.551877  7453 raft_consensus.cc:2749] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:27.565506  2339 leader_election.cc:336] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.569175  2339 leader_election.cc:304] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:27.574707  7454 raft_consensus.cc:2749] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:27.578596  7454 raft_consensus.cc:493] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3cabc5110903443ba3beb5cbb14afa91)
I20260709 13:00:27.579316  7454 raft_consensus.cc:515] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "3cabc5110903443ba3beb5cbb14afa91" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35399 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.581768  7454 leader_election.cc:290] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057), 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399)
W20260709 13:00:27.583838  2342 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:27.594043  2339 leader_election.cc:336] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
W20260709 13:00:27.595937  2342 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:27.596112  2339 leader_election.cc:304] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
W20260709 13:00:27.598106  2339 leader_election.cc:336] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.600673  2339 leader_election.cc:304] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
W20260709 13:00:27.601774  2339 leader_election.cc:336] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.602311  2339 leader_election.cc:304] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, 5a2554c3dead4fcfa5f51708a9ecd5ac
I20260709 13:00:27.603106  7449 raft_consensus.cc:2749] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:27.598325  7454 raft_consensus.cc:2749] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:27.603559  7455 raft_consensus.cc:2749] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:27.610792  2339 leader_election.cc:336] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111)
I20260709 13:00:27.611322  2339 leader_election.cc:304] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 3cabc5110903443ba3beb5cbb14afa91, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:27.612509  7454 raft_consensus.cc:2749] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:27.694948  2342 consensus_peers.cc:597] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:00:27.914551  2342 consensus_peers.cc:597] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:27.925417  7455 raft_consensus.cc:493] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:27.925967  7455 raft_consensus.cc:515] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:27.928433  7455 leader_election.cc:290] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
W20260709 13:00:27.932142  2342 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:27.934792  2344 leader_election.cc:336] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:27.935254  2344 leader_election.cc:304] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:27.935951  7455 raft_consensus.cc:2749] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:27.966185  2344 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:00:27.999157   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:00:28.058663  2339 consensus_peers.cc:597] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 3cabc5110903443ba3beb5cbb14afa91 (127.0.107.195:35399): Couldn't send request to peer 3cabc5110903443ba3beb5cbb14afa91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:28.067886  2344 consensus_peers.cc:597] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Couldn't send request to peer 5a2554c3dead4fcfa5f51708a9ecd5ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:00:28.104044   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:00:28.149209   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:28.150128   431 tablet_replica.cc:333] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.150905   431 raft_consensus.cc:2243] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.151515   431 raft_consensus.cc:2272] T 049eb4ac8c3a4cb896b8b236a384b04d P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.153972   431 tablet_replica.cc:333] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.154825   431 raft_consensus.cc:2243] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.155468   431 raft_consensus.cc:2272] T 555751dc108841d481db7da6ccbf13d5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.158181   431 tablet_replica.cc:333] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.159061   431 raft_consensus.cc:2243] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.160070   431 raft_consensus.cc:2272] T 57ee981b108d48998c03e57930745dce P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.162113   431 tablet_replica.cc:333] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.162690   431 raft_consensus.cc:2243] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.163556   431 raft_consensus.cc:2272] T d08227f27afa422683d506a582939c6d P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.166612   431 tablet_replica.cc:333] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.167550   431 raft_consensus.cc:2243] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.168431   431 raft_consensus.cc:2272] T 7c3ea752cffa4a138dd2984b56316ae5 P 1e45ac8b66854c2f905bf2c4114cb489 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:28.170214  2342 consensus_peers.cc:597] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 -> Peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Couldn't send request to peer fc6fbca2eb8d4bec997c51003e277180. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:00:28.171331   431 tablet_replica.cc:333] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.171978   431 raft_consensus.cc:2243] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.172544   431 raft_consensus.cc:2272] T bf4ba581fa344d64b772795f456096bf P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.174800   431 tablet_replica.cc:333] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.175393   431 raft_consensus.cc:2243] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.176007   431 raft_consensus.cc:2272] T 1bcbd7c7333145a3836ea9b6def4d286 P 1e45ac8b66854c2f905bf2c4114cb489 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.178347   431 tablet_replica.cc:333] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.178915   431 raft_consensus.cc:2243] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.179796   431 raft_consensus.cc:2272] T 1d5c791dce8144e7886b1312c2b6200b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.181758   431 tablet_replica.cc:333] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.182351   431 raft_consensus.cc:2243] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.182835   431 raft_consensus.cc:2272] T 954aeabfbeda41f39cf0433b861851fc P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.185015   431 tablet_replica.cc:333] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.185606   431 raft_consensus.cc:2243] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.186700   431 raft_consensus.cc:2272] T cdb1450b85664ac0a6fa149c1f105679 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.188684   431 tablet_replica.cc:333] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.189247   431 raft_consensus.cc:2243] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.189749   431 raft_consensus.cc:2272] T 74265c5d23584d47a1a5cca905a68876 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.191649   431 tablet_replica.cc:333] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.192277   431 raft_consensus.cc:2243] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.192782   431 raft_consensus.cc:2272] T a2b55a7fa2a04544a73c2fa785686919 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.195017   431 tablet_replica.cc:333] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.195777   431 raft_consensus.cc:2243] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.196795   431 raft_consensus.cc:2272] T 172d54128ab740c980d9c27aa0ff1761 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.199241   431 tablet_replica.cc:333] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.199967   431 raft_consensus.cc:2243] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.200474   431 raft_consensus.cc:2272] T f32dbc3da8894f6cbbf52b501c537a5b P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.202503   431 tablet_replica.cc:333] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.203053   431 raft_consensus.cc:2243] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.203510   431 raft_consensus.cc:2272] T 7aa902e4626a464fabe120fcad834ad0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.205940   431 tablet_replica.cc:333] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.206835   431 raft_consensus.cc:2243] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.207824   431 raft_consensus.cc:2272] T b00f4dc45e904f49a3231fc0c487b88d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.210402   431 tablet_replica.cc:333] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.210988   431 raft_consensus.cc:2243] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.211545   431 raft_consensus.cc:2272] T 32b6ee54d0d6479194b8ac687bbb1754 P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.213544   431 tablet_replica.cc:333] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.214164   431 raft_consensus.cc:2243] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.215003   431 raft_consensus.cc:2272] T 10ddaea2d1d945b78d8286cc74a41ff9 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.217108   431 tablet_replica.cc:333] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.217757   431 raft_consensus.cc:2243] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.218446   431 raft_consensus.cc:2272] T 9df8036dd002479a8e558d2ce8e13e9b P 1e45ac8b66854c2f905bf2c4114cb489 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.221015   431 tablet_replica.cc:333] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.221909   431 raft_consensus.cc:2243] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.222975   431 raft_consensus.cc:2272] T 0d7a515ee1ef4faca822cc4e1083ab3a P 1e45ac8b66854c2f905bf2c4114cb489 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.225091   431 tablet_replica.cc:333] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.225898   431 raft_consensus.cc:2243] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.226569   431 raft_consensus.cc:2272] T 77f1e53da9e94a8e8859328c4a06b68a P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.228493   431 tablet_replica.cc:333] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.229048   431 raft_consensus.cc:2243] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.229535   431 raft_consensus.cc:2272] T 1805a53fe3fc412094cd75832a6e1208 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.231454   431 tablet_replica.cc:333] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.231977   431 raft_consensus.cc:2243] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.232399   431 raft_consensus.cc:2272] T d859537ee3eb49969dd821b3f75dd33e P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.234450   431 tablet_replica.cc:333] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.234678  7458 raft_consensus.cc:493] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fc6fbca2eb8d4bec997c51003e277180)
I20260709 13:00:28.235038   431 raft_consensus.cc:2243] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.235659   431 raft_consensus.cc:2272] T 062a0e40b92a4b4f9763c2dd8d13aa5f P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.235219  7458 raft_consensus.cc:515] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5a2554c3dead4fcfa5f51708a9ecd5ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40197 } } peers { permanent_uuid: "fc6fbca2eb8d4bec997c51003e277180" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35057 } } peers { permanent_uuid: "1e45ac8b66854c2f905bf2c4114cb489" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 46719 } attrs { promote: false } }
I20260709 13:00:28.237645  7458 leader_election.cc:290] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197), fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057)
I20260709 13:00:28.238088   431 tablet_replica.cc:333] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.238993   431 raft_consensus.cc:2243] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.240114   431 raft_consensus.cc:2272] T 525f0b170c13486a8942f69d40971d8f P 1e45ac8b66854c2f905bf2c4114cb489 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:28.242031  2344 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
I20260709 13:00:28.243175   431 tablet_replica.cc:333] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
W20260709 13:00:28.243413  2342 leader_election.cc:336] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
I20260709 13:00:28.243897   431 raft_consensus.cc:2243] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.243839  2342 leader_election.cc:304] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e45ac8b66854c2f905bf2c4114cb489; no voters: 5a2554c3dead4fcfa5f51708a9ecd5ac, fc6fbca2eb8d4bec997c51003e277180
I20260709 13:00:28.244658  7458 raft_consensus.cc:2706] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Received pre-election callback for term 12 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:00:28.245186   431 raft_consensus.cc:2272] T 9b381ac61d4149f096c7f58d4c53f925 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.247254   431 tablet_replica.cc:333] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.247808   431 raft_consensus.cc:2243] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.248623   431 raft_consensus.cc:2272] T 390bda9334de482bb1f2274e10fe5743 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.250582   431 tablet_replica.cc:333] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.251116   431 raft_consensus.cc:2243] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.251888   431 raft_consensus.cc:2272] T 7340b50d876f414287d4fe7df22e3248 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.253849   431 tablet_replica.cc:333] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.254417   431 raft_consensus.cc:2243] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.255225   431 raft_consensus.cc:2272] T 00631bb4062844edb73eb9b0810cc59c P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.257175   431 tablet_replica.cc:333] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.257737   431 raft_consensus.cc:2243] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.258358   431 raft_consensus.cc:2272] T 5297d7a3ab0a4faeaf7d74c4c5296b15 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.260289   431 tablet_replica.cc:333] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.260825   431 raft_consensus.cc:2243] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.261245   431 raft_consensus.cc:2272] T 9e38d8589e334785b807e494aae5aea4 P 1e45ac8b66854c2f905bf2c4114cb489 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.263612   431 tablet_replica.cc:333] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.264386   431 raft_consensus.cc:2243] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.265590   431 raft_consensus.cc:2272] T 71c02c60c1a5490183c0690cd8c98176 P 1e45ac8b66854c2f905bf2c4114cb489 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.267692   431 tablet_replica.cc:333] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.268219   431 raft_consensus.cc:2243] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.269068   431 raft_consensus.cc:2272] T 8085a85190ed479aa2fc71cd75382085 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.270911   431 tablet_replica.cc:333] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.271430   431 raft_consensus.cc:2243] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.272202   431 raft_consensus.cc:2272] T 5741b07c783e4193be39d19fba6c5cec P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.274117   431 tablet_replica.cc:333] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.274617   431 raft_consensus.cc:2243] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.275388   431 raft_consensus.cc:2272] T 22d7b940a3774b7fbb80a3a69355356b P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.277191   431 tablet_replica.cc:333] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.277729   431 raft_consensus.cc:2243] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.278501   431 raft_consensus.cc:2272] T 3edf2cc020b14bb0b4aebbbdfd3e4a8d P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.280489   431 tablet_replica.cc:333] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.280992   431 raft_consensus.cc:2243] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.281873   431 raft_consensus.cc:2272] T e050081dd8c146df92c3ba8d2500e7f0 P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.283667   431 tablet_replica.cc:333] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.284194   431 raft_consensus.cc:2243] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.284670   431 raft_consensus.cc:2272] T 0bc9c2ff15b642d3b2b7f9e5317a1617 P 1e45ac8b66854c2f905bf2c4114cb489 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.286597   431 tablet_replica.cc:333] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.287051   431 raft_consensus.cc:2243] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.287657   431 raft_consensus.cc:2272] T 7c5fb2214fbb40f0a702dbf5aa32966f P 1e45ac8b66854c2f905bf2c4114cb489 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.289474   431 tablet_replica.cc:333] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489: stopping tablet replica
I20260709 13:00:28.289944   431 raft_consensus.cc:2243] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.290741   431 raft_consensus.cc:2272] T e1760e23cca344b0a0ed3ed897bae95f P 1e45ac8b66854c2f905bf2c4114cb489 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.788383   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:00:28.855281   431 master.cc:562] Master@127.0.107.254:38115 shutting down...
W20260709 13:00:28.886663  1480 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:00:28.886930  1480 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:00:28.887152  1480 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:00:32.285912  1417 catalog_manager.cc:4755] TS fc6fbca2eb8d4bec997c51003e277180 (127.0.107.194:35057): ChangeConfig:REMOVE_PEER RPC failed for tablet 049eb4ac8c3a4cb896b8b236a384b04d: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35057: connect: Connection refused (error 111)
W20260709 13:00:43.746538  1419 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111) [suppressed 84 similar messages]
W20260709 13:00:43.750885  1419 catalog_manager.cc:4755] TS 5a2554c3dead4fcfa5f51708a9ecd5ac (127.0.107.193:40197): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c3ea752cffa4a138dd2984b56316ae5: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40197: connect: Connection refused (error 111)
W20260709 13:00:49.766800  1419 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.196:46719: connect: Connection refused (error 111)
W20260709 13:00:49.770427  1419 catalog_manager.cc:4755] TS 1e45ac8b66854c2f905bf2c4114cb489 (127.0.107.196:46719): ChangeConfig:REMOVE_PEER RPC failed for tablet 172d54128ab740c980d9c27aa0ff1761: Network error: Client connection negotiation failed: client connection to 127.0.107.196:46719: connect: Connection refused (error 111)
I20260709 13:00:50.138841   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:50.140468   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.140838   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P d61986b01a0f484cbe47a3797e9dc27f: stopping tablet replica
I20260709 13:00:50.311606   431 master.cc:584] Master@127.0.107.254:38115 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (222482 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:00:50.427764   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:40329
I20260709 13:00:50.428869   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:50.435036  7467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.435295  7468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.436807  7470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.437969   431 server_base.cc:1061] running on GCE node
I20260709 13:00:50.441205   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.441422   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.441543   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602050441532 us; error 0 us; skew 500 ppm
I20260709 13:00:50.442094   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.445082   431 webserver.cc:533] Webserver started at http://127.0.107.254:44091/ using document root <none> and password file <none>
I20260709 13:00:50.445593   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.445847   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.446094   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.447460   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/master-0-root/instance:
uuid: "3a779864a96d43e4ba8354c8bcd6ab23"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
I20260709 13:00:50.453884   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:00:50.458671  7475 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.459736   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:00:50.460244   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/master-0-root
uuid: "3a779864a96d43e4ba8354c8bcd6ab23"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
I20260709 13:00:50.460566   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:50.522424   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:50.523710   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:50.567596   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:40329
I20260709 13:00:50.567780  7526 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:40329 every 8 connection(s)
I20260709 13:00:50.572316  7527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.586268  7527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23: Bootstrap starting.
I20260709 13:00:50.591427  7527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.595814  7527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23: No bootstrap required, opened a new log
I20260709 13:00:50.598049  7527 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a779864a96d43e4ba8354c8bcd6ab23" member_type: VOTER }
I20260709 13:00:50.598485  7527 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.598676  7527 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a779864a96d43e4ba8354c8bcd6ab23, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.599161  7527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a779864a96d43e4ba8354c8bcd6ab23" member_type: VOTER }
I20260709 13:00:50.599601  7527 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:50.599808  7527 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:50.600049  7527 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.604636  7527 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a779864a96d43e4ba8354c8bcd6ab23" member_type: VOTER }
I20260709 13:00:50.605136  7527 leader_election.cc:304] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a779864a96d43e4ba8354c8bcd6ab23; no voters: 
I20260709 13:00:50.606362  7527 leader_election.cc:290] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:50.606769  7530 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:50.608172  7530 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 1 LEADER]: Becoming Leader. State: Replica: 3a779864a96d43e4ba8354c8bcd6ab23, State: Running, Role: LEADER
I20260709 13:00:50.608922  7530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a779864a96d43e4ba8354c8bcd6ab23" member_type: VOTER }
I20260709 13:00:50.609436  7527 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:50.616623  7532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a779864a96d43e4ba8354c8bcd6ab23. Latest consensus state: current_term: 1 leader_uuid: "3a779864a96d43e4ba8354c8bcd6ab23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a779864a96d43e4ba8354c8bcd6ab23" member_type: VOTER } }
I20260709 13:00:50.616937  7531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a779864a96d43e4ba8354c8bcd6ab23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a779864a96d43e4ba8354c8bcd6ab23" member_type: VOTER } }
I20260709 13:00:50.617646  7532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:50.618158  7531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:50.625281  7539 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:50.630359  7539 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:50.645404  7539 catalog_manager.cc:1383] Generated new cluster ID: 43ffeb07151648ceaa026814692cf846
I20260709 13:00:50.646555  7539 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:50.646741   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:50.679672  7539 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:50.681088  7539 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:50.696615  7539 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23: Generated new TSK 0
I20260709 13:00:50.697453  7539 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:50.713758   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:50.721504  7548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.722366  7549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.725100  7551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.725546   431 server_base.cc:1061] running on GCE node
I20260709 13:00:50.728128   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.728336   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.728533   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602050728519 us; error 0 us; skew 500 ppm
I20260709 13:00:50.729171   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.732282   431 webserver.cc:533] Webserver started at http://127.0.107.193:45483/ using document root <none> and password file <none>
I20260709 13:00:50.732854   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.733026   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.733777   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.735551   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root/instance:
uuid: "80af46fc024041de81a638d29912c8a3"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
I20260709 13:00:50.741190   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:00:50.746591  7556 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.747740   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:00:50.748171   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "80af46fc024041de81a638d29912c8a3"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
I20260709 13:00:50.748574   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:50.764637   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:50.765874   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:50.767369   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:50.770260   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:50.770459   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.770764   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:50.770970   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.818228   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38589
I20260709 13:00:50.818320  7618 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38589 every 8 connection(s)
I20260709 13:00:50.823777   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:50.833235  7624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.833478  7623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.837430  7626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.838096   431 server_base.cc:1061] running on GCE node
I20260709 13:00:50.840903   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.841138   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.841318   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602050841297 us; error 0 us; skew 500 ppm
I20260709 13:00:50.842005   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.845325   431 webserver.cc:533] Webserver started at http://127.0.107.194:39487/ using document root <none> and password file <none>
I20260709 13:00:50.845960   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.846184   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.846464   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.846936  7619 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40329
I20260709 13:00:50.847360  7619 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:50.847882   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-1-root/instance:
uuid: "5b52243363f04d04862e5e631403e880"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
I20260709 13:00:50.848160  7619 heartbeater.cc:507] Master 127.0.107.254:40329 requested a full tablet report, sending...
I20260709 13:00:50.850378  7492 ts_manager.cc:194] Registered new tserver with Master: 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:50.852458  7492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44984
I20260709 13:00:50.853307   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:00:50.857477  7631 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.858816   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:00:50.859249   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-1-root
uuid: "5b52243363f04d04862e5e631403e880"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
I20260709 13:00:50.859712   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:50.885896   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:50.887210   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:50.888885   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:50.891505   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:50.891752   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.892009   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:50.892191   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.940150   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46081
I20260709 13:00:50.940465  7693 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46081 every 8 connection(s)
I20260709 13:00:50.945248   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:50.954216  7697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.954952  7698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.958460  7694 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40329
I20260709 13:00:50.958777   431 server_base.cc:1061] running on GCE node
I20260709 13:00:50.958990  7694 heartbeater.cc:461] Registering TS with master...
W20260709 13:00:50.959162  7700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.960222  7694 heartbeater.cc:507] Master 127.0.107.254:40329 requested a full tablet report, sending...
I20260709 13:00:50.960441   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.960723   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.960925   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602050960904 us; error 0 us; skew 500 ppm
I20260709 13:00:50.961827   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.963238  7492 ts_manager.cc:194] Registered new tserver with Master: 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:50.964952   431 webserver.cc:533] Webserver started at http://127.0.107.195:37321/ using document root <none> and password file <none>
I20260709 13:00:50.965267  7492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44988
I20260709 13:00:50.965708   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.966003   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.966334   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.967830   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-2-root/instance:
uuid: "b81c129769e24f019dc9045ce8c09771"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
I20260709 13:00:50.972506   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:00:50.976404  7705 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.977393   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:00:50.977775   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-2-root
uuid: "b81c129769e24f019dc9045ce8c09771"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
I20260709 13:00:50.978065   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:51.004546   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:51.005803   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:51.007295   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:51.009886   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:51.010072   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.010244   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:51.010370   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.058557   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38429
I20260709 13:00:51.058933  7767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38429 every 8 connection(s)
I20260709 13:00:51.064210   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:51.071969  7771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:51.073190  7772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:51.076535   431 server_base.cc:1061] running on GCE node
W20260709 13:00:51.077381  7774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:51.077886  7768 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40329
I20260709 13:00:51.078498  7768 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:51.078823   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:51.079152   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:51.079377   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602051079360 us; error 0 us; skew 500 ppm
I20260709 13:00:51.079608  7768 heartbeater.cc:507] Master 127.0.107.254:40329 requested a full tablet report, sending...
I20260709 13:00:51.080303   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:51.082949  7492 ts_manager.cc:194] Registered new tserver with Master: b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:51.084070   431 webserver.cc:533] Webserver started at http://127.0.107.196:40455/ using document root <none> and password file <none>
I20260709 13:00:51.084651   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:51.084609  7492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44996
I20260709 13:00:51.085052   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:51.085366   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:51.086944   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-3-root/instance:
uuid: "1075f1083cc84c349b3a0bd57774c1e7"
format_stamp: "Formatted at 2026-07-09 13:00:51 on dist-test-slave-qv7r"
I20260709 13:00:51.091857   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:51.095813  7779 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.096673   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:00:51.097141   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-3-root
uuid: "1075f1083cc84c349b3a0bd57774c1e7"
format_stamp: "Formatted at 2026-07-09 13:00:51 on dist-test-slave-qv7r"
I20260709 13:00:51.097467   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:51.119355   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:51.120697   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:51.122131   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:51.124258   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:51.124495   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.124747   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:51.124923   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.174530   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:41545
I20260709 13:00:51.174640  7841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:41545 every 8 connection(s)
I20260709 13:00:51.189855  7842 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40329
I20260709 13:00:51.190335  7842 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:51.191097  7842 heartbeater.cc:507] Master 127.0.107.254:40329 requested a full tablet report, sending...
I20260709 13:00:51.193059  7492 ts_manager.cc:194] Registered new tserver with Master: 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:51.193426   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015544002s
I20260709 13:00:51.194826  7492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45008
I20260709 13:00:51.224776  7492 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45014:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:00:51.484719  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 2a76c63217264185bf001378200c92b8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:51.486012  7732 tablet_service.cc:1511] Processing CreateTablet for tablet 6109e32453a044d0bc4a18d3bf785518 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:51.486362  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a76c63217264185bf001378200c92b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.487059  7730 tablet_service.cc:1511] Processing CreateTablet for tablet f610a99a66b94fc0aa4565a0494013f0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:51.485419  7731 tablet_service.cc:1511] Processing CreateTablet for tablet d85d25c4f4df4190af72f86b0328a345 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:51.487519  7732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6109e32453a044d0bc4a18d3bf785518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.492165  7729 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7a672520974144a4f3fffbc0805301 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:51.494166  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85d25c4f4df4190af72f86b0328a345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.495095  7805 tablet_service.cc:1511] Processing CreateTablet for tablet d85d25c4f4df4190af72f86b0328a345 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:51.496613  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85d25c4f4df4190af72f86b0328a345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.497670  7730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f610a99a66b94fc0aa4565a0494013f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.500761  7807 tablet_service.cc:1511] Processing CreateTablet for tablet fa7816c9f7b54ed198fce1d42596e0f2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:51.498785  7806 tablet_service.cc:1511] Processing CreateTablet for tablet 6109e32453a044d0bc4a18d3bf785518 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:51.499323  7728 tablet_service.cc:1511] Processing CreateTablet for tablet f5457fe8b6ca4fb299cc0137a81729f8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:51.503189  7728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5457fe8b6ca4fb299cc0137a81729f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.504096  7804 tablet_service.cc:1511] Processing CreateTablet for tablet d4a36b4572f0444dafd0d51bfc100984 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:51.505952  7727 tablet_service.cc:1511] Processing CreateTablet for tablet d6cdc86b1e3d4df4a94bc251560f88e7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:51.506731  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 2a76c63217264185bf001378200c92b8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:51.507498  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cdc86b1e3d4df4a94bc251560f88e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.507191  7654 tablet_service.cc:1511] Processing CreateTablet for tablet f5457fe8b6ca4fb299cc0137a81729f8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:51.508167  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a76c63217264185bf001378200c92b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.508863  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5457fe8b6ca4fb299cc0137a81729f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.510509  7658 tablet_service.cc:1511] Processing CreateTablet for tablet fa7816c9f7b54ed198fce1d42596e0f2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:51.510783  7657 tablet_service.cc:1511] Processing CreateTablet for tablet d85d25c4f4df4190af72f86b0328a345 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:51.512092  7658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa7816c9f7b54ed198fce1d42596e0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.515048  7656 tablet_service.cc:1511] Processing CreateTablet for tablet f610a99a66b94fc0aa4565a0494013f0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:51.502192  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa7816c9f7b54ed198fce1d42596e0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.517261  7655 tablet_service.cc:1511] Processing CreateTablet for tablet d4a36b4572f0444dafd0d51bfc100984 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:51.518061  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6109e32453a044d0bc4a18d3bf785518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.519345  7653 tablet_service.cc:1511] Processing CreateTablet for tablet d6cdc86b1e3d4df4a94bc251560f88e7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:51.520900  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f610a99a66b94fc0aa4565a0494013f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.522226  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7a672520974144a4f3fffbc0805301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.526226  7655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a36b4572f0444dafd0d51bfc100984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.527156  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab9b354e4c04221a6922c87d2ba22bd (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:51.528779  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab9b354e4c04221a6922c87d2ba22bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.524847  7652 tablet_service.cc:1511] Processing CreateTablet for tablet f52fbfcad0d747cfb5758693f2cf5be6 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:51.530203  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cdc86b1e3d4df4a94bc251560f88e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.530932  7652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52fbfcad0d747cfb5758693f2cf5be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.531934  7657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85d25c4f4df4190af72f86b0328a345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.533959  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a36b4572f0444dafd0d51bfc100984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.539474  7803 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7a672520974144a4f3fffbc0805301 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:51.541167  7803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7a672520974144a4f3fffbc0805301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.542006  7801 tablet_service.cc:1511] Processing CreateTablet for tablet f52fbfcad0d747cfb5758693f2cf5be6 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:51.543505  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52fbfcad0d747cfb5758693f2cf5be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.539778  7802 tablet_service.cc:1511] Processing CreateTablet for tablet f5457fe8b6ca4fb299cc0137a81729f8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:51.546594  7802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5457fe8b6ca4fb299cc0137a81729f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.626967  7800 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab9b354e4c04221a6922c87d2ba22bd (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:51.628697  7800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab9b354e4c04221a6922c87d2ba22bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:51.631948  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:51.661861  7865 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:51.702018  7654 tablet_service.cc:1511] Processing CreateTablet for tablet ffd6bf52d5074a8cbfd89d2330e9ca7f (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:51.703953  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd6bf52d5074a8cbfd89d2330e9ca7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.704685  7726 tablet_service.cc:1511] Processing CreateTablet for tablet ffd6bf52d5074a8cbfd89d2330e9ca7f (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:51.706037  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd6bf52d5074a8cbfd89d2330e9ca7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.735188  7862 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:51.735405  7864 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:51.743727  7864 tablet_bootstrap.cc:654] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.764665  7865 tablet_bootstrap.cc:654] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.774501  7862 tablet_bootstrap.cc:654] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.781414  7864 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:51.814718  7584 tablet_service.cc:1511] Processing CreateTablet for tablet 2a76c63217264185bf001378200c92b8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:51.827096  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a76c63217264185bf001378200c92b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.827369  7583 tablet_service.cc:1511] Processing CreateTablet for tablet fa7816c9f7b54ed198fce1d42596e0f2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:51.810851  7864 ts_tablet_manager.cc:1403] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.026s
I20260709 13:00:51.839412  7580 tablet_service.cc:1511] Processing CreateTablet for tablet d4a36b4572f0444dafd0d51bfc100984 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:51.823828  7582 tablet_service.cc:1511] Processing CreateTablet for tablet 6109e32453a044d0bc4a18d3bf785518 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:51.829492  7583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa7816c9f7b54ed198fce1d42596e0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.839192  7801 tablet_service.cc:1511] Processing CreateTablet for tablet ffd6bf52d5074a8cbfd89d2330e9ca7f (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:51.846987  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd6bf52d5074a8cbfd89d2330e9ca7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.849922  7728 tablet_service.cc:1511] Processing CreateTablet for tablet b7201e09d4ad45e1ac2b617f22ed4a70 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:51.849951  7655 tablet_service.cc:1511] Processing CreateTablet for tablet b7201e09d4ad45e1ac2b617f22ed4a70 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:51.851598  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a36b4572f0444dafd0d51bfc100984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.851910  7728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7201e09d4ad45e1ac2b617f22ed4a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.853076  7865 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:51.853749  7582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6109e32453a044d0bc4a18d3bf785518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.855278  7657 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed1559d07294774aa94df29c0b5d59a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:51.855839  7619 heartbeater.cc:499] Master 127.0.107.254:40329 was elected leader, sending a full tablet report...
I20260709 13:00:51.855641  7579 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7a672520974144a4f3fffbc0805301 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:51.859378  7579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7a672520974144a4f3fffbc0805301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.861725  7655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7201e09d4ad45e1ac2b617f22ed4a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.861889  7806 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed1559d07294774aa94df29c0b5d59a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:51.864008  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed1559d07294774aa94df29c0b5d59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.865303  7807 tablet_service.cc:1511] Processing CreateTablet for tablet af3917dc3ec14f558877b66019290ec0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:51.832482  7581 tablet_service.cc:1511] Processing CreateTablet for tablet f610a99a66b94fc0aa4565a0494013f0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:51.866976  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3917dc3ec14f558877b66019290ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.867244  7581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f610a99a66b94fc0aa4565a0494013f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.869985  7729 tablet_service.cc:1511] Processing CreateTablet for tablet af3917dc3ec14f558877b66019290ec0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:51.873075  7578 tablet_service.cc:1511] Processing CreateTablet for tablet d6cdc86b1e3d4df4a94bc251560f88e7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:51.874728  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cdc86b1e3d4df4a94bc251560f88e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.854079  7865 ts_tablet_manager.cc:1403] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.193s	user 0.013s	sys 0.003s
I20260709 13:00:51.879598  7577 tablet_service.cc:1511] Processing CreateTablet for tablet f52fbfcad0d747cfb5758693f2cf5be6 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:51.881188  7577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52fbfcad0d747cfb5758693f2cf5be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.883817  7865 raft_consensus.cc:359] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:51.885203  7865 raft_consensus.cc:385] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.889616  7655 tablet_service.cc:1511] Processing CreateTablet for tablet 40895010d1874feea26e2f762ab3a77f (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:51.911278  7655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40895010d1874feea26e2f762ab3a77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.911046  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 6d02dd8c5b7c4a09a55b18dc5b4d7e93 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:51.894239  7805 tablet_service.cc:1511] Processing CreateTablet for tablet 40895010d1874feea26e2f762ab3a77f (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:51.903065  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 2911523c3e9f45638bdcf0de7430dda4 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:51.898367  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 2911523c3e9f45638bdcf0de7430dda4 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:51.890175  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 40895010d1874feea26e2f762ab3a77f (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:51.916883  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2911523c3e9f45638bdcf0de7430dda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.886080  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3917dc3ec14f558877b66019290ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.918128  7864 raft_consensus.cc:359] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:51.918987  7864 raft_consensus.cc:385] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.919365  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40895010d1874feea26e2f762ab3a77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.919303  7864 raft_consensus.cc:740] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.920259  7864 consensus_queue.cc:260] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:51.921463  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2911523c3e9f45638bdcf0de7430dda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.920814  7575 tablet_service.cc:1511] Processing CreateTablet for tablet b7201e09d4ad45e1ac2b617f22ed4a70 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:51.922962  7575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7201e09d4ad45e1ac2b617f22ed4a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.923525  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40895010d1874feea26e2f762ab3a77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.924206  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d02dd8c5b7c4a09a55b18dc5b4d7e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.885543  7865 raft_consensus.cc:740] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.926928  7865 consensus_queue.cc:260] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:51.912971  7576 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab9b354e4c04221a6922c87d2ba22bd (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:51.935509  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab9b354e4c04221a6922c87d2ba22bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.937543  7657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed1559d07294774aa94df29c0b5d59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.941722  7862 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:51.942699  7862 ts_tablet_manager.cc:1403] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.208s	user 0.010s	sys 0.005s
I20260709 13:00:51.952128  7862 raft_consensus.cc:359] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:51.952977  7862 raft_consensus.cc:385] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.953277  7862 raft_consensus.cc:740] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.962852  7862 consensus_queue.cc:260] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:51.971349  7694 heartbeater.cc:499] Master 127.0.107.254:40329 was elected leader, sending a full tablet report...
I20260709 13:00:51.980357  7869 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:51.985634  7577 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed1559d07294774aa94df29c0b5d59a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:51.971347  7865 ts_tablet_manager.cc:1434] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.005s
I20260709 13:00:51.997475  7865 tablet_bootstrap.cc:492] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:52.004649  7577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed1559d07294774aa94df29c0b5d59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.007050  7580 tablet_service.cc:1511] Processing CreateTablet for tablet 2911523c3e9f45638bdcf0de7430dda4 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:51.991477  7582 tablet_service.cc:1511] Processing CreateTablet for tablet af3917dc3ec14f558877b66019290ec0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:52.025522  7582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3917dc3ec14f558877b66019290ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.026296  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2911523c3e9f45638bdcf0de7430dda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.029039  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 6d02dd8c5b7c4a09a55b18dc5b4d7e93 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:52.031740  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d02dd8c5b7c4a09a55b18dc5b4d7e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.012501  7869 tablet_bootstrap.cc:654] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.014447  7865 tablet_bootstrap.cc:654] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.047174  7768 heartbeater.cc:499] Master 127.0.107.254:40329 was elected leader, sending a full tablet report...
I20260709 13:00:52.029930  7576 tablet_service.cc:1511] Processing CreateTablet for tablet 6d02dd8c5b7c4a09a55b18dc5b4d7e93 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:52.055445  7862 ts_tablet_manager.cc:1434] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.107s	user 0.013s	sys 0.017s
I20260709 13:00:52.055882  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d02dd8c5b7c4a09a55b18dc5b4d7e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.056679  7862 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:52.054347  7578 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5331e5203b4e18bef7bbf5215bfcd2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:52.050688  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5331e5203b4e18bef7bbf5215bfcd2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:52.058367  7864 ts_tablet_manager.cc:1434] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.218s	user 0.015s	sys 0.009s
I20260709 13:00:52.059023  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5331e5203b4e18bef7bbf5215bfcd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.058173  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5331e5203b4e18bef7bbf5215bfcd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.059386  7842 heartbeater.cc:499] Master 127.0.107.254:40329 was elected leader, sending a full tablet report...
I20260709 13:00:52.059623  7864 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
W20260709 13:00:52.064563  7769 tablet.cc:2406] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:52.030418  7728 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5331e5203b4e18bef7bbf5215bfcd2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:52.070674  7728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5331e5203b4e18bef7bbf5215bfcd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.074515  7872 raft_consensus.cc:493] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.075136  7872 raft_consensus.cc:515] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.100725  7872 leader_election.cc:290] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:52.106020  7862 tablet_bootstrap.cc:654] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.124133  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc99687adf94edfbef9f24e9d43510b (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:52.125589  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc99687adf94edfbef9f24e9d43510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.118613  7655 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc99687adf94edfbef9f24e9d43510b (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:52.127627  7655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc99687adf94edfbef9f24e9d43510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.139226  7865 tablet_bootstrap.cc:492] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:52.139977  7865 ts_tablet_manager.cc:1403] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.009s
I20260709 13:00:52.144634  7865 raft_consensus.cc:359] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:52.145789  7865 raft_consensus.cc:385] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.146169  7865 raft_consensus.cc:740] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.148952  7869 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:52.149487  7869 ts_tablet_manager.cc:1403] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.170s	user 0.017s	sys 0.000s
I20260709 13:00:52.149243  7584 tablet_service.cc:1511] Processing CreateTablet for tablet 41b65ffc44e9482a9db36207427de2f7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:52.151669  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b65ffc44e9482a9db36207427de2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.154211  7869 raft_consensus.cc:359] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:52.155200  7869 raft_consensus.cc:385] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.155509  7869 raft_consensus.cc:740] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.158372  7869 consensus_queue.cc:260] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:52.168190  7805 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc99687adf94edfbef9f24e9d43510b (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:52.169689  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc99687adf94edfbef9f24e9d43510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.173118  7653 tablet_service.cc:1511] Processing CreateTablet for tablet 41b65ffc44e9482a9db36207427de2f7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:52.174469  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b65ffc44e9482a9db36207427de2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.178001  7870 raft_consensus.cc:493] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.178557  7870 raft_consensus.cc:515] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.179642  7654 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4495c3f82450cbeb8cf7b1ce76dce (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:52.181448  7870 leader_election.cc:290] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:52.185617  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4495c3f82450cbeb8cf7b1ce76dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.186095  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 41b65ffc44e9482a9db36207427de2f7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:52.185467  7806 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4495c3f82450cbeb8cf7b1ce76dce (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:52.191730  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4495c3f82450cbeb8cf7b1ce76dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.207439  7801 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7e711bccc84ba9aab8ad5513568455 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:52.209615  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7e711bccc84ba9aab8ad5513568455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.192212  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b65ffc44e9482a9db36207427de2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.189924  7865 consensus_queue.cc:260] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:52.203794  7864 tablet_bootstrap.cc:654] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.233119  7865 ts_tablet_manager.cc:1434] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.003s
I20260709 13:00:52.234436  7865 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:52.240906  7869 ts_tablet_manager.cc:1434] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.008s
I20260709 13:00:52.245038  7576 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4495c3f82450cbeb8cf7b1ce76dce (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:52.245110  7580 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7e711bccc84ba9aab8ad5513568455 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:52.248848  7871 raft_consensus.cc:493] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.249553  7871 raft_consensus.cc:515] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:52.250131  7862 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:52.250838  7862 ts_tablet_manager.cc:1403] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.194s	user 0.010s	sys 0.018s
I20260709 13:00:52.250555  7655 tablet_service.cc:1511] Processing CreateTablet for tablet 1604dbc6aa844378800263c852a90568 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:52.252069  7655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1604dbc6aa844378800263c852a90568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.255100  7862 raft_consensus.cc:359] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.256028  7862 raft_consensus.cc:385] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.256422  7862 raft_consensus.cc:740] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.258529  7871 leader_election.cc:290] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:52.259294  7862 consensus_queue.cc:260] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.262477  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4495c3f82450cbeb8cf7b1ce76dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.273505  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7e711bccc84ba9aab8ad5513568455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.275409  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e32453a044d0bc4a18d3bf785518" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:52.286561  7782 leader_election.cc:343] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.290712  7862 ts_tablet_manager.cc:1434] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 13:00:52.291899  7862 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:52.290347  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 1604dbc6aa844378800263c852a90568 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:52.293377  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1604dbc6aa844378800263c852a90568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.296919  7578 tablet_service.cc:1511] Processing CreateTablet for tablet c80b3e6d140c42ab83aedacbad5a486d (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:52.298530  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80b3e6d140c42ab83aedacbad5a486d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.301854  7869 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:52.303678  7862 tablet_bootstrap.cc:654] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.311761  7807 tablet_service.cc:1511] Processing CreateTablet for tablet 5496197ab1264ee1887afbf67a081376 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:52.313124  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5496197ab1264ee1887afbf67a081376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.331914  7881 raft_consensus.cc:493] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.332502  7881 raft_consensus.cc:515] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:52.352339  7869 tablet_bootstrap.cc:654] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.352888  7578 tablet_service.cc:1511] Processing CreateTablet for tablet 5496197ab1264ee1887afbf67a081376 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:52.353802  7654 tablet_service.cc:1511] Processing CreateTablet for tablet c80b3e6d140c42ab83aedacbad5a486d (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:52.357115  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7e711bccc84ba9aab8ad5513568455 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:52.358929  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5496197ab1264ee1887afbf67a081376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.359017  7729 tablet_service.cc:1511] Processing CreateTablet for tablet 1604dbc6aa844378800263c852a90568 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:52.360296  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7e711bccc84ba9aab8ad5513568455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.360443  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80b3e6d140c42ab83aedacbad5a486d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.348902  7881 leader_election.cc:290] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:52.371155  7865 tablet_bootstrap.cc:654] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.371024  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:52.371997  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 5496197ab1264ee1887afbf67a081376 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:52.375229  7732 tablet_service.cc:1511] Processing CreateTablet for tablet c80b3e6d140c42ab83aedacbad5a486d (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:52.377040  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:52.379448  7727 tablet_service.cc:1511] Processing CreateTablet for tablet 229814a1ef67415c854a94da0c89c7c0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:52.390913  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e32453a044d0bc4a18d3bf785518" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:52.399567  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5496197ab1264ee1887afbf67a081376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.403024  7801 tablet_service.cc:1511] Processing CreateTablet for tablet 229814a1ef67415c854a94da0c89c7c0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:52.404551  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229814a1ef67415c854a94da0c89c7c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:52.404968  7706 leader_election.cc:343] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:52.406949  7708 leader_election.cc:343] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.407526  7708 leader_election.cc:304] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:52.394797  7870 raft_consensus.cc:493] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.395133  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1604dbc6aa844378800263c852a90568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.410948  7864 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:52.414630  7870 raft_consensus.cc:515] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.428267  7870 leader_election.cc:290] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:52.428758  7870 raft_consensus.cc:2749] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.435009  7864 ts_tablet_manager.cc:1403] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.376s	user 0.006s	sys 0.010s
I20260709 13:00:52.446287  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229814a1ef67415c854a94da0c89c7c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:52.448293  7780 leader_election.cc:343] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.455749  7780 leader_election.cc:304] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
W20260709 13:00:52.456806  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 57974.7us
I20260709 13:00:52.461885  7873 raft_consensus.cc:2749] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.464484  7580 tablet_service.cc:1511] Processing CreateTablet for tablet 229814a1ef67415c854a94da0c89c7c0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:52.465813  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229814a1ef67415c854a94da0c89c7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.468595  7653 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef8564b08234776a109c3b317ab232e (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:52.470008  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef8564b08234776a109c3b317ab232e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.470369  7732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80b3e6d140c42ab83aedacbad5a486d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.478166  7806 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef8564b08234776a109c3b317ab232e (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:52.478754  7862 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:52.479590  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef8564b08234776a109c3b317ab232e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.479395  7584 tablet_service.cc:1511] Processing CreateTablet for tablet 93820f75ef26417db4b155dd5f3847ef (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:52.480654  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93820f75ef26417db4b155dd5f3847ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.479297  7862 ts_tablet_manager.cc:1403] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.188s	user 0.034s	sys 0.019s
I20260709 13:00:52.484687  7864 raft_consensus.cc:359] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.485543  7864 raft_consensus.cc:385] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.487057  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:52.499984  7871 raft_consensus.cc:493] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.492015  7708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 85269.2us
W20260709 13:00:52.519286  7633 leader_election.cc:343] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.528229  7871 raft_consensus.cc:515] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:52.529452  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 93820f75ef26417db4b155dd5f3847ef (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:52.530792  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93820f75ef26417db4b155dd5f3847ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.532235  7871 leader_election.cc:290] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:52.534974  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:52.536150  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef8564b08234776a109c3b317ab232e (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:00:52.536669  7708 leader_election.cc:343] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.539311  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 93820f75ef26417db4b155dd5f3847ef (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:52.541482  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef8564b08234776a109c3b317ab232e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.541981  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:00:52.543686  7633 leader_election.cc:343] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.513051  7864 raft_consensus.cc:740] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.545109  7864 consensus_queue.cc:260] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.547528  7864 ts_tablet_manager.cc:1434] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.002s
I20260709 13:00:52.548951  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93820f75ef26417db4b155dd5f3847ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.551138  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
W20260709 13:00:52.553041  7632 leader_election.cc:343] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.553596  7632 leader_election.cc:304] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:52.554870  7871 raft_consensus.cc:2749] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.556160  7864 tablet_bootstrap.cc:492] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:52.560431  7805 tablet_service.cc:1511] Processing CreateTablet for tablet 51ea4c1d73af403bb50c3ecab728ec32 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:52.562394  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ea4c1d73af403bb50c3ecab728ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.562765  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:52.563257  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:52.563947  7594 raft_consensus.cc:2468] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
W20260709 13:00:52.564391  7707 leader_election.cc:343] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.564922  7707 leader_election.cc:304] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:52.565982  7894 raft_consensus.cc:2749] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.565690  7634 leader_election.cc:304] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7
I20260709 13:00:52.485340  7862 raft_consensus.cc:359] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.571442  7871 raft_consensus.cc:2804] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.572870  7871 raft_consensus.cc:493] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.575569  7871 raft_consensus.cc:3060] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.576018  7869 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:52.576551  7869 ts_tablet_manager.cc:1403] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.275s	user 0.016s	sys 0.007s
I20260709 13:00:52.579710  7869 raft_consensus.cc:359] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.580516  7869 raft_consensus.cc:385] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.580817  7869 raft_consensus.cc:740] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.581606  7869 consensus_queue.cc:260] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.583738  7869 ts_tablet_manager.cc:1434] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:52.584811  7869 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:52.591769  7869 tablet_bootstrap.cc:654] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.588914  7871 raft_consensus.cc:515] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:52.572054  7862 raft_consensus.cc:385] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.610555  7862 raft_consensus.cc:740] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.625676  7862 consensus_queue.cc:260] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.627890  7862 ts_tablet_manager.cc:1434] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.000s
I20260709 13:00:52.628988  7862 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
W20260709 13:00:52.635555  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:52.602736  7580 tablet_service.cc:1511] Processing CreateTablet for tablet 51ea4c1d73af403bb50c3ecab728ec32 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:52.635279  7729 tablet_service.cc:1511] Processing CreateTablet for tablet 8295a58ce0dd4fb99fffd754746b8b0a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:52.636811  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8295a58ce0dd4fb99fffd754746b8b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.643740  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ea4c1d73af403bb50c3ecab728ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.649276  7578 tablet_service.cc:1511] Processing CreateTablet for tablet 8295a58ce0dd4fb99fffd754746b8b0a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:52.649401  7805 tablet_service.cc:1511] Processing CreateTablet for tablet 8295a58ce0dd4fb99fffd754746b8b0a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:52.650784  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8295a58ce0dd4fb99fffd754746b8b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.651051  7864 tablet_bootstrap.cc:654] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.651443  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8295a58ce0dd4fb99fffd754746b8b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.663954  7871 leader_election.cc:290] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:52.664808  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:52.666465  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:52.665472  7594 raft_consensus.cc:3060] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:52.668342  7633 leader_election.cc:343] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.671623  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:00:52.673390  7558 leader_election.cc:343] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.673552  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:52.674604  7669 raft_consensus.cc:2393] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:00:52.676247  7557 leader_election.cc:304] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:52.677695  7894 raft_consensus.cc:493] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.678305  7894 raft_consensus.cc:515] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.679991  7594 raft_consensus.cc:2468] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:52.662388  7654 tablet_service.cc:1511] Processing CreateTablet for tablet 51ea4c1d73af403bb50c3ecab728ec32 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:52.681634  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ea4c1d73af403bb50c3ecab728ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.681429  7634 leader_election.cc:304] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7
I20260709 13:00:52.682183  7881 raft_consensus.cc:2749] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.685890  7871 raft_consensus.cc:2804] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.686295  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e32453a044d0bc4a18d3bf785518" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:52.686661  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e32453a044d0bc4a18d3bf785518" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:52.687033  7594 raft_consensus.cc:2468] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
I20260709 13:00:52.687626  7817 raft_consensus.cc:2468] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
I20260709 13:00:52.688333  7708 leader_election.cc:304] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:52.689213  7870 raft_consensus.cc:2804] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.689651  7870 raft_consensus.cc:493] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.690004  7870 raft_consensus.cc:3060] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.689862  7894 leader_election.cc:290] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:52.691738  7862 tablet_bootstrap.cc:654] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.698307  7865 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:52.699483  7865 ts_tablet_manager.cc:1403] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.465s	user 0.047s	sys 0.033s
I20260709 13:00:52.702461  7659 tablet_service.cc:1511] Processing CreateTablet for tablet f985608da1404258977e2e929aad7559 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:52.703869  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f985608da1404258977e2e929aad7559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.706283  7865 raft_consensus.cc:359] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.710168  7862 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:52.729007  7862 ts_tablet_manager.cc:1403] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.100s	user 0.006s	sys 0.010s
I20260709 13:00:52.730086  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 45a1233ab4c040ebaf43748e94eaf5b5 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:52.698527  7870 raft_consensus.cc:515] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.731688  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a1233ab4c040ebaf43748e94eaf5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.732584  7862 raft_consensus.cc:359] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.733237  7870 leader_election.cc:290] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:52.739378  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e32453a044d0bc4a18d3bf785518" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:52.739143  7805 tablet_service.cc:1511] Processing CreateTablet for tablet 5b0c19d3d9ae4f2d97d738803826bf74 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:52.725782  7806 tablet_service.cc:1511] Processing CreateTablet for tablet f985608da1404258977e2e929aad7559 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:52.726972  7584 tablet_service.cc:1511] Processing CreateTablet for tablet 45a1233ab4c040ebaf43748e94eaf5b5 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:52.728228  7864 tablet_bootstrap.cc:492] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:52.741209  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b0c19d3d9ae4f2d97d738803826bf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.716972  7729 tablet_service.cc:1511] Processing CreateTablet for tablet f985608da1404258977e2e929aad7559 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:52.744094  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f985608da1404258977e2e929aad7559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.744913  7653 tablet_service.cc:1511] Processing CreateTablet for tablet 5b0c19d3d9ae4f2d97d738803826bf74 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:52.746510  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b0c19d3d9ae4f2d97d738803826bf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.710474  7869 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:52.749063  7869 ts_tablet_manager.cc:1403] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.164s	user 0.037s	sys 0.046s
I20260709 13:00:52.750278  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f985608da1404258977e2e929aad7559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.730079  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 45a1233ab4c040ebaf43748e94eaf5b5 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:52.736363  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e32453a044d0bc4a18d3bf785518" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:52.752499  7817 raft_consensus.cc:3060] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.752362  7869 raft_consensus.cc:359] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:52.734021  7865 raft_consensus.cc:385] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.742134  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a1233ab4c040ebaf43748e94eaf5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.733467  7862 raft_consensus.cc:385] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.754261  7865 raft_consensus.cc:740] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.742530  7864 ts_tablet_manager.cc:1403] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.001s
I20260709 13:00:52.740599  7594 raft_consensus.cc:3060] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.758999  7862 raft_consensus.cc:740] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.759873  7862 consensus_queue.cc:260] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.756104  7865 consensus_queue.cc:260] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.760646  7864 raft_consensus.cc:359] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:52.762840  7864 raft_consensus.cc:385] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.763144  7864 raft_consensus.cc:740] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.763907  7865 ts_tablet_manager.cc:1434] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 13:00:52.765084  7865 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:52.765681  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 30c245d203f74d999c25bede65ee4f53 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:52.766335  7862 ts_tablet_manager.cc:1434] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:00:52.753284  7869 raft_consensus.cc:385] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.766780  7869 raft_consensus.cc:740] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.767133  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a1233ab4c040ebaf43748e94eaf5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.767405  7862 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:52.767652  7869 consensus_queue.cc:260] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:52.766216  7871 raft_consensus.cc:697] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:52.772115  7871 consensus_queue.cc:237] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:52.774705  7862 tablet_bootstrap.cc:654] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.775758  7873 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.776249  7873 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.777631  7869 ts_tablet_manager.cc:1434] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:00:52.778589  7873 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:52.780189  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c245d203f74d999c25bede65ee4f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.781379  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:52.781239  7801 tablet_service.cc:1511] Processing CreateTablet for tablet 30c245d203f74d999c25bede65ee4f53 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:52.782608  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c245d203f74d999c25bede65ee4f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.784660  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:52.786024  7780 leader_election.cc:343] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.786005  7817 raft_consensus.cc:2468] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:52.787918  7707 leader_election.cc:304] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:52.788830  7870 raft_consensus.cc:2804] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.789534  7870 raft_consensus.cc:697] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
W20260709 13:00:52.789650  7782 leader_election.cc:343] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.790485  7870 consensus_queue.cc:237] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.792253  7782 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:52.793746  7873 raft_consensus.cc:2749] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.778767  7869 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:52.763916  7864 consensus_queue.cc:260] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:52.805401  7576 tablet_service.cc:1511] Processing CreateTablet for tablet 30c245d203f74d999c25bede65ee4f53 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:52.811502  7865 tablet_bootstrap.cc:654] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.812192  7578 tablet_service.cc:1511] Processing CreateTablet for tablet 5b0c19d3d9ae4f2d97d738803826bf74 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:52.814131  7864 ts_tablet_manager.cc:1434] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.003s
I20260709 13:00:52.834636  7864 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:52.835767  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 8153e37254134d1494dcd79f992b6967 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:52.842056  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8153e37254134d1494dcd79f992b6967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.837445  7653 tablet_service.cc:1511] Processing CreateTablet for tablet 8153e37254134d1494dcd79f992b6967 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:52.845981  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8153e37254134d1494dcd79f992b6967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.850562  7864 tablet_bootstrap.cc:654] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.851824  7869 tablet_bootstrap.cc:654] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.850661  7727 tablet_service.cc:1511] Processing CreateTablet for tablet 8153e37254134d1494dcd79f992b6967 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:52.855502  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8153e37254134d1494dcd79f992b6967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.855095  7492 catalog_manager.cc:5697] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 0 to 1, leader changed from <none> to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.863426  7580 tablet_service.cc:1511] Processing CreateTablet for tablet 639d9a3ce83649d6ba3735d7d3d81fc5 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:52.864029  7594 raft_consensus.cc:2468] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:52.870280  7654 tablet_service.cc:1511] Processing CreateTablet for tablet 639d9a3ce83649d6ba3735d7d3d81fc5 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:52.872148  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639d9a3ce83649d6ba3735d7d3d81fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.880245  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c245d203f74d999c25bede65ee4f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.897746  7801 tablet_service.cc:1511] Processing CreateTablet for tablet fe0b231c31d34cc19a247378b4e932bf (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:52.899127  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639d9a3ce83649d6ba3735d7d3d81fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.899437  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0b231c31d34cc19a247378b4e932bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.900345  7584 tablet_service.cc:1511] Processing CreateTablet for tablet fe0b231c31d34cc19a247378b4e932bf (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:52.901646  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b0c19d3d9ae4f2d97d738803826bf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.905035  7490 catalog_manager.cc:5697] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.907212  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0b231c31d34cc19a247378b4e932bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.912985  7729 tablet_service.cc:1511] Processing CreateTablet for tablet 639d9a3ce83649d6ba3735d7d3d81fc5 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:52.914479  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639d9a3ce83649d6ba3735d7d3d81fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.932375  7865 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:52.932976  7865 ts_tablet_manager.cc:1403] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.168s	user 0.011s	sys 0.004s
I20260709 13:00:52.933799  7659 tablet_service.cc:1511] Processing CreateTablet for tablet fe0b231c31d34cc19a247378b4e932bf (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:52.935204  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0b231c31d34cc19a247378b4e932bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.936151  7862 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:52.936205  7865 raft_consensus.cc:359] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.937150  7865 raft_consensus.cc:385] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.937461  7865 raft_consensus.cc:740] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.936861  7862 ts_tablet_manager.cc:1403] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.170s	user 0.019s	sys 0.006s
I20260709 13:00:52.939525  7865 consensus_queue.cc:260] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.944561  7862 raft_consensus.cc:359] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.945685  7862 raft_consensus.cc:385] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.946084  7862 raft_consensus.cc:740] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.947516  7870 raft_consensus.cc:493] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.948084  7870 raft_consensus.cc:515] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.949111  7865 ts_tablet_manager.cc:1434] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:00:52.950809  7865 tablet_bootstrap.cc:492] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:52.953248  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f610a99a66b94fc0aa4565a0494013f0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:52.954221  7669 raft_consensus.cc:2468] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
I20260709 13:00:52.954455  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f610a99a66b94fc0aa4565a0494013f0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:52.955953  7706 leader_election.cc:304] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
W20260709 13:00:52.956810  7708 leader_election.cc:343] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.956838  7894 raft_consensus.cc:2804] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.957965  7894 raft_consensus.cc:493] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.958353  7894 raft_consensus.cc:3060] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.959553  7869 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:52.960119  7869 ts_tablet_manager.cc:1403] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.016s
I20260709 13:00:52.962060  7862 consensus_queue.cc:260] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.963617  7869 raft_consensus.cc:359] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.964495  7870 leader_election.cc:290] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:52.964470  7869 raft_consensus.cc:385] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.969532  7869 raft_consensus.cc:740] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.970629  7869 consensus_queue.cc:260] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:52.971666  7727 tablet_service.cc:1511] Processing CreateTablet for tablet 17d9469ca1534ec2b25b7938331c6600 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:52.973335  7869 ts_tablet_manager.cc:1434] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 13:00:52.973507  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d9469ca1534ec2b25b7938331c6600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.983464  7870 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.975733  7894 raft_consensus.cc:515] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.984021  7870 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:52.984825  7873 raft_consensus.cc:493] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.985715  7873 raft_consensus.cc:515] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:52.986160  7870 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:52.987380  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:52.988142  7873 leader_election.cc:290] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
W20260709 13:00:52.989305  7706 leader_election.cc:343] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.990319  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f610a99a66b94fc0aa4565a0494013f0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:52.990923  7669 raft_consensus.cc:3060] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.993918  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f610a99a66b94fc0aa4565a0494013f0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:52.995811  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:53.004900  7708 leader_election.cc:343] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:53.007295  7708 leader_election.cc:343] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.007751  7708 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:53.008510  7870 raft_consensus.cc:2749] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.008241  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 17d9469ca1534ec2b25b7938331c6600 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:53.009588  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d9469ca1534ec2b25b7938331c6600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.011529  7864 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:53.012035  7864 ts_tablet_manager.cc:1403] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.178s	user 0.011s	sys 0.019s
I20260709 13:00:53.014160  7869 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:52.998193  7894 leader_election.cc:290] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:53.009994  7865 tablet_bootstrap.cc:654] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.014600  7669 raft_consensus.cc:2468] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:53.022176  7864 raft_consensus.cc:359] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.023224  7864 raft_consensus.cc:385] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.023527  7864 raft_consensus.cc:740] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.024385  7864 consensus_queue.cc:260] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.026026  7706 leader_election.cc:304] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:53.026835  7864 ts_tablet_manager.cc:1434] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:00:53.028095  7864 tablet_bootstrap.cc:492] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:53.028164  7873 raft_consensus.cc:493] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.028807  7873 raft_consensus.cc:515] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.032131  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:53.032805  7594 raft_consensus.cc:2468] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:53.038630  7782 leader_election.cc:304] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:53.037285  7873 leader_election.cc:290] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:53.040311  7873 raft_consensus.cc:2804] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.040848  7873 raft_consensus.cc:493] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.041286  7873 raft_consensus.cc:3060] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.043450  7584 tablet_service.cc:1511] Processing CreateTablet for tablet 17d9469ca1534ec2b25b7938331c6600 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:53.047017  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:53.049692  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:53.050333  7743 raft_consensus.cc:2468] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:53.044602  7911 raft_consensus.cc:2804] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.051779  7911 raft_consensus.cc:697] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:00:53.052582  7911 consensus_queue.cc:237] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.053668  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d9469ca1534ec2b25b7938331c6600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.055184  7862 ts_tablet_manager.cc:1434] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.114s	user 0.016s	sys 0.012s
W20260709 13:00:53.054587  7780 leader_election.cc:343] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.062448  7654 tablet_service.cc:1511] Processing CreateTablet for tablet dc0e53656f344150a25cb441648dd489 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:53.063911  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0e53656f344150a25cb441648dd489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.066516  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:53.070642  7669 raft_consensus.cc:2468] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:53.080327  7729 tablet_service.cc:1511] Processing CreateTablet for tablet dc0e53656f344150a25cb441648dd489 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:53.082052  7869 tablet_bootstrap.cc:654] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.082641  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0e53656f344150a25cb441648dd489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.083277  7780 leader_election.cc:304] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: b81c129769e24f019dc9045ce8c09771
I20260709 13:00:53.085333  7862 tablet_bootstrap.cc:492] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:53.090652  7864 tablet_bootstrap.cc:654] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.091809  7914 raft_consensus.cc:2804] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.092427  7914 raft_consensus.cc:493] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.092895  7914 raft_consensus.cc:3060] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.096812  7801 tablet_service.cc:1511] Processing CreateTablet for tablet dc0e53656f344150a25cb441648dd489 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:53.098287  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0e53656f344150a25cb441648dd489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.097960  7580 tablet_service.cc:1511] Processing CreateTablet for tablet f97aa2293ce6406190f9b27a1f8ee8c8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:53.099292  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97aa2293ce6406190f9b27a1f8ee8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.115790  7659 tablet_service.cc:1511] Processing CreateTablet for tablet f97aa2293ce6406190f9b27a1f8ee8c8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:53.118042  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97aa2293ce6406190f9b27a1f8ee8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.121924  7731 tablet_service.cc:1511] Processing CreateTablet for tablet f97aa2293ce6406190f9b27a1f8ee8c8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:53.123910  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97aa2293ce6406190f9b27a1f8ee8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.132512  7873 raft_consensus.cc:515] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.136492  7862 tablet_bootstrap.cc:654] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.144109  7865 tablet_bootstrap.cc:492] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:53.147277  7865 ts_tablet_manager.cc:1403] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.197s	user 0.039s	sys 0.027s
I20260709 13:00:53.150528  7865 raft_consensus.cc:359] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.151552  7865 raft_consensus.cc:385] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.151880  7865 raft_consensus.cc:740] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.152604  7865 consensus_queue.cc:260] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.160086  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:53.160830  7743 raft_consensus.cc:3060] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.162091  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:53.162792  7594 raft_consensus.cc:3060] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.162420  7871 consensus_queue.cc:1048] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:53.160281  7873 leader_election.cc:290] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:53.170192  7865 ts_tablet_manager.cc:1434] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:00:53.171720  7865 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:53.175565  7804 tablet_service.cc:1511] Processing CreateTablet for tablet c0511ad7dfd44065b288a786074949ef (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:53.176403  7576 tablet_service.cc:1511] Processing CreateTablet for tablet c0511ad7dfd44065b288a786074949ef (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:53.177084  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0511ad7dfd44065b288a786074949ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.177435  7653 tablet_service.cc:1511] Processing CreateTablet for tablet c0511ad7dfd44065b288a786074949ef (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:53.178280  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0511ad7dfd44065b288a786074949ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.178771  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0511ad7dfd44065b288a786074949ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.182454  7871 raft_consensus.cc:493] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.183486  7871 raft_consensus.cc:515] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.184922  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 3a49f753e0c24447b801656d29b78649 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:53.185912  7594 raft_consensus.cc:2468] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:53.186519  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a49f753e0c24447b801656d29b78649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.187417  7782 leader_election.cc:304] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:53.188016  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:53.188416  7873 raft_consensus.cc:2804] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.188961  7742 raft_consensus.cc:2468] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:53.190959  7632 leader_election.cc:304] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:53.192314  7900 raft_consensus.cc:2804] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.192865  7900 raft_consensus.cc:493] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.193321  7900 raft_consensus.cc:3060] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.219138  7580 tablet_service.cc:1511] Processing CreateTablet for tablet 3a49f753e0c24447b801656d29b78649 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:53.224313  7873 raft_consensus.cc:697] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:53.226392  7805 tablet_service.cc:1511] Processing CreateTablet for tablet 3a49f753e0c24447b801656d29b78649 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:53.214455  7914 raft_consensus.cc:515] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.223711  7871 leader_election.cc:290] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:53.234251  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:53.249595  7634 leader_election.cc:343] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.249871  7869 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:53.230795  7881 raft_consensus.cc:493] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.250612  7869 ts_tablet_manager.cc:1403] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.237s	user 0.021s	sys 0.013s
I20260709 13:00:53.250881  7881 raft_consensus.cc:515] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:53.238479  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a49f753e0c24447b801656d29b78649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.254940  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a36b4572f0444dafd0d51bfc100984" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:53.255306  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a36b4572f0444dafd0d51bfc100984" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:53.256531  7914 leader_election.cc:290] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:53.253419  7881 leader_election.cc:290] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:00:53.257707  7557 leader_election.cc:343] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.246126  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a49f753e0c24447b801656d29b78649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.258708  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
W20260709 13:00:53.260221  7558 leader_election.cc:343] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.260704  7558 leader_election.cc:304] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:53.261174  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 7daadac41440483ba1ee8e8ff7b4f741 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:00:53.262065  7780 leader_election.cc:343] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.258728  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:53.263355  7669 raft_consensus.cc:3060] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.265964  7881 raft_consensus.cc:2749] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.270084  7743 raft_consensus.cc:2468] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:53.270299  7869 raft_consensus.cc:359] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.271926  7869 raft_consensus.cc:385] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.273682  7869 raft_consensus.cc:740] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.227272  7873 consensus_queue.cc:237] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.273255  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7daadac41440483ba1ee8e8ff7b4f741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.272773  7865 tablet_bootstrap.cc:654] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.277271  7911 consensus_queue.cc:1048] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:00:53.283530  7806 tablet_service.cc:1511] Processing CreateTablet for tablet 7daadac41440483ba1ee8e8ff7b4f741 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:53.284940  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7daadac41440483ba1ee8e8ff7b4f741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.284720  7578 tablet_service.cc:1511] Processing CreateTablet for tablet f82c3df35a7c4361be5f6570b4d2af91 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:53.285977  7864 tablet_bootstrap.cc:492] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:53.286031  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82c3df35a7c4361be5f6570b4d2af91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.286669  7864 ts_tablet_manager.cc:1403] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.259s	user 0.033s	sys 0.030s
I20260709 13:00:53.274554  7869 consensus_queue.cc:260] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.293063  7869 ts_tablet_manager.cc:1434] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.003s
I20260709 13:00:53.292999  7862 tablet_bootstrap.cc:492] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:53.311375  7669 raft_consensus.cc:2468] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:53.313326  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 7daadac41440483ba1ee8e8ff7b4f741 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:53.314280  7780 leader_election.cc:304] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: b81c129769e24f019dc9045ce8c09771
I20260709 13:00:53.314725  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7daadac41440483ba1ee8e8ff7b4f741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.314371  7727 tablet_service.cc:1511] Processing CreateTablet for tablet f82c3df35a7c4361be5f6570b4d2af91 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:53.316251  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82c3df35a7c4361be5f6570b4d2af91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.316267  7920 raft_consensus.cc:2804] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.318432  7920 raft_consensus.cc:697] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:53.319237  7920 consensus_queue.cc:237] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.323163  7911 consensus_queue.cc:1048] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.310583  7862 ts_tablet_manager.cc:1403] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.225s	user 0.012s	sys 0.008s
I20260709 13:00:53.337359  7869 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:53.325974  7881 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.340574  7864 raft_consensus.cc:359] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.342761  7864 raft_consensus.cc:385] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.342365  7881 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.306521  7900 raft_consensus.cc:515] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.372067  7900 leader_election.cc:290] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:53.371752  7654 tablet_service.cc:1511] Processing CreateTablet for tablet f82c3df35a7c4361be5f6570b4d2af91 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:53.373258  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82c3df35a7c4361be5f6570b4d2af91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.346683  7864 raft_consensus.cc:740] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.388087  7865 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:53.388698  7865 ts_tablet_manager.cc:1403] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.217s	user 0.017s	sys 0.006s
I20260709 13:00:53.394408  7862 raft_consensus.cc:359] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.395277  7862 raft_consensus.cc:385] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.395593  7862 raft_consensus.cc:740] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
W20260709 13:00:53.409626  7633 consensus_peers.cc:597] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 -> Peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Couldn't send request to peer 1075f1083cc84c349b3a0bd57774c1e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:53.408427  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:53.411577  7815 raft_consensus.cc:2468] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:53.410094  7862 consensus_queue.cc:260] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.414090  7659 tablet_service.cc:1511] Processing CreateTablet for tablet ce87ae60b2104f579d001664481e7aa8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:53.415484  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce87ae60b2104f579d001664481e7aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.401660  7881 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:53.433616  7580 tablet_service.cc:1511] Processing CreateTablet for tablet ce87ae60b2104f579d001664481e7aa8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:53.435324  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce87ae60b2104f579d001664481e7aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.444543  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:53.430693  7864 consensus_queue.cc:260] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.446813  7743 raft_consensus.cc:3060] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.448138  7864 ts_tablet_manager.cc:1434] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.161s	user 0.009s	sys 0.001s
I20260709 13:00:53.450212  7801 tablet_service.cc:1511] Processing CreateTablet for tablet ce87ae60b2104f579d001664481e7aa8 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:53.432055  7558 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:53.461265  7881 raft_consensus.cc:2804] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.462692  7881 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.463274  7881 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.474021  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce87ae60b2104f579d001664481e7aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.477624  7864 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:53.486243  7862 ts_tablet_manager.cc:1434] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.003s
I20260709 13:00:53.487571  7862 tablet_bootstrap.cc:492] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:53.490947  7491 catalog_manager.cc:5697] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 0 to 1, leader changed from <none> to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.493076  7743 raft_consensus.cc:2468] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:53.501893  7804 tablet_service.cc:1511] Processing CreateTablet for tablet cba55b3f6e424ec7a65fc13489c43a43 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:53.503340  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba55b3f6e424ec7a65fc13489c43a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.503825  7489 catalog_manager.cc:5697] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.508350  7870 raft_consensus.cc:493] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.508896  7870 raft_consensus.cc:515] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.509917  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:53.509523  7726 tablet_service.cc:1511] Processing CreateTablet for tablet cba55b3f6e424ec7a65fc13489c43a43 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:53.511112  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba55b3f6e424ec7a65fc13489c43a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.512385  7870 leader_election.cc:290] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:53.513130  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85d25c4f4df4190af72f86b0328a345" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:53.513901  7669 raft_consensus.cc:2468] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
W20260709 13:00:53.516883  7634 leader_election.cc:343] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.518049  7706 leader_election.cc:304] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:53.513887  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85d25c4f4df4190af72f86b0328a345" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:53.518939  7870 raft_consensus.cc:2804] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.519313  7870 raft_consensus.cc:493] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.519382  7817 raft_consensus.cc:2468] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
I20260709 13:00:53.519738  7870 raft_consensus.cc:3060] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.520350  7869 tablet_bootstrap.cc:654] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.521545  7584 tablet_service.cc:1511] Processing CreateTablet for tablet cba55b3f6e424ec7a65fc13489c43a43 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:53.523387  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba55b3f6e424ec7a65fc13489c43a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.529000  7632 leader_election.cc:304] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:53.530470  7900 raft_consensus.cc:2804] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.530977  7900 raft_consensus.cc:697] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:53.531435  7881 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.531797  7900 consensus_queue.cc:237] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.534276  7881 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:53.536649  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:53.538255  7817 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.543123  7864 tablet_bootstrap.cc:654] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.544132  7870 raft_consensus.cc:515] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.547676  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:53.548487  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:53.552903  7911 consensus_queue.cc:1048] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.553524  7653 tablet_service.cc:1511] Processing CreateTablet for tablet c23d956c8a9a435baf5e03e60d7a052a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:53.581233  7870 leader_election.cc:290] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:53.581475  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23d956c8a9a435baf5e03e60d7a052a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.582895  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85d25c4f4df4190af72f86b0328a345" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:53.583603  7816 raft_consensus.cc:3060] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.556542  7731 tablet_service.cc:1511] Processing CreateTablet for tablet c23d956c8a9a435baf5e03e60d7a052a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:53.590332  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23d956c8a9a435baf5e03e60d7a052a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.556738  7801 tablet_service.cc:1511] Processing CreateTablet for tablet c23d956c8a9a435baf5e03e60d7a052a (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:00:53.579062  7557 leader_election.cc:343] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.592375  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23d956c8a9a435baf5e03e60d7a052a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:53.594695  7557 leader_election.cc:343] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.595247  7578 tablet_service.cc:1511] Processing CreateTablet for tablet 7c15656cdc6f4507ae213e6321baad95 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:53.565064  7865 raft_consensus.cc:359] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:53.610258  7862 tablet_bootstrap.cc:654] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.610451  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85d25c4f4df4190af72f86b0328a345" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:53.610749  7817 raft_consensus.cc:2468] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:53.612501  7816 raft_consensus.cc:2468] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:53.597221  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c15656cdc6f4507ae213e6321baad95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.614359  7865 raft_consensus.cc:385] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.622941  7669 raft_consensus.cc:3060] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.642555  7707 leader_election.cc:304] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:53.632588  7865 raft_consensus.cc:740] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.645429  7865 consensus_queue.cc:260] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:53.647891  7865 ts_tablet_manager.cc:1434] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.259s	user 0.012s	sys 0.006s
I20260709 13:00:53.648986  7865 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:53.649955  7864 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:53.651422  7864 ts_tablet_manager.cc:1403] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.008s
I20260709 13:00:53.655575  7558 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: b81c129769e24f019dc9045ce8c09771
I20260709 13:00:53.656591  7881 raft_consensus.cc:2804] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.659861  7911 raft_consensus.cc:2804] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:00:53.663838  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:53.663582  7864 raft_consensus.cc:359] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:00:53.664366  7708 consensus_peers.cc:597] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:53.664700  7864 raft_consensus.cc:385] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.665094  7864 raft_consensus.cc:740] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.664462  7869 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:53.669452  7654 tablet_service.cc:1511] Processing CreateTablet for tablet 7c15656cdc6f4507ae213e6321baad95 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:53.670702  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c15656cdc6f4507ae213e6321baad95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.675417  7869 ts_tablet_manager.cc:1403] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.338s	user 0.042s	sys 0.048s
I20260709 13:00:53.676177  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 7c15656cdc6f4507ae213e6321baad95 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:53.677394  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c15656cdc6f4507ae213e6321baad95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.666230  7911 raft_consensus.cc:697] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:00:53.678591  7911 consensus_queue.cc:237] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.679005  7659 tablet_service.cc:1511] Processing CreateTablet for tablet baabbed5310440d19416189e295e3db0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:53.666050  7864 consensus_queue.cc:260] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:53.680405  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baabbed5310440d19416189e295e3db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.682152  7864 ts_tablet_manager.cc:1434] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.004s
I20260709 13:00:53.683270  7864 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:53.685173  7873 raft_consensus.cc:493] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.678627  7869 raft_consensus.cc:359] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.685766  7873 raft_consensus.cc:515] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:53.686201  7869 raft_consensus.cc:385] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.686587  7869 raft_consensus.cc:740] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.687985  7873 leader_election.cc:290] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:53.687098  7490 catalog_manager.cc:5697] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.689740  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 1581b91c4b8044b294ec8540edf505e9 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:53.690999  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1581b91c4b8044b294ec8540edf505e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.691761  7489 catalog_manager.cc:5697] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.693249  7869 consensus_queue.cc:260] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.695005  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 1581b91c4b8044b294ec8540edf505e9 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:53.696306  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1581b91c4b8044b294ec8540edf505e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.704773  7801 tablet_service.cc:1511] Processing CreateTablet for tablet baabbed5310440d19416189e295e3db0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:53.706486  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baabbed5310440d19416189e295e3db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.705892  7580 tablet_service.cc:1511] Processing CreateTablet for tablet baabbed5310440d19416189e295e3db0 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:53.708796  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baabbed5310440d19416189e295e3db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.723141  7881 raft_consensus.cc:697] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:53.743148  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:53.746877  7576 tablet_service.cc:1511] Processing CreateTablet for tablet 1581b91c4b8044b294ec8540edf505e9 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:53.764609  7864 tablet_bootstrap.cc:654] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.747043  7881 consensus_queue.cc:237] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:53.747529  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:53.775774  7862 tablet_bootstrap.cc:492] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:53.779182  7782 leader_election.cc:304] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:53.764611  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1581b91c4b8044b294ec8540edf505e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.780031  7920 raft_consensus.cc:2749] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.776402  7862 ts_tablet_manager.cc:1403] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.289s	user 0.019s	sys 0.044s
I20260709 13:00:53.787461  7669 raft_consensus.cc:2468] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:53.780622  7865 tablet_bootstrap.cc:654] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:53.793736  7780 consensus_peers.cc:597] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:53.794713  7873 consensus_queue.cc:1048] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.799887  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 3c78d34c2d104e6596872bdbc02005b7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:53.801437  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c78d34c2d104e6596872bdbc02005b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.807035  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 3c78d34c2d104e6596872bdbc02005b7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:53.809060  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c78d34c2d104e6596872bdbc02005b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.812232  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 0d97da3f424447f9987d7c6ab8d99c80 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:53.813184  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4dcf12326349beb860a3547c340348 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:53.813901  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d97da3f424447f9987d7c6ab8d99c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.814538  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4dcf12326349beb860a3547c340348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.812232  7654 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4dcf12326349beb860a3547c340348 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:53.814531  7801 tablet_service.cc:1511] Processing CreateTablet for tablet 3c78d34c2d104e6596872bdbc02005b7 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:53.817834  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c78d34c2d104e6596872bdbc02005b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.815858  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4dcf12326349beb860a3547c340348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.804543  7491 catalog_manager.cc:5697] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 0 to 1, leader changed from <none> to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.823315  7578 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4dcf12326349beb860a3547c340348 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:53.828250  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4dcf12326349beb860a3547c340348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.829453  7869 ts_tablet_manager.cc:1434] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.154s	user 0.017s	sys 0.005s
I20260709 13:00:53.830632  7869 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:53.839067  7869 tablet_bootstrap.cc:654] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.848796  7873 consensus_queue.cc:1048] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.881970  7862 raft_consensus.cc:359] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.883483  7862 raft_consensus.cc:385] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.883857  7862 raft_consensus.cc:740] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.858331  7944 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.886610  7944 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.888693  7944 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:53.891873  7578 tablet_service.cc:1511] Processing CreateTablet for tablet 0d97da3f424447f9987d7c6ab8d99c80 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:53.899030  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d97da3f424447f9987d7c6ab8d99c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.914477  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:53.915210  7742 raft_consensus.cc:2468] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:53.916469  7869 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:53.916993  7869 ts_tablet_manager.cc:1403] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.012s
I20260709 13:00:53.917309  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:53.920034  7869 raft_consensus.cc:359] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.919721  7491 catalog_manager.cc:5697] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.922240  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc7723aa6994ac4a65710463c633f66 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:53.922722  7864 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:53.923291  7864 ts_tablet_manager.cc:1403] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.240s	user 0.014s	sys 0.032s
I20260709 13:00:53.923476  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc7723aa6994ac4a65710463c633f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.924896  7557 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
W20260709 13:00:53.925871  7557 leader_election.cc:343] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.926481  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc7723aa6994ac4a65710463c633f66 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:53.927059  7873 consensus_queue.cc:1048] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.928525  7864 raft_consensus.cc:359] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:53.884693  7862 consensus_queue.cc:260] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.929462  7881 raft_consensus.cc:2804] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.930361  7584 tablet_service.cc:1511] Processing CreateTablet for tablet fd3528a166624614b3565fd49a48c9d2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:53.920823  7869 raft_consensus.cc:385] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.929003  7865 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:53.931486  7865 ts_tablet_manager.cc:1403] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.283s	user 0.015s	sys 0.008s
I20260709 13:00:53.931726  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3528a166624614b3565fd49a48c9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.934650  7865 raft_consensus.cc:359] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.935456  7865 raft_consensus.cc:385] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.935807  7865 raft_consensus.cc:740] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.936609  7865 consensus_queue.cc:260] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.937143  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc7723aa6994ac4a65710463c633f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.944706  7864 raft_consensus.cc:385] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.920253  7801 tablet_service.cc:1511] Processing CreateTablet for tablet fd3528a166624614b3565fd49a48c9d2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:53.946307  7801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3528a166624614b3565fd49a48c9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.946594  7869 raft_consensus.cc:740] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.946650  7911 raft_consensus.cc:493] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.949002  7816 raft_consensus.cc:3060] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.945300  7864 raft_consensus.cc:740] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.949618  7865 ts_tablet_manager.cc:1434] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:00:53.950512  7654 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc7723aa6994ac4a65710463c633f66 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:53.951009  7580 tablet_service.cc:1511] Processing CreateTablet for tablet b712db90ef70445e9ba1d2b20e0ab685 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:53.931777  7862 ts_tablet_manager.cc:1434] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.133s	user 0.005s	sys 0.001s
I20260709 13:00:53.961993  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b712db90ef70445e9ba1d2b20e0ab685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.961936  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 0d97da3f424447f9987d7c6ab8d99c80 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:53.963140  7726 tablet_service.cc:1511] Processing CreateTablet for tablet fd3528a166624614b3565fd49a48c9d2 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:53.964274  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3528a166624614b3565fd49a48c9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.965683  7862 tablet_bootstrap.cc:492] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:53.960886  7911 raft_consensus.cc:515] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:53.966524  7864 consensus_queue.cc:260] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:53.930399  7881 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.968328  7881 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.970468  7865 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:53.973882  7900 raft_consensus.cc:493] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.974530  7900 raft_consensus.cc:515] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.976967  7900 leader_election.cc:290] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:53.982210  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc7723aa6994ac4a65710463c633f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.984439  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d97da3f424447f9987d7c6ab8d99c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.985780  7869 consensus_queue.cc:260] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:53.988101  7869 ts_tablet_manager.cc:1434] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.071s	user 0.003s	sys 0.004s
I20260709 13:00:53.989094  7869 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:53.992105  7653 tablet_service.cc:1511] Processing CreateTablet for tablet b712db90ef70445e9ba1d2b20e0ab685 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:53.992444  7911 leader_election.cc:290] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:53.992287  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:53.994817  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:00:53.996518  7632 leader_election.cc:343] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:53.996693  7707 leader_election.cc:343] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.995221  7864 ts_tablet_manager.cc:1434] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.072s	user 0.000s	sys 0.008s
I20260709 13:00:53.998431  7864 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:54.000936  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.004928  7862 tablet_bootstrap.cc:654] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:54.006253  7634 leader_election.cc:343] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.006767  7634 leader_election.cc:304] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:54.007722  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.007911  7900 raft_consensus.cc:2749] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.014743  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b712db90ef70445e9ba1d2b20e0ab685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:54.015910  7727 tablet_service.cc:1511] Processing CreateTablet for tablet b712db90ef70445e9ba1d2b20e0ab685 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:00:54.019388  7706 leader_election.cc:343] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.019979  7706 leader_election.cc:304] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:54.020598  7655 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb46fd098ba461a871adb4c40c79e93 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:54.021546  7894 raft_consensus.cc:2749] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.022065  7655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb46fd098ba461a871adb4c40c79e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:54.017396  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b712db90ef70445e9ba1d2b20e0ab685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:54.035066  7584 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb46fd098ba461a871adb4c40c79e93 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:54.036509  7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb46fd098ba461a871adb4c40c79e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:54.043215  7804 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb46fd098ba461a871adb4c40c79e93 (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:54.044518  7804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb46fd098ba461a871adb4c40c79e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:54.046018  7900 consensus_queue.cc:1048] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.049015  7806 tablet_service.cc:1511] Processing CreateTablet for tablet de9b9a02932b4dad97d864deeac40bdb (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:54.049854  7869 tablet_bootstrap.cc:654] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.050117  7578 tablet_service.cc:1511] Processing CreateTablet for tablet de9b9a02932b4dad97d864deeac40bdb (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:54.050515  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9b9a02932b4dad97d864deeac40bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:54.051457  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9b9a02932b4dad97d864deeac40bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:54.056218  7865 tablet_bootstrap.cc:654] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.087108  7593 raft_consensus.cc:3060] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.094767  7881 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.097111  7881 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:54.098021  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:54.099308  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:54.099912  7743 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.107807  7900 raft_consensus.cc:493] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.122512  7864 tablet_bootstrap.cc:654] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.125815  7731 tablet_service.cc:1511] Processing CreateTablet for tablet de9b9a02932b4dad97d864deeac40bdb (DEFAULT_TABLE table=test-workload [id=33c9378881104ce6b4dfc7a5fbf5edb3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:54.127079  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9b9a02932b4dad97d864deeac40bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:54.128351  7862 tablet_bootstrap.cc:492] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:54.128839  7862 ts_tablet_manager.cc:1403] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.005s
I20260709 13:00:54.127028  7900 raft_consensus.cc:515] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.130632  7911 consensus_queue.cc:1048] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.132272  7900 leader_election.cc:290] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:00:54.115243  7557 leader_election.cc:343] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.134780  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a36b4572f0444dafd0d51bfc100984" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.135411  7592 raft_consensus.cc:2468] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:54.137431  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a36b4572f0444dafd0d51bfc100984" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:00:54.139389  7633 leader_election.cc:343] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.140961  7634 leader_election.cc:304] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7
I20260709 13:00:54.142086  7900 raft_consensus.cc:2804] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.142454  7900 raft_consensus.cc:493] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:54.142490  7634 consensus_peers.cc:597] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.142884  7900 raft_consensus.cc:3060] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.143541  7862 raft_consensus.cc:359] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.144197  7862 raft_consensus.cc:385] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.144490  7862 raft_consensus.cc:740] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.155892  7862 consensus_queue.cc:260] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.160495  7743 raft_consensus.cc:2468] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:54.164601  7862 ts_tablet_manager.cc:1434] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:00:54.166311  7862 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:54.172465  7557 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:54.173722  7881 raft_consensus.cc:2804] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.174213  7881 raft_consensus.cc:697] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:54.175066  7881 consensus_queue.cc:237] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.180194  7927 raft_consensus.cc:493] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.180799  7927 raft_consensus.cc:515] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.185539  7927 leader_election.cc:290] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:54.185936  7869 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:54.186699  7869 ts_tablet_manager.cc:1403] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.198s	user 0.025s	sys 0.022s
I20260709 13:00:54.189781  7869 raft_consensus.cc:359] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.190477  7869 raft_consensus.cc:385] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.192083  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7816c9f7b54ed198fce1d42596e0f2" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.190748  7869 raft_consensus.cc:740] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.196849  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7816c9f7b54ed198fce1d42596e0f2" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.196936  7869 consensus_queue.cc:260] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.197009  7900 raft_consensus.cc:515] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.199417  7869 ts_tablet_manager.cc:1434] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
W20260709 13:00:54.200145  7782 leader_election.cc:343] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:54.202696  7780 leader_election.cc:343] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.203204  7780 leader_election.cc:304] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:54.203457  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a36b4572f0444dafd0d51bfc100984" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:54.203529  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a36b4572f0444dafd0d51bfc100984" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:54.204075  7594 raft_consensus.cc:3060] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.206233  7869 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:54.205462  7920 raft_consensus.cc:2749] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.212586  7936 consensus_queue.cc:1048] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.214779  7869 tablet_bootstrap.cc:654] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.215587  7594 raft_consensus.cc:2468] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:54.203027  7900 leader_election.cc:290] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:54.226926  7634 leader_election.cc:304] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:54.229159  7865 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:54.229794  7865 ts_tablet_manager.cc:1403] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.260s	user 0.020s	sys 0.007s
I20260709 13:00:54.237232  7865 raft_consensus.cc:359] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.237895  7865 raft_consensus.cc:385] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:54.236905  7633 leader_election.cc:343] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.242105  7964 raft_consensus.cc:2804] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.240249  7865 raft_consensus.cc:740] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.250635  7864 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:54.251276  7864 ts_tablet_manager.cc:1403] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.253s	user 0.014s	sys 0.009s
I20260709 13:00:54.253808  7862 tablet_bootstrap.cc:654] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.254411  7864 raft_consensus.cc:359] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.256546  7864 raft_consensus.cc:385] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.256815  7864 raft_consensus.cc:740] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.257457  7865 consensus_queue.cc:260] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.260108  7964 raft_consensus.cc:697] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:54.262508  7865 ts_tablet_manager.cc:1434] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:00:54.262084  7964 consensus_queue.cc:237] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.264041  7865 tablet_bootstrap.cc:492] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:54.242308  7881 consensus_queue.cc:1048] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:00:54.266050  7864 consensus_queue.cc:260] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.270571  7869 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:54.271112  7869 ts_tablet_manager.cc:1403] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.006s
I20260709 13:00:54.272395  7944 raft_consensus.cc:493] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.272946  7944 raft_consensus.cc:515] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.275040  7492 catalog_manager.cc:5697] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.277834  7944 leader_election.cc:290] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:54.285262  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
W20260709 13:00:54.287053  7557 leader_election.cc:343] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.287226  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.287952  7669 raft_consensus.cc:2468] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:54.289417  7557 leader_election.cc:304] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: b81c129769e24f019dc9045ce8c09771
I20260709 13:00:54.290688  7944 raft_consensus.cc:2804] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.291085  7944 raft_consensus.cc:493] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.291461  7944 raft_consensus.cc:3060] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:54.294786  7557 consensus_peers.cc:597] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.294950  7864 ts_tablet_manager.cc:1434] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:00:54.296006  7864 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:54.302799  7864 tablet_bootstrap.cc:654] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.302799  7865 tablet_bootstrap.cc:654] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.303454  7869 raft_consensus.cc:359] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.304454  7869 raft_consensus.cc:385] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.304802  7869 raft_consensus.cc:740] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.306298  7869 consensus_queue.cc:260] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.309195  7869 ts_tablet_manager.cc:1434] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:00:54.305646  7944 raft_consensus.cc:515] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.310531  7869 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:54.314566  7944 leader_election.cc:290] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:54.316144  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:54.316807  7669 raft_consensus.cc:3060] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.318106  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
W20260709 13:00:54.319619  7557 leader_election.cc:343] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.328905  7864 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:54.329457  7864 ts_tablet_manager.cc:1403] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.002s
I20260709 13:00:54.332672  7869 tablet_bootstrap.cc:654] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.329864  7669 raft_consensus.cc:2468] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:54.340339  7557 leader_election.cc:304] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: b81c129769e24f019dc9045ce8c09771
I20260709 13:00:54.341545  7971 raft_consensus.cc:2804] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.342376  7971 raft_consensus.cc:697] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:54.343389  7864 raft_consensus.cc:359] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.343222  7971 consensus_queue.cc:237] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.344092  7864 raft_consensus.cc:385] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.344395  7864 raft_consensus.cc:740] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.345062  7864 consensus_queue.cc:260] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.346230  7870 raft_consensus.cc:493] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.346796  7870 raft_consensus.cc:515] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.347627  7864 ts_tablet_manager.cc:1434] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:00:54.349944  7864 tablet_bootstrap.cc:492] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:54.350703  7862 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:54.351284  7862 ts_tablet_manager.cc:1403] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.185s	user 0.014s	sys 0.005s
I20260709 13:00:54.354723  7862 raft_consensus.cc:359] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.355446  7862 raft_consensus.cc:385] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.355706  7862 raft_consensus.cc:740] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.356832  7870 leader_election.cc:290] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:54.357777  7864 tablet_bootstrap.cc:654] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.352173  7491 catalog_manager.cc:5697] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.359632  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.360432  7862 consensus_queue.cc:260] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.364521  7862 ts_tablet_manager.cc:1434] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:00:54.366940  7865 tablet_bootstrap.cc:492] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:54.367621  7865 ts_tablet_manager.cc:1403] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.008s
I20260709 13:00:54.366952  7862 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:54.370371  7865 raft_consensus.cc:359] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.371075  7865 raft_consensus.cc:385] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.372337  7865 raft_consensus.cc:740] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.360424  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:54.373245  7865 consensus_queue.cc:260] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.375881  7865 ts_tablet_manager.cc:1434] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:54.377010  7865 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:54.380314  7707 leader_election.cc:304] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:54.381934  7870 raft_consensus.cc:2749] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.383697  7865 tablet_bootstrap.cc:654] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.400348  7489 catalog_manager.cc:5697] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.412246  7864 tablet_bootstrap.cc:492] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:54.413029  7864 ts_tablet_manager.cc:1403] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.040s
I20260709 13:00:54.415208  7862 tablet_bootstrap.cc:654] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.421532  7869 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:54.421036  7864 raft_consensus.cc:359] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.422542  7869 ts_tablet_manager.cc:1403] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.003s
I20260709 13:00:54.422803  7864 raft_consensus.cc:385] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.423264  7864 raft_consensus.cc:740] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.424158  7864 consensus_queue.cc:260] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.425220  7869 raft_consensus.cc:359] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.426067  7869 raft_consensus.cc:385] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.426368  7869 raft_consensus.cc:740] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.427958  7869 consensus_queue.cc:260] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.430583  7869 ts_tablet_manager.cc:1434] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:00:54.431636  7869 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:54.438405  7864 ts_tablet_manager.cc:1434] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:00:54.439460  7862 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:54.439846  7864 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:54.440006  7862 ts_tablet_manager.cc:1403] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.000s
I20260709 13:00:54.445042  7862 raft_consensus.cc:359] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.445894  7862 raft_consensus.cc:385] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.446185  7862 raft_consensus.cc:740] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.446915  7862 consensus_queue.cc:260] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.448916  7862 ts_tablet_manager.cc:1434] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:00:54.449046  7864 tablet_bootstrap.cc:654] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.450825  7862 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:54.453874  7865 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:54.454396  7865 ts_tablet_manager.cc:1403] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.078s	user 0.036s	sys 0.035s
I20260709 13:00:54.455912  7869 tablet_bootstrap.cc:654] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.460392  7865 raft_consensus.cc:359] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.461428  7862 tablet_bootstrap.cc:654] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.461192  7865 raft_consensus.cc:385] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.462441  7865 raft_consensus.cc:740] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.464094  7865 consensus_queue.cc:260] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.466204  7865 ts_tablet_manager.cc:1434] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:00:54.467252  7865 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:54.470721  7869 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:54.470914  7864 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:54.471253  7869 ts_tablet_manager.cc:1403] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:00:54.471326  7864 ts_tablet_manager.cc:1403] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 13:00:54.473140  7865 tablet_bootstrap.cc:654] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.474434  7864 raft_consensus.cc:359] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.474998  7864 raft_consensus.cc:385] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.475248  7864 raft_consensus.cc:740] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.475843  7864 consensus_queue.cc:260] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.477789  7864 ts_tablet_manager.cc:1434] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:54.478698  7864 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:54.484586  7864 tablet_bootstrap.cc:654] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.486320  7869 raft_consensus.cc:359] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.487214  7869 raft_consensus.cc:385] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.487510  7869 raft_consensus.cc:740] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.488255  7869 consensus_queue.cc:260] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.489132  7865 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:54.489696  7865 ts_tablet_manager.cc:1403] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 13:00:54.490698  7869 ts_tablet_manager.cc:1434] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:00:54.492368  7865 raft_consensus.cc:359] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.493067  7865 raft_consensus.cc:385] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.493324  7865 raft_consensus.cc:740] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.493670  7869 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:54.494369  7865 consensus_queue.cc:260] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.500064  7865 ts_tablet_manager.cc:1434] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:54.501109  7865 tablet_bootstrap.cc:492] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:54.502177  7869 tablet_bootstrap.cc:654] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.502912  7862 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:54.503506  7862 ts_tablet_manager.cc:1403] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.003s
I20260709 13:00:54.506884  7862 raft_consensus.cc:359] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.507933  7862 raft_consensus.cc:385] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.508468  7862 raft_consensus.cc:740] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.509578  7862 consensus_queue.cc:260] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.511705  7865 tablet_bootstrap.cc:654] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.513243  7862 ts_tablet_manager.cc:1434] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:00:54.515102  7862 tablet_bootstrap.cc:492] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:54.519248  7864 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:54.519848  7864 ts_tablet_manager.cc:1403] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.011s
I20260709 13:00:54.519953  7862 tablet_bootstrap.cc:654] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.524679  7865 tablet_bootstrap.cc:492] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:54.525223  7865 ts_tablet_manager.cc:1403] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.010s
I20260709 13:00:54.527151  7869 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:54.527946  7869 ts_tablet_manager.cc:1403] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 13:00:54.527987  7865 raft_consensus.cc:359] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.523046  7864 raft_consensus.cc:359] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.530675  7865 raft_consensus.cc:385] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.530709  7864 raft_consensus.cc:385] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.531127  7865 raft_consensus.cc:740] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.534747  7864 raft_consensus.cc:740] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.535283  7865 consensus_queue.cc:260] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.537153  7869 raft_consensus.cc:359] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.537756  7865 ts_tablet_manager.cc:1434] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:00:54.535694  7864 consensus_queue.cc:260] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.538044  7869 raft_consensus.cc:385] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.538465  7869 raft_consensus.cc:740] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.540254  7869 consensus_queue.cc:260] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.539402  7864 ts_tablet_manager.cc:1434] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:00:54.541424  7862 tablet_bootstrap.cc:492] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:54.541950  7862 ts_tablet_manager.cc:1403] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.010s
I20260709 13:00:54.542073  7864 tablet_bootstrap.cc:492] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:54.544814  7862 raft_consensus.cc:359] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.545523  7862 raft_consensus.cc:385] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.545811  7862 raft_consensus.cc:740] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.546546  7862 consensus_queue.cc:260] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.548604  7862 ts_tablet_manager.cc:1434] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:54.548728  7864 tablet_bootstrap.cc:654] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.539418  7865 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:54.549604  7862 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:54.555717  7865 tablet_bootstrap.cc:654] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.556052  7862 tablet_bootstrap.cc:654] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.559182  7869 ts_tablet_manager.cc:1434] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:00:54.560753  7869 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:54.565572  7971 raft_consensus.cc:493] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.566445  7870 raft_consensus.cc:493] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.566304  7971 raft_consensus.cc:515] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.566931  7870 raft_consensus.cc:515] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.568456  7971 leader_election.cc:290] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:54.568926  7870 leader_election.cc:290] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:54.570739  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40895010d1874feea26e2f762ab3a77f" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:54.571645  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40895010d1874feea26e2f762ab3a77f" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:00:54.572243  7707 leader_election.cc:343] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.572845  7869 tablet_bootstrap.cc:654] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.572284  7669 raft_consensus.cc:2468] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
I20260709 13:00:54.576589  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.579301  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:54.579995  7971 raft_consensus.cc:493] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.579349  7706 leader_election.cc:304] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7
I20260709 13:00:54.580616  7971 raft_consensus.cc:515] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.581084  7911 raft_consensus.cc:2804] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.581756  7911 raft_consensus.cc:493] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.582238  7911 raft_consensus.cc:3060] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.583508  7971 leader_election.cc:290] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:54.584255  7865 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:54.584167  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:54.584802  7865 ts_tablet_manager.cc:1403] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.004s
I20260709 13:00:54.584899  7816 raft_consensus.cc:2468] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:54.586315  7558 leader_election.cc:304] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:54.587093  7971 raft_consensus.cc:2804] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.587568  7971 raft_consensus.cc:493] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.588231  7971 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.589741  7557 leader_election.cc:304] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:54.591761  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.587484  7593 raft_consensus.cc:3060] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.599499  7865 raft_consensus.cc:359] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.600467  7865 raft_consensus.cc:385] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.600811  7865 raft_consensus.cc:740] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.608376  7864 tablet_bootstrap.cc:492] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:54.609005  7864 ts_tablet_manager.cc:1403] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.024s
I20260709 13:00:54.609176  7862 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:54.609640  7869 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:54.609711  7862 ts_tablet_manager.cc:1403] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.060s	user 0.030s	sys 0.025s
I20260709 13:00:54.610292  7869 ts_tablet_manager.cc:1403] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.004s
I20260709 13:00:54.612211  7864 raft_consensus.cc:359] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.613011  7864 raft_consensus.cc:385] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.612769  7862 raft_consensus.cc:359] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.613071  7869 raft_consensus.cc:359] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.613531  7864 raft_consensus.cc:740] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.613664  7862 raft_consensus.cc:385] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.613857  7869 raft_consensus.cc:385] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.614161  7862 raft_consensus.cc:740] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.614251  7869 raft_consensus.cc:740] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
W20260709 13:00:54.614711  7557 leader_election.cc:343] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.614733  7864 consensus_queue.cc:260] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.615705  7870 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.616300  7870 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.618510  7870 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:54.614990  7862 consensus_queue.cc:260] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.620548  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:54.620374  7971 raft_consensus.cc:515] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.621940  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.622525  7971 leader_election.cc:290] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:54.622648  7862 ts_tablet_manager.cc:1434] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:54.615147  7869 consensus_queue.cc:260] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.623695  7862 tablet_bootstrap.cc:492] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:54.625207  7869 ts_tablet_manager.cc:1434] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:00:54.626186  7869 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:54.626935  7708 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:54.627756  7870 raft_consensus.cc:2749] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.628293  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:54.628614  7743 raft_consensus.cc:3060] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.632597  7862 tablet_bootstrap.cc:654] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.632895  7869 tablet_bootstrap.cc:654] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.634228  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:54.635047  7816 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.637527  7971 raft_consensus.cc:493] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.638201  7971 raft_consensus.cc:515] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.641777  7971 leader_election.cc:290] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:54.643571  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5331e5203b4e18bef7bbf5215bfcd2" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:54.645771  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5331e5203b4e18bef7bbf5215bfcd2" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
W20260709 13:00:54.647274  7557 leader_election.cc:343] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:54.648842  7558 leader_election.cc:343] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.649343  7558 leader_election.cc:304] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:54.651472  7869 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:54.652005  7869 ts_tablet_manager.cc:1403] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.016s
I20260709 13:00:54.652554  7964 raft_consensus.cc:493] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.653182  7816 raft_consensus.cc:2468] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:54.653070  7964 raft_consensus.cc:515] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.654558  7920 raft_consensus.cc:493] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.655062  7862 tablet_bootstrap.cc:492] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:54.655357  7964 leader_election.cc:290] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:54.656136  7862 ts_tablet_manager.cc:1403] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260709 13:00:54.656795  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7816c9f7b54ed198fce1d42596e0f2" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:54.657459  7815 raft_consensus.cc:2468] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:54.658834  7633 leader_election.cc:304] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:00:54.658923  7862 raft_consensus.cc:359] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.659545  7964 raft_consensus.cc:2804] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.659638  7862 raft_consensus.cc:385] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.660018  7964 raft_consensus.cc:493] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.655073  7920 raft_consensus.cc:515] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.660193  7862 raft_consensus.cc:740] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.660458  7964 raft_consensus.cc:3060] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.661182  7971 raft_consensus.cc:2749] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:54.668437  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:54.660955  7862 consensus_queue.cc:260] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.661792  7944 raft_consensus.cc:493] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.662220  7920 leader_election.cc:290] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:54.615427  7865 consensus_queue.cc:260] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.663362  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.670420  7669 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.670123  7944 raft_consensus.cc:515] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
W20260709 13:00:54.671427  7782 leader_election.cc:343] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.672966  7944 leader_election.cc:290] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:54.674510  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:54.675109  7862 ts_tablet_manager.cc:1434] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:00:54.675233  7741 raft_consensus.cc:2468] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:54.664813  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:54.676231  7862 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:54.676437  7742 raft_consensus.cc:2468] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:54.676914  7964 raft_consensus.cc:515] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.678066  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.678787  7667 raft_consensus.cc:2468] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:54.665613  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7816c9f7b54ed198fce1d42596e0f2" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.665860  7864 ts_tablet_manager.cc:1434] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.003s
I20260709 13:00:54.661851  7558 leader_election.cc:304] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:54.663545  7869 raft_consensus.cc:359] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.678172  7669 raft_consensus.cc:2468] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:54.679742  7594 raft_consensus.cc:2468] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:54.664655  7911 raft_consensus.cc:515] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.679086  7964 leader_election.cc:290] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:54.680001  7869 raft_consensus.cc:385] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.683100  7869 raft_consensus.cc:740] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.683966  7864 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:54.683856  7869 consensus_queue.cc:260] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.680254  7944 raft_consensus.cc:2804] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.686085  7944 raft_consensus.cc:697] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:54.686955  7944 consensus_queue.cc:237] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.688071  7865 ts_tablet_manager.cc:1434] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.005s
I20260709 13:00:54.689155  7865 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:54.690668  7869 ts_tablet_manager.cc:1434] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 13:00:54.691804  7869 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:54.692253  7911 leader_election.cc:290] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:54.692328  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40895010d1874feea26e2f762ab3a77f" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:54.693255  7816 raft_consensus.cc:3060] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.694130  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40895010d1874feea26e2f762ab3a77f" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:54.694777  7667 raft_consensus.cc:3060] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.693147  7864 tablet_bootstrap.cc:654] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.698602  7869 tablet_bootstrap.cc:654] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.697414  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7816c9f7b54ed198fce1d42596e0f2" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:54.681293  7557 leader_election.cc:304] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:54.702625  7971 raft_consensus.cc:2804] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.703174  7971 raft_consensus.cc:493] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.703608  7971 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.704157  7780 leader_election.cc:304] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:54.705016  7920 raft_consensus.cc:2804] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.705399  7920 raft_consensus.cc:493] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.705817  7920 raft_consensus.cc:3060] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.705946  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7816c9f7b54ed198fce1d42596e0f2" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:54.706620  7594 raft_consensus.cc:3060] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.708742  7815 raft_consensus.cc:3060] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.712594  7971 raft_consensus.cc:515] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.713423  7920 raft_consensus.cc:515] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.748346  7944 consensus_queue.cc:1048] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:54.753978  7862 tablet_bootstrap.cc:654] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.757866  7881 raft_consensus.cc:2749] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.763772  7997 raft_consensus.cc:493] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.764442  7997 raft_consensus.cc:515] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.779330  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:54.780066  7741 raft_consensus.cc:3060] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.786722  7815 raft_consensus.cc:2468] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:54.788102  7971 leader_election.cc:290] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:54.792375  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
W20260709 13:00:54.794107  7782 leader_election.cc:343] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.791318  7741 raft_consensus.cc:2468] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:54.795030  7865 tablet_bootstrap.cc:654] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.776836  7920 leader_election.cc:290] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:54.801704  7816 raft_consensus.cc:2468] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:54.804666  7633 leader_election.cc:304] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:00:54.805745  7594 raft_consensus.cc:2468] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:54.806444  7963 raft_consensus.cc:2804] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.807094  7963 raft_consensus.cc:697] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:54.807142  7707 leader_election.cc:304] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:54.808068  7963 consensus_queue.cc:237] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.808974  7780 leader_election.cc:304] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:54.810496  8000 raft_consensus.cc:2804] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.811107  8000 raft_consensus.cc:697] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:54.811139  7894 raft_consensus.cc:493] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.811762  7894 raft_consensus.cc:515] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.812101  8000 consensus_queue.cc:237] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.802116  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a36b4572f0444dafd0d51bfc100984" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.822230  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:54.823016  7668 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.824019  7666 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.803889  7920 raft_consensus.cc:493] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.830339  7741 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.832427  7593 raft_consensus.cc:2393] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:00:54.813812  7911 raft_consensus.cc:2804] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.821168  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.834609  7900 raft_consensus.cc:493] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.845826  7900 raft_consensus.cc:515] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.837631  7998 raft_consensus.cc:493] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.856465  7668 raft_consensus.cc:2468] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:54.855465  7900 leader_election.cc:290] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:54.837538  7911 raft_consensus.cc:697] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:00:54.856840  7998 raft_consensus.cc:515] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.843323  7920 raft_consensus.cc:515] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.858472  7911 consensus_queue.cc:237] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:54.860136  7920 leader_election.cc:290] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:54.834365  7997 leader_election.cc:290] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:54.853451  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:54.860492  7998 leader_election.cc:290] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:54.860360  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:54.861965  7594 raft_consensus.cc:2468] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:54.852476  7894 leader_election.cc:290] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:54.863210  7743 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.872531  7971 consensus_queue.cc:1048] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.870431  7782 leader_election.cc:304] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:54.872766  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:54.874989  7742 raft_consensus.cc:2468] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:54.874923  7881 consensus_queue.cc:1048] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.876601  7632 leader_election.cc:304] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:54.874943  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.877489  7963 raft_consensus.cc:2804] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.880388  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a36b4572f0444dafd0d51bfc100984" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.886955  7666 raft_consensus.cc:2393] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81c129769e24f019dc9045ce8c09771 in current term 1: Already voted for candidate 80af46fc024041de81a638d29912c8a3 in this term.
I20260709 13:00:54.890407  7557 leader_election.cc:304] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:54.891284  7971 raft_consensus.cc:2804] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.891781  7971 raft_consensus.cc:697] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:54.892652  7971 consensus_queue.cc:237] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.893878  8003 raft_consensus.cc:2804] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.894393  8003 raft_consensus.cc:493] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.894743  8003 raft_consensus.cc:3060] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.894894  7706 leader_election.cc:304] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:54.904392  7492 catalog_manager.cc:5697] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.914810  7900 consensus_queue.cc:1048] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.918304  7864 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:54.919040  7864 ts_tablet_manager.cc:1403] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.235s	user 0.016s	sys 0.000s
I20260709 13:00:54.896137  7963 raft_consensus.cc:493] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.902392  7894 raft_consensus.cc:3060] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.901839  7743 raft_consensus.cc:2468] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:54.926479  7667 raft_consensus.cc:2468] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:54.926829  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:54.927704  7743 raft_consensus.cc:2468] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:54.928817  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.921948  7963 raft_consensus.cc:3060] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.934171  7862 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:54.934839  7862 ts_tablet_manager.cc:1403] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.259s	user 0.019s	sys 0.011s
I20260709 13:00:54.936453  7864 raft_consensus.cc:359] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.937341  7864 raft_consensus.cc:385] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.937628  7864 raft_consensus.cc:740] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.938416  7864 consensus_queue.cc:260] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.942078  7864 ts_tablet_manager.cc:1434] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:00:54.943095  7864 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:54.943718  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:54.944525  7816 raft_consensus.cc:2468] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:54.944644  7780 leader_election.cc:304] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:54.945813  7815 raft_consensus.cc:3060] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.946915  7920 raft_consensus.cc:2804] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.947366  7920 raft_consensus.cc:493] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.947844  7920 raft_consensus.cc:3060] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.947571  7490 catalog_manager.cc:5697] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.949518  7894 raft_consensus.cc:2749] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.951429  7780 leader_election.cc:304] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:54.952319  7869 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:54.952862  7869 ts_tablet_manager.cc:1403] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.261s	user 0.015s	sys 0.010s
I20260709 13:00:54.957617  7996 consensus_queue.cc:1048] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.975507  7869 raft_consensus.cc:359] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.976675  7869 raft_consensus.cc:385] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.978422  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:54.977165  7869 raft_consensus.cc:740] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.985050  7869 consensus_queue.cc:260] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:54.988863  7865 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:54.989418  7865 ts_tablet_manager.cc:1403] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.300s	user 0.015s	sys 0.046s
I20260709 13:00:54.993175  7964 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:00:54.979043  7488 catalog_manager.cc:5697] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 0 to 1, leader changed from <none> to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.993499  8003 raft_consensus.cc:515] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:54.995855  7869 ts_tablet_manager.cc:1434] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:00:54.995383  7964 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:54.999570  7996 raft_consensus.cc:493] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.002444  7489 catalog_manager.cc:5697] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.005722  7862 raft_consensus.cc:359] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.012979  7865 raft_consensus.cc:359] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.018621  7862 raft_consensus.cc:385] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.019522  7862 raft_consensus.cc:740] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.018826  7865 raft_consensus.cc:385] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.021785  7865 raft_consensus.cc:740] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.016832  7964 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:55.020673  7862 consensus_queue.cc:260] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.013499  7996 raft_consensus.cc:515] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.015497  7869 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:55.018569  7864 tablet_bootstrap.cc:654] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.025909  7862 ts_tablet_manager.cc:1434] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.000s
I20260709 13:00:55.026126  7865 consensus_queue.cc:260] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.030014  7862 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:55.036373  7865 ts_tablet_manager.cc:1434] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:00:55.037242  7865 tablet_bootstrap.cc:492] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:55.041831  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:55.041875  7963 raft_consensus.cc:515] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.043663  7666 raft_consensus.cc:2393] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:00:55.046309  7862 tablet_bootstrap.cc:654] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.047075  7963 leader_election.cc:290] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:55.048084  7865 tablet_bootstrap.cc:654] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.056478  7996 leader_election.cc:290] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
W20260709 13:00:55.038770  7780 leader_election.cc:343] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.060998  7920 raft_consensus.cc:515] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.066629  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:55.068583  7920 leader_election.cc:290] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:55.070366  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:55.070524  7998 raft_consensus.cc:2749] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.071271  7743 raft_consensus.cc:2393] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:00:55.072937  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:55.073634  7740 raft_consensus.cc:3060] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.074832  7632 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:55.077407  8003 leader_election.cc:290] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:55.078128  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:55.080137  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:55.080574  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:55.095531  7865 tablet_bootstrap.cc:492] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:55.096501  7865 ts_tablet_manager.cc:1403] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.004s
I20260709 13:00:55.097380  7900 raft_consensus.cc:493] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.098063  7900 raft_consensus.cc:515] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.099969  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:55.100833  7593 raft_consensus.cc:3060] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.101509  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:55.102104  7900 leader_election.cc:290] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:55.110904  7666 raft_consensus.cc:2393] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
W20260709 13:00:55.111193  8013 log.cc:927] Time spent T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:00:55.106909  7963 raft_consensus.cc:2749] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:55.114279  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:55.115391  7816 raft_consensus.cc:2393] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 1: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:00:55.116195  8003 raft_consensus.cc:493] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.116683  8003 raft_consensus.cc:515] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.118786  8003 leader_election.cc:290] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:55.118861  7558 leader_election.cc:304] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:55.113195  7740 raft_consensus.cc:2468] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.122816  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5331e5203b4e18bef7bbf5215bfcd2" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:55.123091  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5331e5203b4e18bef7bbf5215bfcd2" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:55.123531  7742 raft_consensus.cc:2468] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:55.123694  7592 raft_consensus.cc:2468] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:55.124594  7971 raft_consensus.cc:3060] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.127331  7911 raft_consensus.cc:493] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.131074  7780 leader_election.cc:304] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:55.138967  7593 raft_consensus.cc:2468] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.140725  7782 leader_election.cc:304] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:55.135011  7633 leader_election.cc:304] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:55.141752  8003 raft_consensus.cc:2804] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.135955  7862 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:55.142035  8000 raft_consensus.cc:2804] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.141129  7780 leader_election.cc:304] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:55.142645  7862 ts_tablet_manager.cc:1403] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.002s
I20260709 13:00:55.142784  8000 raft_consensus.cc:697] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:55.143175  7997 raft_consensus.cc:2804] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.143705  7997 raft_consensus.cc:697] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:55.142163  8003 raft_consensus.cc:493] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.128623  7963 consensus_queue.cc:1048] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:00:55.136957  7911 raft_consensus.cc:515] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.147162  7865 raft_consensus.cc:359] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.148150  7865 raft_consensus.cc:385] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.148507  7865 raft_consensus.cc:740] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.128777  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:55.152042  7865 consensus_queue.cc:260] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.157258  7862 raft_consensus.cc:359] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.158056  7862 raft_consensus.cc:385] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.158349  7862 raft_consensus.cc:740] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.146716  8003 raft_consensus.cc:3060] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.160240  7862 consensus_queue.cc:260] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.152745  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:55.164060  7862 ts_tablet_manager.cc:1434] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:00:55.166507  7862 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:55.144575  7997 consensus_queue.cc:237] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.168852  7668 raft_consensus.cc:3060] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.143873  8000 consensus_queue.cc:237] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.177047  7865 ts_tablet_manager.cc:1434] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:00:55.181870  7864 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:55.181939  7865 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:55.182631  7864 ts_tablet_manager.cc:1403] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.240s	user 0.014s	sys 0.005s
I20260709 13:00:55.184494  8024 raft_consensus.cc:2749] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.188155  7996 consensus_queue.cc:1048] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:00:55.207701  7864 raft_consensus.cc:359] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.208511  7864 raft_consensus.cc:385] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.208781  7864 raft_consensus.cc:740] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.211553  7911 leader_election.cc:290] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:55.211386  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc99687adf94edfbef9f24e9d43510b" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:55.210583  7864 consensus_queue.cc:260] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.215059  7864 ts_tablet_manager.cc:1434] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:00:55.216220  7864 tablet_bootstrap.cc:492] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:55.215576  7665 raft_consensus.cc:2468] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
I20260709 13:00:55.216476  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc99687adf94edfbef9f24e9d43510b" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:55.217648  7706 leader_election.cc:304] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
W20260709 13:00:55.218667  7707 leader_election.cc:343] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.219645  7911 raft_consensus.cc:2804] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.220084  7911 raft_consensus.cc:493] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.220463  7911 raft_consensus.cc:3060] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.223011  7865 tablet_bootstrap.cc:654] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.227065  7869 tablet_bootstrap.cc:654] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.227819  7864 tablet_bootstrap.cc:654] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.230049  7862 tablet_bootstrap.cc:654] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.242079  8024 consensus_queue.cc:1048] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.256477  7633 leader_election.cc:304] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:55.257851  7996 consensus_queue.cc:1048] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.273012  8003 raft_consensus.cc:515] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.278730  7865 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:55.279592  7865 ts_tablet_manager.cc:1403] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.000s
I20260709 13:00:55.301342  7864 tablet_bootstrap.cc:492] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:55.302106  7864 ts_tablet_manager.cc:1403] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.004s
I20260709 13:00:55.292140  7971 raft_consensus.cc:2749] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.311841  8003 leader_election.cc:290] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:55.295271  7911 raft_consensus.cc:515] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.313079  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5331e5203b4e18bef7bbf5215bfcd2" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:55.313763  7594 raft_consensus.cc:3060] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.315307  7911 leader_election.cc:290] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:55.317315  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc99687adf94edfbef9f24e9d43510b" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:55.321197  7869 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:55.321949  7869 ts_tablet_manager.cc:1403] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.313s	user 0.019s	sys 0.006s
I20260709 13:00:55.322800  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc99687adf94edfbef9f24e9d43510b" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:55.323458  7666 raft_consensus.cc:3060] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.328599  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5331e5203b4e18bef7bbf5215bfcd2" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:55.329321  7741 raft_consensus.cc:3060] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:55.328773  7707 leader_election.cc:343] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.333899  8024 consensus_queue.cc:1048] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.339910  7936 consensus_queue.cc:1048] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.340794  7741 raft_consensus.cc:2468] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.341320  7489 catalog_manager.cc:5697] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.342262  8000 consensus_queue.cc:1048] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.344736  7936 raft_consensus.cc:493] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.345361  7936 raft_consensus.cc:515] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.346836  7869 raft_consensus.cc:359] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.348101  7668 raft_consensus.cc:2468] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.348277  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:55.349927  7708 leader_election.cc:343] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.350590  7865 raft_consensus.cc:359] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.351353  7865 raft_consensus.cc:385] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.351624  7865 raft_consensus.cc:740] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.351854  8022 raft_consensus.cc:2749] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.352286  7865 consensus_queue.cc:260] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.354848  7780 leader_election.cc:304] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:55.355078  7864 raft_consensus.cc:359] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.355793  7864 raft_consensus.cc:385] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.343541  7489 catalog_manager.cc:5697] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:55.355831  8000 raft_consensus.cc:2804] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.357100  8000 raft_consensus.cc:697] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:55.358263  8000 consensus_queue.cc:237] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.359705  8024 raft_consensus.cc:493] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.360538  7862 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:55.355206  7869 raft_consensus.cc:385] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.360188  8024 raft_consensus.cc:515] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.356170  7864 raft_consensus.cc:740] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.360981  7869 raft_consensus.cc:740] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.361052  7862 ts_tablet_manager.cc:1403] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.195s	user 0.016s	sys 0.010s
I20260709 13:00:55.361977  7936 leader_election.cc:290] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:55.365302  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:55.368141  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4495c3f82450cbeb8cf7b1ce76dce" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:55.362816  7666 raft_consensus.cc:2468] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
W20260709 13:00:55.369832  7634 leader_election.cc:343] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.365087  7864 consensus_queue.cc:260] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.372536  7864 ts_tablet_manager.cc:1434] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 13:00:55.366088  7869 consensus_queue.cc:260] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.354897  7594 raft_consensus.cc:2468] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.366587  8024 leader_election.cc:290] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:55.367882  7865 ts_tablet_manager.cc:1434] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:00:55.375134  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4495c3f82450cbeb8cf7b1ce76dce" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:55.376401  7865 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
W20260709 13:00:55.376891  7633 leader_election.cc:343] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.373626  7864 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:55.377460  7633 leader_election.cc:304] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
W20260709 13:00:55.369499  7706 leader_election.cc:343] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.378429  8024 raft_consensus.cc:2749] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.380060  7862 raft_consensus.cc:359] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.381542  7862 raft_consensus.cc:385] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.378372  7706 leader_election.cc:304] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:55.382017  7862 raft_consensus.cc:740] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.382550  7936 raft_consensus.cc:2749] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.383097  7706 leader_election.cc:304] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7
I20260709 13:00:55.383873  7936 raft_consensus.cc:2804] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.383451  7862 consensus_queue.cc:260] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.384371  7936 raft_consensus.cc:697] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:00:55.385329  7936 consensus_queue.cc:237] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.388957  7869 ts_tablet_manager.cc:1434] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.004s
I20260709 13:00:55.390039  7869 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:55.392037  8003 consensus_queue.cc:1048] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.410662  7862 ts_tablet_manager.cc:1434] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:00:55.411980  7862 tablet_bootstrap.cc:492] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:55.417847  7869 tablet_bootstrap.cc:654] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.420102  7996 consensus_queue.cc:1048] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.435376  7862 tablet_bootstrap.cc:654] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:55.472579  8040 log.cc:927] Time spent T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:00:55.491253  7864 tablet_bootstrap.cc:654] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.500048  7865 tablet_bootstrap.cc:654] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.502869  7869 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:55.503422  7869 ts_tablet_manager.cc:1403] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.114s	user 0.003s	sys 0.016s
I20260709 13:00:55.505023  7862 tablet_bootstrap.cc:492] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:55.505551  7862 ts_tablet_manager.cc:1403] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.009s
I20260709 13:00:55.506270  7869 raft_consensus.cc:359] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.506997  7869 raft_consensus.cc:385] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.507270  7869 raft_consensus.cc:740] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.507395  7996 consensus_queue.cc:1048] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.508010  7869 consensus_queue.cc:260] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.509155  7911 consensus_queue.cc:1048] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:55.509313  7862 raft_consensus.cc:359] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.510505  7862 raft_consensus.cc:385] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.510782  7862 raft_consensus.cc:740] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.520363  7490 catalog_manager.cc:5697] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.523651  7862 consensus_queue.cc:260] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.524756  7869 ts_tablet_manager.cc:1434] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:00:55.529420  7869 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:55.551503  7862 ts_tablet_manager.cc:1434] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:00:55.552553  7864 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:55.552917  7864 ts_tablet_manager.cc:1403] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.180s	user 0.028s	sys 0.008s
I20260709 13:00:55.553545  7862 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:55.554051  7999 raft_consensus.cc:493] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.554522  7999 raft_consensus.cc:515] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.556674  7999 leader_election.cc:290] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:55.558240  7864 raft_consensus.cc:359] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.559105  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:55.559402  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:55.560243  7862 tablet_bootstrap.cc:654] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.559881  7489 catalog_manager.cc:5697] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:55.560719  7557 leader_election.cc:343] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.560084  7741 raft_consensus.cc:2468] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:55.559082  7864 raft_consensus.cc:385] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.562086  7557 leader_election.cc:304] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:55.562647  7864 raft_consensus.cc:740] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.563736  7999 raft_consensus.cc:2804] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.564226  7999 raft_consensus.cc:493] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.564651  7999 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.564844  7865 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:55.565364  7865 ts_tablet_manager.cc:1403] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.007s
I20260709 13:00:55.566856  7869 tablet_bootstrap.cc:654] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.566464  7488 catalog_manager.cc:5697] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 0 to 1, leader changed from <none> to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.568868  7865 raft_consensus.cc:359] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.567761  7864 consensus_queue.cc:260] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.577419  7865 raft_consensus.cc:385] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.577991  7865 raft_consensus.cc:740] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.579107  7865 consensus_queue.cc:260] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.579953  7864 ts_tablet_manager.cc:1434] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:00:55.583994  7865 ts_tablet_manager.cc:1434] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:00:55.585312  7865 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:55.587695  7864 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:55.595247  7864 tablet_bootstrap.cc:654] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.596112  7869 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:55.596678  7869 ts_tablet_manager.cc:1403] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.007s
I20260709 13:00:55.574268  7999 raft_consensus.cc:515] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.600311  7865 tablet_bootstrap.cc:654] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.601632  7869 raft_consensus.cc:359] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.602425  7869 raft_consensus.cc:385] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.602743  7869 raft_consensus.cc:740] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.603559  7869 consensus_queue.cc:260] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.606022  7869 ts_tablet_manager.cc:1434] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:00:55.606340  7999 leader_election.cc:290] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:55.610198  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:55.610858  7741 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.613389  8000 raft_consensus.cc:493] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.614362  8000 raft_consensus.cc:515] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.615034  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:55.615603  7665 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.616724  8000 leader_election.cc:290] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:55.618124  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7e711bccc84ba9aab8ad5513568455" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:55.618881  7592 raft_consensus.cc:2468] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:55.620218  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7e711bccc84ba9aab8ad5513568455" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:55.620539  7782 leader_election.cc:304] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:55.620940  7740 raft_consensus.cc:2468] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:55.621414  8003 raft_consensus.cc:2804] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.621183  7997 consensus_queue.cc:1048] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:55.621847  8003 raft_consensus.cc:493] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.622254  8003 raft_consensus.cc:3060] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.628752  7741 raft_consensus.cc:2468] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:55.630096  7557 leader_election.cc:304] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:55.631134  7862 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:55.631692  7862 ts_tablet_manager.cc:1403] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.005s
I20260709 13:00:55.634614  7862 raft_consensus.cc:359] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.635305  7862 raft_consensus.cc:385] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.636459  7869 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:55.637825  7999 raft_consensus.cc:2804] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.635324  7665 raft_consensus.cc:2468] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:55.638441  7999 raft_consensus.cc:697] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:55.635592  7862 raft_consensus.cc:740] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.642059  7862 consensus_queue.cc:260] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.629254  8003 raft_consensus.cc:515] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.646387  7864 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:55.646911  7864 ts_tablet_manager.cc:1403] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.004s
I20260709 13:00:55.645140  7999 consensus_queue.cc:237] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.655766  7862 ts_tablet_manager.cc:1434] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:00:55.655596  8000 consensus_queue.cc:1048] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:55.673760  7862 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:55.658730  7865 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:55.681821  7865 ts_tablet_manager.cc:1403] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.004s
I20260709 13:00:55.682188  7862 tablet_bootstrap.cc:654] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.672679  7864 raft_consensus.cc:359] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.684340  7864 raft_consensus.cc:385] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.684623  7864 raft_consensus.cc:740] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.686935  7997 consensus_queue.cc:1048] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.686842  7864 consensus_queue.cc:260] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.662217  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7e711bccc84ba9aab8ad5513568455" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:55.699491  7741 raft_consensus.cc:3060] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.703450  7869 tablet_bootstrap.cc:654] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.700503  8003 leader_election.cc:290] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:55.706877  7864 ts_tablet_manager.cc:1434] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:00:55.708951  7864 tablet_bootstrap.cc:492] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:55.711604  7862 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:55.700240  7865 raft_consensus.cc:359] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.701620  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7e711bccc84ba9aab8ad5513568455" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:55.712795  7862 ts_tablet_manager.cc:1403] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.008s
I20260709 13:00:55.713173  7594 raft_consensus.cc:3060] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.717334  7881 raft_consensus.cc:493] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.717957  7881 raft_consensus.cc:515] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.721315  7881 leader_election.cc:290] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:55.722299  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:55.722811  8003 raft_consensus.cc:493] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.722862  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:55.723726  7740 raft_consensus.cc:2468] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:55.723538  8003 raft_consensus.cc:515] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:00:55.724058  7557 leader_election.cc:343] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.724910  7557 leader_election.cc:304] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:55.725983  7865 raft_consensus.cc:385] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.726290  7881 raft_consensus.cc:2804] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.726670  7865 raft_consensus.cc:740] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.726889  7881 raft_consensus.cc:493] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.727697  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4495c3f82450cbeb8cf7b1ce76dce" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:55.727974  7881 raft_consensus.cc:3060] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:55.729656  7782 leader_election.cc:343] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.730845  7594 raft_consensus.cc:2468] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.732182  7782 leader_election.cc:304] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:55.733863  7997 raft_consensus.cc:2804] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.734549  7997 raft_consensus.cc:697] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:55.736023  8026 raft_consensus.cc:493] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.735910  7997 consensus_queue.cc:237] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.736511  8026 raft_consensus.cc:515] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.738924  8026 leader_election.cc:290] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:55.739609  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:55.746042  7864 tablet_bootstrap.cc:654] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.745464  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:55.746699  7740 raft_consensus.cc:2468] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
W20260709 13:00:55.745704  7780 leader_election.cc:343] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.749727  7741 raft_consensus.cc:2468] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.756845  7862 raft_consensus.cc:359] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.757782  7862 raft_consensus.cc:385] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.758162  7862 raft_consensus.cc:740] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.748020  8003 leader_election.cc:290] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:55.749189  7865 consensus_queue.cc:260] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.761334  7865 ts_tablet_manager.cc:1434] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:00:55.750417  7780 leader_election.cc:304] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:55.763782  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4495c3f82450cbeb8cf7b1ce76dce" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:55.764514  7666 raft_consensus.cc:2468] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:55.766256  7869 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:55.766786  7869 ts_tablet_manager.cc:1403] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.000s
I20260709 13:00:55.767081  7490 catalog_manager.cc:5697] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.769281  7881 raft_consensus.cc:515] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.759130  7862 consensus_queue.cc:260] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:55.769714  7869 raft_consensus.cc:359] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.777408  7869 raft_consensus.cc:385] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.777760  7869 raft_consensus.cc:740] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.768680  7865 tablet_bootstrap.cc:492] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:55.778812  7881 leader_election.cc:290] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:55.778585  7869 consensus_queue.cc:260] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.779433  8003 raft_consensus.cc:2804] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.779832  8003 raft_consensus.cc:493] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.780185  8003 raft_consensus.cc:3060] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.780938  7869 ts_tablet_manager.cc:1434] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:55.781941  7869 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:55.782486  7862 ts_tablet_manager.cc:1434] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:00:55.783507  7862 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:55.784135  7865 tablet_bootstrap.cc:654] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.788893  7869 tablet_bootstrap.cc:654] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.788689  7780 leader_election.cc:304] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:55.790385  7862 tablet_bootstrap.cc:654] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.791877  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:55.792523  7741 raft_consensus.cc:3060] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.794190  8003 raft_consensus.cc:515] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
W20260709 13:00:55.806511  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:55.801759  7997 raft_consensus.cc:2804] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.804172  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:55.803511  8003 leader_election.cc:290] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:55.816361  7997 raft_consensus.cc:493] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:55.832511  7557 leader_election.cc:343] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.836208  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:55.837110  7742 raft_consensus.cc:3060] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.830193  7997 raft_consensus.cc:3060] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.843575  7488 catalog_manager.cc:5697] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.848685  7864 tablet_bootstrap.cc:492] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:55.849138  7864 ts_tablet_manager.cc:1403] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.141s	user 0.023s	sys 0.021s
I20260709 13:00:55.852136  7864 raft_consensus.cc:359] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.852836  7864 raft_consensus.cc:385] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.853106  7864 raft_consensus.cc:740] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.853845  7864 consensus_queue.cc:260] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:55.856750  7864 ts_tablet_manager.cc:1434] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:55.857738  7864 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:55.847834  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:55.859968  7815 raft_consensus.cc:3060] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.862735  7741 raft_consensus.cc:2468] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:55.868942  7864 tablet_bootstrap.cc:654] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.868011  7557 leader_election.cc:304] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
W20260709 13:00:55.871912  7780 leader_election.cc:343] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.871922  7881 raft_consensus.cc:2804] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.873607  7881 raft_consensus.cc:697] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:55.874616  7881 consensus_queue.cc:237] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.875418  8026 consensus_queue.cc:1048] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.835083  8003 consensus_queue.cc:1048] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:00:55.908255  7742 raft_consensus.cc:2468] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.920503  8024 raft_consensus.cc:493] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.921304  8024 raft_consensus.cc:515] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.929160  8024 leader_election.cc:290] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:55.930673  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5496197ab1264ee1887afbf67a081376" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:55.932307  7634 leader_election.cc:343] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.933130  7997 raft_consensus.cc:515] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.935714  7894 consensus_queue.cc:1048] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.937713  7862 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:55.938268  7862 ts_tablet_manager.cc:1403] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.005s
I20260709 13:00:55.941393  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4495c3f82450cbeb8cf7b1ce76dce" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:55.942304  7592 raft_consensus.cc:3060] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.942126  7862 raft_consensus.cc:359] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.943228  7862 raft_consensus.cc:385] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.943790  7862 raft_consensus.cc:740] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.949112  7997 leader_election.cc:290] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:55.958339  7780 leader_election.cc:304] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:55.959501  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4495c3f82450cbeb8cf7b1ce76dce" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:55.960136  7666 raft_consensus.cc:3060] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.961757  7997 raft_consensus.cc:2804] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.944725  7862 consensus_queue.cc:260] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:55.966080  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5496197ab1264ee1887afbf67a081376" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:55.967043  7817 raft_consensus.cc:2468] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:55.968416  7633 leader_election.cc:304] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:55.970646  7869 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:55.970599  7964 raft_consensus.cc:2804] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.971446  7964 raft_consensus.cc:493] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.972081  7964 raft_consensus.cc:3060] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.971550  7869 ts_tablet_manager.cc:1403] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.190s	user 0.030s	sys 0.014s
I20260709 13:00:55.990278  7869 raft_consensus.cc:359] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:55.992483  7869 raft_consensus.cc:385] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.992892  7869 raft_consensus.cc:740] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.985226  7592 raft_consensus.cc:2468] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:55.995337  7862 ts_tablet_manager.cc:1434] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:00:55.962541  7997 raft_consensus.cc:697] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:55.998847  7862 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:56.002039  7865 tablet_bootstrap.cc:492] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:56.002609  7865 ts_tablet_manager.cc:1403] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.234s	user 0.022s	sys 0.031s
I20260709 13:00:56.006506  7894 consensus_queue.cc:1048] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.007210  7865 raft_consensus.cc:359] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.007707  7666 raft_consensus.cc:2468] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:56.008543  7865 raft_consensus.cc:385] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.009327  7865 raft_consensus.cc:740] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.011927  7780 leader_election.cc:304] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:00:56.012910  8000 raft_consensus.cc:2804] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:56.013461  8000 raft_consensus.cc:697] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:56.014649  8000 consensus_queue.cc:237] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.013710  7864 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:56.017765  8003 consensus_queue.cc:1048] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.019562  7864 ts_tablet_manager.cc:1403] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.025s
I20260709 13:00:56.024152  7864 raft_consensus.cc:359] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.025166  7864 raft_consensus.cc:385] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.030962  7997 consensus_queue.cc:237] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.033093  7865 consensus_queue.cc:260] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.035125  7865 ts_tablet_manager.cc:1434] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:00:56.036216  7865 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:56.025514  7864 raft_consensus.cc:740] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.041198  7869 consensus_queue.cc:260] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.053292  7869 ts_tablet_manager.cc:1434] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.001s
I20260709 13:00:56.054592  7869 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:56.055008  7864 consensus_queue.cc:260] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.069007  7864 ts_tablet_manager.cc:1434] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:00:56.100756  7862 tablet_bootstrap.cc:654] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.131738  7864 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
W20260709 13:00:56.133692  7633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 53892.1us
I20260709 13:00:56.148396  7964 raft_consensus.cc:515] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.152020  8003 consensus_queue.cc:1048] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:56.155006  8078 log.cc:927] Time spent T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.003s
I20260709 13:00:56.159520  7964 leader_election.cc:290] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:56.160292  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5496197ab1264ee1887afbf67a081376" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:56.160928  7815 raft_consensus.cc:3060] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.161064  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5496197ab1264ee1887afbf67a081376" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:56.162045  7592 raft_consensus.cc:3060] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.163066  7489 catalog_manager.cc:5697] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.168694  7865 tablet_bootstrap.cc:654] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.174685  7869 tablet_bootstrap.cc:654] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.176855  7815 raft_consensus.cc:2468] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:56.188194  7881 consensus_queue.cc:1048] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.187353  7592 raft_consensus.cc:2468] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:56.190972  7634 leader_election.cc:304] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:56.191900  7964 raft_consensus.cc:2804] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:56.192467  7864 tablet_bootstrap.cc:654] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.192623  7964 raft_consensus.cc:697] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:56.193660  7964 consensus_queue.cc:237] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.210602  7862 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:56.211246  7862 ts_tablet_manager.cc:1403] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.214s	user 0.020s	sys 0.016s
I20260709 13:00:56.220366  7862 raft_consensus.cc:359] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.221107  7862 raft_consensus.cc:385] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.221374  7862 raft_consensus.cc:740] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.222091  7862 consensus_queue.cc:260] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.227751  7862 ts_tablet_manager.cc:1434] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:00:56.228746  7862 tablet_bootstrap.cc:492] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:56.236694  7865 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:56.238355  7865 ts_tablet_manager.cc:1403] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.202s	user 0.009s	sys 0.005s
I20260709 13:00:56.240756  7862 tablet_bootstrap.cc:654] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.241288  7911 raft_consensus.cc:493] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.242065  7911 raft_consensus.cc:515] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.245707  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229814a1ef67415c854a94da0c89c7c0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:56.246507  7817 raft_consensus.cc:2468] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
I20260709 13:00:56.247908  7707 leader_election.cc:304] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:56.249148  8080 raft_consensus.cc:2804] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:56.249637  7911 leader_election.cc:290] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:56.249729  8080 raft_consensus.cc:493] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.250460  8080 raft_consensus.cc:3060] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.238839  7869 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:56.250566  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229814a1ef67415c854a94da0c89c7c0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:56.258044  7869 ts_tablet_manager.cc:1403] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.000s
W20260709 13:00:56.272269  7708 leader_election.cc:343] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:56.274616  8003 consensus_queue.cc:1048] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.278710  8080 raft_consensus.cc:515] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.280575  7492 catalog_manager.cc:5697] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.282480  7864 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:56.282814  8080 leader_election.cc:290] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:56.282972  7864 ts_tablet_manager.cc:1403] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.019s
I20260709 13:00:56.283846  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229814a1ef67415c854a94da0c89c7c0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:56.284428  7817 raft_consensus.cc:3060] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.285745  7865 raft_consensus.cc:359] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.286408  7865 raft_consensus.cc:385] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.286651  7865 raft_consensus.cc:740] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.287304  7865 consensus_queue.cc:260] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.288785  7865 ts_tablet_manager.cc:1434] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.000s
I20260709 13:00:56.292486  7865 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:56.291193  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229814a1ef67415c854a94da0c89c7c0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
W20260709 13:00:56.297341  7708 leader_election.cc:343] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:56.296933  7864 raft_consensus.cc:359] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.298147  7864 raft_consensus.cc:385] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.303071  7996 consensus_queue.cc:1048] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.303833  7869 raft_consensus.cc:359] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.304647  7869 raft_consensus.cc:385] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.304996  7869 raft_consensus.cc:740] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.305827  7869 consensus_queue.cc:260] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.298610  7864 raft_consensus.cc:740] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.308485  7862 tablet_bootstrap.cc:492] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:56.309156  7862 ts_tablet_manager.cc:1403] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
I20260709 13:00:56.310956  7869 ts_tablet_manager.cc:1434] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 13:00:56.311985  7869 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:56.316059  7862 raft_consensus.cc:359] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.316805  7862 raft_consensus.cc:385] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.317086  7862 raft_consensus.cc:740] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.312916  7817 raft_consensus.cc:2468] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:56.318117  7869 tablet_bootstrap.cc:654] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.318964  7707 leader_election.cc:304] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:56.321233  7862 consensus_queue.cc:260] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.321741  8080 raft_consensus.cc:2804] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:56.322307  8080 raft_consensus.cc:697] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:00:56.323486  8080 consensus_queue.cc:237] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.328073  7862 ts_tablet_manager.cc:1434] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:00:56.330776  7864 consensus_queue.cc:260] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.337237  7864 ts_tablet_manager.cc:1434] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:00:56.338400  7864 tablet_bootstrap.cc:492] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:56.343174  7862 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
W20260709 13:00:56.347801  7557 consensus_peers.cc:597] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:56.348651  7869 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:56.349224  7869 ts_tablet_manager.cc:1403] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:00:56.351886  7862 tablet_bootstrap.cc:654] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.352125  7869 raft_consensus.cc:359] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.352907  7869 raft_consensus.cc:385] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.353210  7869 raft_consensus.cc:740] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.353914  7869 consensus_queue.cc:260] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.356904  7869 ts_tablet_manager.cc:1434] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:56.358103  7869 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:56.361259  7865 tablet_bootstrap.cc:654] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.364530  7488 catalog_manager.cc:5697] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.367172  7864 tablet_bootstrap.cc:654] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.369629  7862 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:56.370148  7862 ts_tablet_manager.cc:1403] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.001s
I20260709 13:00:56.373059  7869 tablet_bootstrap.cc:654] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.372877  7862 raft_consensus.cc:359] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.374142  7862 raft_consensus.cc:385] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.374526  7862 raft_consensus.cc:740] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.375447  7862 consensus_queue.cc:260] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.381536  7862 ts_tablet_manager.cc:1434] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:00:56.382508  7864 tablet_bootstrap.cc:492] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:56.382532  7862 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:56.383183  7864 ts_tablet_manager.cc:1403] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 13:00:56.387840  7865 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:56.387873  7864 raft_consensus.cc:359] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.388814  7864 raft_consensus.cc:385] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.388607  7865 ts_tablet_manager.cc:1403] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.000s
I20260709 13:00:56.389261  7864 raft_consensus.cc:740] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.389159  7862 tablet_bootstrap.cc:654] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.390291  7864 consensus_queue.cc:260] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.391884  7865 raft_consensus.cc:359] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.392448  7865 raft_consensus.cc:385] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.392701  7865 raft_consensus.cc:740] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.392804  7864 ts_tablet_manager.cc:1434] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:00:56.394163  7864 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:56.393350  7865 consensus_queue.cc:260] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.395323  7490 catalog_manager.cc:5697] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.396896  7865 ts_tablet_manager.cc:1434] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:56.397836  7865 tablet_bootstrap.cc:492] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:56.402024  7864 tablet_bootstrap.cc:654] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.408715  7869 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:56.409219  7869 ts_tablet_manager.cc:1403] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.004s
I20260709 13:00:56.412192  7869 raft_consensus.cc:359] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.413069  7869 raft_consensus.cc:385] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.413249  7865 tablet_bootstrap.cc:654] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.413394  7869 raft_consensus.cc:740] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.414391  7869 consensus_queue.cc:260] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.416759  7862 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:56.416277  7489 catalog_manager.cc:5697] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 0 to 1, leader changed from <none> to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.417294  7862 ts_tablet_manager.cc:1403] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.010s
I20260709 13:00:56.420392  7862 raft_consensus.cc:359] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.420897  7869 ts_tablet_manager.cc:1434] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:56.421085  7862 raft_consensus.cc:385] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.421375  7862 raft_consensus.cc:740] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.422029  7869 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:56.422178  7862 consensus_queue.cc:260] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.424530  7862 ts_tablet_manager.cc:1434] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:56.425779  7964 raft_consensus.cc:493] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.426354  7964 raft_consensus.cc:515] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.426584  8003 consensus_queue.cc:1048] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.429050  7964 leader_election.cc:290] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:56.429709  7865 tablet_bootstrap.cc:492] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:56.430260  7865 ts_tablet_manager.cc:1403] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.002s
I20260709 13:00:56.430457  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:56.431200  7742 raft_consensus.cc:2468] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:56.431317  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:56.432027  7594 raft_consensus.cc:2468] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:56.432197  7869 tablet_bootstrap.cc:654] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.433068  7865 raft_consensus.cc:359] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.433907  7865 raft_consensus.cc:385] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.434165  7865 raft_consensus.cc:740] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.434655  7634 leader_election.cc:304] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:56.434883  7865 consensus_queue.cc:260] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.435789  8083 raft_consensus.cc:2804] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:56.436291  8083 raft_consensus.cc:493] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.436707  8083 raft_consensus.cc:3060] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.437395  7865 ts_tablet_manager.cc:1434] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:00:56.438421  7865 tablet_bootstrap.cc:492] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:56.452617  8003 raft_consensus.cc:493] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.454728  7666 raft_consensus.cc:3060] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.455657  7971 consensus_queue.cc:1048] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.467494  7997 consensus_queue.cc:1048] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.475176  7865 tablet_bootstrap.cc:654] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.493073  7964 raft_consensus.cc:493] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.493989  7964 raft_consensus.cc:515] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.453501  8003 raft_consensus.cc:515] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.511668  7862 tablet_bootstrap.cc:492] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:56.511955  7865 tablet_bootstrap.cc:492] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:56.512517  7865 ts_tablet_manager.cc:1403] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.011s
I20260709 13:00:56.521216  8003 leader_election.cc:290] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:56.535005  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef8564b08234776a109c3b317ab232e" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:56.535815  7741 raft_consensus.cc:2468] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:56.535979  7964 leader_election.cc:290] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:56.531072  7865 raft_consensus.cc:359] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.540871  7865 raft_consensus.cc:385] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.541167  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:56.531049  8003 consensus_queue.cc:1048] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:00:56.542326  7741 raft_consensus.cc:2468] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:56.543557  7780 leader_election.cc:304] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:56.541239  7865 raft_consensus.cc:740] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.544354  7997 raft_consensus.cc:2804] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:56.544772  7997 raft_consensus.cc:493] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.545094  7997 raft_consensus.cc:3060] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.544958  7865 consensus_queue.cc:260] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.545521  7632 leader_election.cc:304] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:56.547318  7865 ts_tablet_manager.cc:1434] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:00:56.547993  7964 raft_consensus.cc:2804] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:56.548106  8083 raft_consensus.cc:515] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.548751  7964 raft_consensus.cc:493] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.551806  7964 raft_consensus.cc:3060] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.551601  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:56.552801  7865 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:56.561028  7864 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:56.562021  7864 ts_tablet_manager.cc:1403] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.168s	user 0.035s	sys 0.023s
I20260709 13:00:56.569114  8024 raft_consensus.cc:493] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.570228  8024 raft_consensus.cc:515] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.573040  8024 leader_election.cc:290] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:56.582794  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:56.567910  7864 raft_consensus.cc:359] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.588802  7864 raft_consensus.cc:385] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.589466  7864 raft_consensus.cc:740] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.591368  7864 consensus_queue.cc:260] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.591053  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef8564b08234776a109c3b317ab232e" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:56.607628  7864 ts_tablet_manager.cc:1434] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.044s	user 0.000s	sys 0.010s
I20260709 13:00:56.609760  7864 tablet_bootstrap.cc:492] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:56.612744  8080 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.613359  8080 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.599635  7881 raft_consensus.cc:493] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.614591  7881 raft_consensus.cc:515] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.615572  8080 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:56.615773  7862 tablet_bootstrap.cc:654] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.617678  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:56.619804  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:56.620723  7817 raft_consensus.cc:2468] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:56.622656  7558 leader_election.cc:304] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:56.623540  7999 raft_consensus.cc:2804] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:56.617779  7881 leader_election.cc:290] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:56.623914  7999 raft_consensus.cc:493] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:56.625305  7708 leader_election.cc:343] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:56.634089  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:56.617681  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:56.624784  7666 raft_consensus.cc:2468] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:56.634897  7742 raft_consensus.cc:2468] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:56.635288  7999 raft_consensus.cc:3060] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:56.627255  7633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 57432.4us
W20260709 13:00:56.646355  7706 leader_election.cc:343] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:56.646878  7706 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:56.648285  8080 raft_consensus.cc:2749] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:56.650760  7869 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:56.651262  7869 ts_tablet_manager.cc:1403] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.229s	user 0.010s	sys 0.049s
I20260709 13:00:56.653390  8026 consensus_queue.cc:1048] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.656663  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:56.657447  7862 tablet_bootstrap.cc:492] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:56.658099  7862 ts_tablet_manager.cc:1403] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.233s	user 0.022s	sys 0.006s
I20260709 13:00:56.663497  7862 raft_consensus.cc:359] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.670449  7862 raft_consensus.cc:385] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.671219  7862 raft_consensus.cc:740] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.672679  7869 raft_consensus.cc:359] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.669055  7997 raft_consensus.cc:515] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.672896  7964 raft_consensus.cc:515] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.667824  8083 leader_election.cc:290] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:56.677769  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:56.680703  7742 raft_consensus.cc:3060] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.680787  7668 raft_consensus.cc:1240] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Rejecting Update request from peer 1075f1083cc84c349b3a0bd57774c1e7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:00:56.682981  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef8564b08234776a109c3b317ab232e" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:56.673504  7869 raft_consensus.cc:385] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.684346  7869 raft_consensus.cc:740] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.683632  7740 raft_consensus.cc:3060] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.666944  7865 tablet_bootstrap.cc:654] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.672854  7862 consensus_queue.cc:260] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.693990  7864 tablet_bootstrap.cc:654] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.691715  7869 consensus_queue.cc:260] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.685272  7996 raft_consensus.cc:493] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.701817  7862 ts_tablet_manager.cc:1434] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:00:56.698280  7911 raft_consensus.cc:493] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.680163  7997 leader_election.cc:290] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:56.708902  7862 tablet_bootstrap.cc:492] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:56.713747  7911 raft_consensus.cc:515] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.714398  7742 raft_consensus.cc:2468] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:56.705827  8000 consensus_queue.cc:1059] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:00:56.715485  8000 raft_consensus.cc:3055] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:56.715937  8000 raft_consensus.cc:740] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:56.716110  7911 leader_election.cc:290] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:56.701005  7996 raft_consensus.cc:515] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.718647  7964 leader_election.cc:290] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:56.719564  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f985608da1404258977e2e929aad7559" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:00:56.721760  7707 leader_election.cc:343] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:56.721901  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f985608da1404258977e2e929aad7559" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:56.717043  8000 consensus_queue.cc:260] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.722569  7666 raft_consensus.cc:2468] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 0.
I20260709 13:00:56.724013  7706 leader_election.cc:304] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7
I20260709 13:00:56.718704  7996 leader_election.cc:290] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:56.727314  7911 raft_consensus.cc:2804] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:56.728195  7911 raft_consensus.cc:493] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.728674  7911 raft_consensus.cc:3060] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.723412  8000 raft_consensus.cc:3060] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.706314  7634 leader_election.cc:304] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:56.739143  7964 raft_consensus.cc:2749] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:56.740336  7964 consensus_queue.cc:1048] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.746625  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229814a1ef67415c854a94da0c89c7c0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:56.761257  7999 raft_consensus.cc:515] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.774322  7999 leader_election.cc:290] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:56.780349  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:56.781098  7739 raft_consensus.cc:3060] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.785290  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef8564b08234776a109c3b317ab232e" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:56.785992  7666 raft_consensus.cc:3060] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.786659  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:56.787971  7632 leader_election.cc:304] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:56.789283  7739 raft_consensus.cc:2468] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:56.790299  7964 raft_consensus.cc:2804] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:56.790980  7964 raft_consensus.cc:697] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:56.702461  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:56.811499  7557 leader_election.cc:304] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:56.792263  7964 consensus_queue.cc:237] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:56.808068  7594 raft_consensus.cc:3060] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.821517  7999 raft_consensus.cc:2804] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:56.832983  7869 ts_tablet_manager.cc:1434] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.181s	user 0.046s	sys 0.033s
I20260709 13:00:56.834355  7869 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:56.829298  8003 raft_consensus.cc:493] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.854898  7864 tablet_bootstrap.cc:492] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:56.855630  7864 ts_tablet_manager.cc:1403] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.246s	user 0.017s	sys 0.015s
I20260709 13:00:56.857110  7862 tablet_bootstrap.cc:654] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.835968  7999 raft_consensus.cc:697] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:56.841195  7740 raft_consensus.cc:2468] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:56.887776  7869 tablet_bootstrap.cc:654] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.843575  8003 raft_consensus.cc:515] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.905144  8003 leader_election.cc:290] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:56.906286  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ea4c1d73af403bb50c3ecab728ec32" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:56.910713  7864 raft_consensus.cc:359] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.911818  7864 raft_consensus.cc:385] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.912528  7864 raft_consensus.cc:740] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.885195  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:56.873510  7971 raft_consensus.cc:493] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.913376  7864 consensus_queue.cc:260] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.884783  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:56.889911  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229814a1ef67415c854a94da0c89c7c0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:56.869467  7666 raft_consensus.cc:2468] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:56.927218  7864 ts_tablet_manager.cc:1434] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.002s
I20260709 13:00:56.928797  7864 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:56.928586  7816 raft_consensus.cc:3060] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.874483  7999 consensus_queue.cc:237] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.935199  7814 raft_consensus.cc:2410] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:00:56.943854  7865 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:56.944410  7865 ts_tablet_manager.cc:1403] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.395s	user 0.012s	sys 0.007s
I20260709 13:00:56.944790  8125 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.923314  7971 raft_consensus.cc:515] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.949766  7593 raft_consensus.cc:2468] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:56.951447  8083 consensus_queue.cc:1048] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.954049  7782 leader_election.cc:304] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:56.954283  7594 raft_consensus.cc:2468] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:56.940179  7817 raft_consensus.cc:2393] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate b81c129769e24f019dc9045ce8c09771 in this term.
I20260709 13:00:56.955816  8026 raft_consensus.cc:2804] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:56.955940  7780 leader_election.cc:304] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:56.956233  8026 raft_consensus.cc:493] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.956658  8026 raft_consensus.cc:3060] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.957342  7997 raft_consensus.cc:2804] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:56.960552  7997 raft_consensus.cc:697] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:56.948477  8125 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:56.963830  7865 raft_consensus.cc:359] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.967087  7865 raft_consensus.cc:385] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.967366  7865 raft_consensus.cc:740] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.964545  8125 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:56.971499  7862 tablet_bootstrap.cc:492] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:56.971987  7862 ts_tablet_manager.cc:1403] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.269s	user 0.019s	sys 0.003s
I20260709 13:00:56.974539  7865 consensus_queue.cc:260] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:56.962622  7971 leader_election.cc:290] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:56.979403  7865 ts_tablet_manager.cc:1434] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:00:56.981056  7865 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:56.960834  7633 leader_election.cc:304] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:56.982394  8083 raft_consensus.cc:2749] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:56.961483  7997 consensus_queue.cc:237] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.975759  7558 leader_election.cc:304] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:56.987476  7971 raft_consensus.cc:3060] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.965420  7911 raft_consensus.cc:515] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:56.999593  7489 catalog_manager.cc:5697] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.996062  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ea4c1d73af403bb50c3ecab728ec32" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:57.017115  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ea4c1d73af403bb50c3ecab728ec32" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.017638  8026 raft_consensus.cc:515] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.019066  7814 raft_consensus.cc:2393] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:00:57.020042  8026 leader_election.cc:290] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:57.022734  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ea4c1d73af403bb50c3ecab728ec32" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
W20260709 13:00:57.023048  8119 log.cc:927] Time spent T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:00:57.023567  7594 raft_consensus.cc:3060] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.027105  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ea4c1d73af403bb50c3ecab728ec32" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:57.029224  7816 raft_consensus.cc:2468] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:57.031741  7971 raft_consensus.cc:2749] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.012382  7667 raft_consensus.cc:2468] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:57.035868  7869 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:57.036592  7869 ts_tablet_manager.cc:1403] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.008s
I20260709 13:00:57.049533  7864 tablet_bootstrap.cc:654] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.055429  8127 consensus_queue.cc:1048] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:57.056309  7667 raft_consensus.cc:3060] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.060961  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f985608da1404258977e2e929aad7559" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:57.061815  7665 raft_consensus.cc:3060] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.064430  7911 leader_election.cc:290] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:57.061045  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.081349  7665 raft_consensus.cc:2468] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:57.091032  7862 raft_consensus.cc:359] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.092654  7862 raft_consensus.cc:385] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.093071  7862 raft_consensus.cc:740] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.093931  7862 consensus_queue.cc:260] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.096035  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:57.096832  7862 ts_tablet_manager.cc:1434] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.125s	user 0.005s	sys 0.003s
I20260709 13:00:57.092217  7557 leader_election.cc:304] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:57.099570  7862 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:57.102249  8126 raft_consensus.cc:493] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.103008  8126 raft_consensus.cc:515] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
W20260709 13:00:57.103729  7708 leader_election.cc:343] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.105221  7869 raft_consensus.cc:359] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.108618  7869 raft_consensus.cc:385] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.109019  7869 raft_consensus.cc:740] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.110001  7869 consensus_queue.cc:260] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.107779  8128 consensus_queue.cc:1048] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:00:57.118801  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f985608da1404258977e2e929aad7559" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:57.119488  7815 raft_consensus.cc:3060] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.120030  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e37254134d1494dcd79f992b6967" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.106071  8126 leader_election.cc:290] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:57.124486  7862 tablet_bootstrap.cc:654] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.127337  7869 ts_tablet_manager.cc:1434] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.003s
I20260709 13:00:57.128703  7869 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:57.130167  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ea4c1d73af403bb50c3ecab728ec32" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:57.133939  7665 raft_consensus.cc:3060] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.130589  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e37254134d1494dcd79f992b6967" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:57.137332  7865 tablet_bootstrap.cc:654] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.130236  7706 leader_election.cc:304] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:57.147593  7492 catalog_manager.cc:5697] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:57.119467  7707 leader_election.cc:343] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.153272  7707 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:57.154244  7911 raft_consensus.cc:2749] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.155791  7864 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:57.156445  7864 ts_tablet_manager.cc:1403] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.228s	user 0.020s	sys 0.021s
W20260709 13:00:57.156701  7707 leader_election.cc:343] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.152132  8127 raft_consensus.cc:2804] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.162585  8127 raft_consensus.cc:697] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:00:57.175400  7864 raft_consensus.cc:359] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.176020  7864 raft_consensus.cc:385] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.176229  7864 raft_consensus.cc:740] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.168133  7815 raft_consensus.cc:2468] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:00:57.163597  8127 consensus_queue.cc:237] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.172433  7665 raft_consensus.cc:2468] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:57.180697  7864 consensus_queue.cc:260] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.200313  7594 raft_consensus.cc:2468] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:57.200666  7864 ts_tablet_manager.cc:1434] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.003s
I20260709 13:00:57.206920  7864 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:57.213388  7865 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:57.214478  7865 ts_tablet_manager.cc:1403] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.010s
I20260709 13:00:57.210881  7999 raft_consensus.cc:2749] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.243786  7780 leader_election.cc:304] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
W20260709 13:00:57.246166  7706 leader_election.cc:343] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.246482  8114 raft_consensus.cc:2804] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.250124  7706 leader_election.cc:304] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:57.250535  8114 raft_consensus.cc:697] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:57.250761  7869 tablet_bootstrap.cc:654] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.259758  8126 raft_consensus.cc:2749] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.266077  8114 consensus_queue.cc:237] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.270555  8111 consensus_queue.cc:1048] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:57.273051  7864 tablet_bootstrap.cc:654] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.286615  7490 catalog_manager.cc:5697] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.290642  7865 raft_consensus.cc:359] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.291285  7865 raft_consensus.cc:385] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.291568  7865 raft_consensus.cc:740] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.294158  7865 consensus_queue.cc:260] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.304754  7865 ts_tablet_manager.cc:1434] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 13:00:57.306051  7862 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:57.306617  7862 ts_tablet_manager.cc:1403] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.209s	user 0.034s	sys 0.048s
I20260709 13:00:57.309499  7862 raft_consensus.cc:359] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.310209  7862 raft_consensus.cc:385] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.310504  7862 raft_consensus.cc:740] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.311177  7862 consensus_queue.cc:260] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.306589  7865 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:57.321542  7862 ts_tablet_manager.cc:1434] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:00:57.322618  7862 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:57.329068  7862 tablet_bootstrap.cc:654] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.333455  7865 tablet_bootstrap.cc:654] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.339216  7869 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:57.339735  7869 ts_tablet_manager.cc:1403] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.211s	user 0.011s	sys 0.000s
I20260709 13:00:57.343917  7489 catalog_manager.cc:5697] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 0 to 1, leader changed from <none> to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.347329  8083 consensus_queue.cc:1048] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:57.350243  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:57.352825  7869 raft_consensus.cc:359] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.353578  7869 raft_consensus.cc:385] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.353844  7869 raft_consensus.cc:740] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.354492  7869 consensus_queue.cc:260] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.356890  7864 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:57.357431  7864 ts_tablet_manager.cc:1403] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.151s	user 0.008s	sys 0.017s
I20260709 13:00:57.360177  7864 raft_consensus.cc:359] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.360872  7864 raft_consensus.cc:385] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.361115  7864 raft_consensus.cc:740] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.363729  7869 ts_tablet_manager.cc:1434] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:00:57.364907  7869 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:57.365839  7864 consensus_queue.cc:260] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.369542  8083 raft_consensus.cc:493] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.370570  8083 raft_consensus.cc:515] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.374184  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.374787  7813 raft_consensus.cc:2468] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:57.376039  7633 leader_election.cc:304] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:00:57.373548  7864 ts_tablet_manager.cc:1434] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:00:57.377158  7964 raft_consensus.cc:2804] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.377796  7964 raft_consensus.cc:493] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.378130  7964 raft_consensus.cc:3060] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.378368  7864 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:57.379647  7862 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:57.380230  7862 ts_tablet_manager.cc:1403] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.023s
I20260709 13:00:57.386669  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:57.387027  7964 raft_consensus.cc:515] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.387652  7591 raft_consensus.cc:2468] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:57.380398  7488 catalog_manager.cc:5697] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.371274  7869 tablet_bootstrap.cc:654] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.400059  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:57.427460  7813 raft_consensus.cc:3060] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.425925  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:57.429894  7591 raft_consensus.cc:3060] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.430589  7862 raft_consensus.cc:359] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.431330  7862 raft_consensus.cc:385] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.431849  7862 raft_consensus.cc:740] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.432680  7862 consensus_queue.cc:260] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.398890  8083 leader_election.cc:290] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:57.434435  7864 tablet_bootstrap.cc:654] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.435014  7862 ts_tablet_manager.cc:1434] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.054s	user 0.019s	sys 0.002s
I20260709 13:00:57.436668  7865 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:57.440603  7862 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:57.443120  7865 ts_tablet_manager.cc:1403] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.001s
I20260709 13:00:57.405910  7964 leader_election.cc:290] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:57.445874  8127 raft_consensus.cc:493] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.446825  8127 raft_consensus.cc:515] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.447597  7862 tablet_bootstrap.cc:654] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.449180  8127 leader_election.cc:290] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:57.451972  7869 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:57.452530  7869 ts_tablet_manager.cc:1403] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.000s
I20260709 13:00:57.453493  7813 raft_consensus.cc:2468] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:57.454759  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:57.454882  7633 leader_election.cc:304] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:00:57.456353  7964 raft_consensus.cc:2804] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.456401  7869 raft_consensus.cc:359] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.457015  7964 raft_consensus.cc:697] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:57.451972  7864 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:57.458495  7864 ts_tablet_manager.cc:1403] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.006s
I20260709 13:00:57.459851  7591 raft_consensus.cc:2468] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
W20260709 13:00:57.460960  7706 leader_election.cc:343] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.461912  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:57.457921  7964 consensus_queue.cc:237] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:00:57.463719  7708 leader_election.cc:343] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.464200  7708 leader_election.cc:304] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:57.461120  7864 raft_consensus.cc:359] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.465675  8127 raft_consensus.cc:2749] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.457271  7869 raft_consensus.cc:385] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.466889  7864 raft_consensus.cc:385] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.473345  7869 raft_consensus.cc:740] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.473673  7864 raft_consensus.cc:740] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.474259  7869 consensus_queue.cc:260] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.474614  7864 consensus_queue.cc:260] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.476887  7869 ts_tablet_manager.cc:1434] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:00:57.478626  7999 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.479310  7999 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.480628  8117 consensus_queue.cc:1048] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:57.481038  7869 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:57.483456  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:57.481434  7999 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:57.486730  7864 ts_tablet_manager.cc:1434] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:00:57.487798  7864 tablet_bootstrap.cc:492] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:57.465327  7865 raft_consensus.cc:359] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.491191  7865 raft_consensus.cc:385] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.491619  7865 raft_consensus.cc:740] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.492559  7865 consensus_queue.cc:260] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.493758  7667 raft_consensus.cc:2468] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:57.495260  7865 ts_tablet_manager.cc:1434] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:00:57.497380  7557 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:57.498278  7999 raft_consensus.cc:2804] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.498646  7999 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.499127  7999 raft_consensus.cc:3060] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.499012  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:57.499928  7739 raft_consensus.cc:2468] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:57.501904  7490 catalog_manager.cc:5697] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.507632  7862 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:57.508186  7862 ts_tablet_manager.cc:1403] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.007s
I20260709 13:00:57.511370  7862 raft_consensus.cc:359] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.512566  7862 raft_consensus.cc:385] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.512971  7862 raft_consensus.cc:740] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.513935  7862 consensus_queue.cc:260] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.514011  7999 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.519023  7865 tablet_bootstrap.cc:492] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:57.522375  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:57.512703  7864 tablet_bootstrap.cc:654] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.522604  7862 ts_tablet_manager.cc:1434] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 13:00:57.531337  7862 tablet_bootstrap.cc:492] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:57.523020  7667 raft_consensus.cc:3060] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.535789  7869 tablet_bootstrap.cc:654] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.541945  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:57.542344  7862 tablet_bootstrap.cc:654] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.542672  7740 raft_consensus.cc:3060] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.532459  7999 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:57.544742  8026 consensus_queue.cc:1048] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:57.546408  7865 tablet_bootstrap.cc:654] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.549491  7667 raft_consensus.cc:2468] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:57.558423  7557 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:57.559288  8117 raft_consensus.cc:2804] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.559746  8117 raft_consensus.cc:697] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:57.560556  8117 consensus_queue.cc:237] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.560959  8120 raft_consensus.cc:493] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.556897  7740 raft_consensus.cc:2468] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:57.581370  7862 tablet_bootstrap.cc:492] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:57.581930  7862 ts_tablet_manager.cc:1403] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.002s
I20260709 13:00:57.561492  8120 raft_consensus.cc:515] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.584159  8120 leader_election.cc:290] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:57.584818  7862 raft_consensus.cc:359] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.585546  7862 raft_consensus.cc:385] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.585853  7862 raft_consensus.cc:740] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.586258  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:57.587854  7708 leader_election.cc:343] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.596468  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:57.597595  8115 consensus_queue.cc:1048] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:57.589797  7862 consensus_queue.cc:260] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.602152  7864 tablet_bootstrap.cc:492] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:57.602952  7864 ts_tablet_manager.cc:1403] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.115s	user 0.006s	sys 0.019s
I20260709 13:00:57.608665  7862 ts_tablet_manager.cc:1434] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:00:57.609738  7862 tablet_bootstrap.cc:492] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
W20260709 13:00:57.609817  7706 leader_election.cc:343] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.610416  7706 leader_election.cc:304] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:57.612205  8120 raft_consensus.cc:2749] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.625918  8026 consensus_queue.cc:1048] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:57.616536  7488 catalog_manager.cc:5697] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.630429  7862 tablet_bootstrap.cc:654] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.655401  7865 tablet_bootstrap.cc:492] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:57.655961  7865 ts_tablet_manager.cc:1403] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.003s
I20260709 13:00:57.658954  7865 raft_consensus.cc:359] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.659683  7865 raft_consensus.cc:385] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.659951  7865 raft_consensus.cc:740] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.660571  7865 consensus_queue.cc:260] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.668601  7865 ts_tablet_manager.cc:1434] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:57.672875  7865 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:57.676676  8026 consensus_queue.cc:1048] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:57.682432  8083 raft_consensus.cc:493] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.682931  8083 raft_consensus.cc:515] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.670157  7864 raft_consensus.cc:359] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.684021  7864 raft_consensus.cc:385] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.684370  7864 raft_consensus.cc:740] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.685042  8083 leader_election.cc:290] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:57.685653  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e37254134d1494dcd79f992b6967" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:57.686125  7865 tablet_bootstrap.cc:654] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.686314  7739 raft_consensus.cc:2468] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:57.689033  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e37254134d1494dcd79f992b6967" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.689162  8026 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.689989  7632 leader_election.cc:304] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:57.690232  8026 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.690476  7911 consensus_queue.cc:1048] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:57.690827  8083 raft_consensus.cc:2804] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.691629  8083 raft_consensus.cc:493] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.692114  8083 raft_consensus.cc:3060] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.693465  8026 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:57.700219  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:57.702011  7782 leader_election.cc:343] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.685214  7864 consensus_queue.cc:260] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.707038  7817 raft_consensus.cc:2468] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:57.707743  7869 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:57.708307  7869 ts_tablet_manager.cc:1403] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.228s	user 0.013s	sys 0.029s
I20260709 13:00:57.711257  7864 ts_tablet_manager.cc:1434] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 13:00:57.712365  7864 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:57.712880  7869 raft_consensus.cc:359] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.713634  7869 raft_consensus.cc:385] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.713907  7869 raft_consensus.cc:740] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.714582  7869 consensus_queue.cc:260] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.717088  7869 ts_tablet_manager.cc:1434] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:00:57.722700  8117 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.723237  8117 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.725925  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:57.726689  7869 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:57.726635  7739 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:57.728821  7780 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:57.734324  8114 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.734900  8114 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.735338  8114 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.708576  8083 raft_consensus.cc:515] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.740469  8083 leader_election.cc:290] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:57.740890  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:57.741694  7739 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:57.740798  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e37254134d1494dcd79f992b6967" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:57.743364  7740 raft_consensus.cc:3060] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.746172  7557 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:57.751005  7862 tablet_bootstrap.cc:492] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:57.751631  7862 ts_tablet_manager.cc:1403] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.000s
I20260709 13:00:57.756515  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e37254134d1494dcd79f992b6967" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:57.757536  7813 raft_consensus.cc:3060] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.757944  8127 raft_consensus.cc:493] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.763234  8127 raft_consensus.cc:515] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.751508  7999 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.748097  8117 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:57.762228  7911 raft_consensus.cc:493] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.803653  7911 raft_consensus.cc:515] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.769315  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.770407  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:57.771207  7740 raft_consensus.cc:2468] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:57.771265  8127 leader_election.cc:290] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:57.776614  8120 consensus_queue.cc:1048] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:57.814962  7869 tablet_bootstrap.cc:654] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.784693  7862 raft_consensus.cc:359] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.775947  7999 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.798913  7864 tablet_bootstrap.cc:654] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:57.813807  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46081, user_credentials={real_user=slave}} blocked reactor thread for 60419.7us
I20260709 13:00:57.815637  7862 raft_consensus.cc:385] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.819289  7862 raft_consensus.cc:740] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.820393  7865 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:57.821092  7865 ts_tablet_manager.cc:1403] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.006s
I20260709 13:00:57.818001  7999 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.816495  7911 leader_election.cc:290] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:57.827580  7862 consensus_queue.cc:260] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.824846  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e53656f344150a25cb441648dd489" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:00:57.823850  7707 leader_election.cc:343] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.831517  8127 raft_consensus.cc:493] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.830060  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:00:57.840801  7708 leader_election.cc:343] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.846608  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e53656f344150a25cb441648dd489" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.869720  7862 ts_tablet_manager.cc:1434] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.117s	user 0.026s	sys 0.014s
I20260709 13:00:57.872998  7862 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
W20260709 13:00:57.874264  7706 leader_election.cc:343] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.828826  8114 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.871801  8117 raft_consensus.cc:493] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.901444  8117 raft_consensus.cc:515] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.883944  7865 raft_consensus.cc:359] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.902469  7865 raft_consensus.cc:385] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.902765  7865 raft_consensus.cc:740] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.866074  8127 raft_consensus.cc:515] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.904214  8117 leader_election.cc:290] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:57.906581  8127 leader_election.cc:290] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:57.903416  7813 raft_consensus.cc:2468] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:57.892416  7862 tablet_bootstrap.cc:654] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.866859  7708 leader_election.cc:304] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
W20260709 13:00:57.897891  7707 leader_election.cc:343] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.898538  7999 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:57.888808  7632 leader_election.cc:304] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:57.913713  7865 consensus_queue.cc:260] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:57.919548  7865 ts_tablet_manager.cc:1434] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
I20260709 13:00:57.920150  8174 raft_consensus.cc:2749] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.922959  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:00:57.923187  7708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 87461us
I20260709 13:00:57.923383  8082 raft_consensus.cc:2804] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.923976  8082 raft_consensus.cc:697] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:57.924538  7816 raft_consensus.cc:2393] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:00:57.924779  8082 consensus_queue.cc:237] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:57.931622  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0b231c31d34cc19a247378b4e932bf" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.932359  7815 raft_consensus.cc:2468] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:57.917124  7707 leader_election.cc:304] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:57.933995  7558 leader_election.cc:304] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
W20260709 13:00:57.936687  7706 leader_election.cc:343] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.935972  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:57.936602  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0b231c31d34cc19a247378b4e932bf" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:57.937857  7668 raft_consensus.cc:2468] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:57.941006  8127 raft_consensus.cc:2749] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.942919  8117 raft_consensus.cc:2804] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.943389  8117 raft_consensus.cc:493] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.943756  8117 raft_consensus.cc:3060] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:57.943549  7707 leader_election.cc:343] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.961988  7865 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:57.971942  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:57.958799  8114 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:57.958971  7999 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:57.972818  7815 raft_consensus.cc:2393] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:00:57.967696  7707 leader_election.cc:304] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:57.978440  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:57.978776  8174 raft_consensus.cc:2749] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.979084  7742 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.980222  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:57.991485  8172 consensus_queue.cc:1048] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:57.996892  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:57.997802  7594 raft_consensus.cc:2393] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 80af46fc024041de81a638d29912c8a3 in this term.
I20260709 13:00:58.000627  7869 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:58.001124  7869 ts_tablet_manager.cc:1403] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.275s	user 0.015s	sys 0.004s
I20260709 13:00:58.003990  7869 raft_consensus.cc:359] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.004755  7869 raft_consensus.cc:385] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.004624  7782 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:58.005144  7869 raft_consensus.cc:740] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.006047  8172 raft_consensus.cc:2749] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.006076  7869 consensus_queue.cc:260] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:57.998234  7742 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:58.010797  7964 consensus_queue.cc:1048] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.011150  7557 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7
I20260709 13:00:58.012738  7865 tablet_bootstrap.cc:654] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.014132  7869 ts_tablet_manager.cc:1434] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:00:58.017889  7869 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:58.024667  7864 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:58.026530  7864 ts_tablet_manager.cc:1403] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.313s	user 0.020s	sys 0.035s
I20260709 13:00:57.994062  8117 raft_consensus.cc:515] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.026928  8175 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.034160  8175 raft_consensus.cc:697] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:58.035187  8175 consensus_queue.cc:237] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.037282  8117 leader_election.cc:290] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:58.038630  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0b231c31d34cc19a247378b4e932bf" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:58.039270  7816 raft_consensus.cc:3060] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.040390  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0b231c31d34cc19a247378b4e932bf" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:58.040989  7668 raft_consensus.cc:3060] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.058264  7816 raft_consensus.cc:2468] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:58.059295  8082 consensus_queue.cc:1048] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.061990  7869 tablet_bootstrap.cc:654] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.058784  7864 raft_consensus.cc:359] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.063148  7864 raft_consensus.cc:385] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.063583  7864 raft_consensus.cc:740] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.066078  7864 consensus_queue.cc:260] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.064981  7668 raft_consensus.cc:2468] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:58.071997  7490 catalog_manager.cc:5697] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.069792  7489 catalog_manager.cc:5697] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.063161  7558 leader_election.cc:304] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:58.075903  8117 raft_consensus.cc:2804] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.076730  8117 raft_consensus.cc:697] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:58.083195  7864 ts_tablet_manager.cc:1434] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:00:58.084851  7864 tablet_bootstrap.cc:492] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:58.102684  8117 consensus_queue.cc:237] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.125854  8176 consensus_queue.cc:1048] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.132593  7862 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:58.133193  7862 ts_tablet_manager.cc:1403] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.263s	user 0.016s	sys 0.016s
I20260709 13:00:58.134635  8176 raft_consensus.cc:493] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.135962  8176 raft_consensus.cc:515] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.136865  7862 raft_consensus.cc:359] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.138188  8176 leader_election.cc:290] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:58.136423  7864 tablet_bootstrap.cc:654] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.140213  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:58.141023  7742 raft_consensus.cc:2468] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:58.141855  7862 raft_consensus.cc:385] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.142226  7862 raft_consensus.cc:740] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.142928  7862 consensus_queue.cc:260] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.143580  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:58.144976  7862 ts_tablet_manager.cc:1434] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:00:58.146159  7557 leader_election.cc:304] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:58.148290  7862 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:58.147579  8115 raft_consensus.cc:2804] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.149645  8115 raft_consensus.cc:493] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.150050  8115 raft_consensus.cc:3060] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:58.153373  7557 leader_election.cc:343] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.158298  8174 raft_consensus.cc:493] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:00:58.158936  8175 consensus_queue.cc:1048] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.158844  8174 raft_consensus.cc:515] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.159255  7862 tablet_bootstrap.cc:654] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.161242  8174 leader_election.cc:290] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:58.162863  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:58.163623  7815 raft_consensus.cc:2468] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
I20260709 13:00:58.165055  7707 leader_election.cc:304] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:58.165939  8174 raft_consensus.cc:2804] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:58.166338  8174 raft_consensus.cc:493] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:00:58.166720  8174 raft_consensus.cc:3060] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.168000  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:58.168898  7668 raft_consensus.cc:2393] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81c129769e24f019dc9045ce8c09771 in current term 2: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:00:58.174824  8174 raft_consensus.cc:515] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.187077  7865 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:58.187666  7865 ts_tablet_manager.cc:1403] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.226s	user 0.022s	sys 0.019s
I20260709 13:00:58.210408  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:58.210438  7865 raft_consensus.cc:359] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.211548  7865 raft_consensus.cc:385] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.211782  7666 raft_consensus.cc:2393] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b81c129769e24f019dc9045ce8c09771 in current term 2: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:00:58.211875  7865 raft_consensus.cc:740] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.212944  7865 consensus_queue.cc:260] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.216240  8171 raft_consensus.cc:493] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.221905  7865 ts_tablet_manager.cc:1434] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:00:58.222682  7865 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:58.227461  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1604dbc6aa844378800263c852a90568" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:58.224325  8171 raft_consensus.cc:515] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.229918  8179 raft_consensus.cc:493] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.230459  8179 raft_consensus.cc:515] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.231349  8171 leader_election.cc:290] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:58.233934  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:58.234717  7740 raft_consensus.cc:2468] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:58.235322  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:58.235932  7780 leader_election.cc:304] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:58.236941  8171 raft_consensus.cc:2804] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:58.237450  7782 leader_election.cc:343] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.237432  7869 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:58.239310  7869 ts_tablet_manager.cc:1403] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.222s	user 0.012s	sys 0.014s
I20260709 13:00:58.237411  8171 raft_consensus.cc:493] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.241907  8171 raft_consensus.cc:3060] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.243250  8179 leader_election.cc:290] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:58.244293  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:58.247229  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:58.247948  7740 raft_consensus.cc:2468] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:58.249814  7862 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:58.250375  7862 ts_tablet_manager.cc:1403] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.102s	user 0.035s	sys 0.024s
I20260709 13:00:58.221312  8174 leader_election.cc:290] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:58.249487  7632 leader_election.cc:304] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:58.255257  7869 raft_consensus.cc:359] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.257622  7865 tablet_bootstrap.cc:654] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.258318  7869 raft_consensus.cc:385] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.259052  7869 raft_consensus.cc:740] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.260051  7869 consensus_queue.cc:260] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.241432  7815 raft_consensus.cc:2468] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
I20260709 13:00:58.264922  7869 ts_tablet_manager.cc:1434] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:00:58.266181  7869 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:58.267697  7864 tablet_bootstrap.cc:492] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:58.268342  7864 ts_tablet_manager.cc:1403] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.184s	user 0.013s	sys 0.018s
I20260709 13:00:58.266064  8179 raft_consensus.cc:2804] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.271870  8179 raft_consensus.cc:493] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.272015  7707 leader_election.cc:304] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:58.263504  8115 raft_consensus.cc:515] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.272300  8179 raft_consensus.cc:3060] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.272866  8171 raft_consensus.cc:515] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.273497  7594 raft_consensus.cc:2393] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 1: Already voted for candidate 80af46fc024041de81a638d29912c8a3 in this term.
I20260709 13:00:58.274544  8115 leader_election.cc:290] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:58.274922  8171 leader_election.cc:290] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:58.279263  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:58.279919  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:58.280544  7740 raft_consensus.cc:3060] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.281014  8174 raft_consensus.cc:2804] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.284525  8174 raft_consensus.cc:697] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:00:58.285446  8174 consensus_queue.cc:237] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.281255  7490 catalog_manager.cc:5697] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.290169  7862 raft_consensus.cc:359] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.290972  7862 raft_consensus.cc:385] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.291257  7862 raft_consensus.cc:740] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.293658  7864 raft_consensus.cc:359] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.294730  7864 raft_consensus.cc:385] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.295003  7864 raft_consensus.cc:740] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.296695  7864 consensus_queue.cc:260] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.299211  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:58.299854  7739 raft_consensus.cc:3060] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.300417  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:58.301108  7869 tablet_bootstrap.cc:654] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:58.302640  7782 leader_election.cc:343] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.291949  7862 consensus_queue.cc:260] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.306945  7740 raft_consensus.cc:2468] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:58.309731  7862 ts_tablet_manager.cc:1434] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:00:58.310050  7557 leader_election.cc:304] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:58.311208  7971 raft_consensus.cc:2804] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.311923  7739 raft_consensus.cc:2468] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:58.312034  7971 raft_consensus.cc:697] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:58.313119  7971 consensus_queue.cc:237] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.282806  8179 raft_consensus.cc:515] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.315685  7668 raft_consensus.cc:2393] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:00:58.316758  7780 leader_election.cc:304] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:58.317636  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:58.317941  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:58.318647  8114 raft_consensus.cc:2804] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.319173  8114 raft_consensus.cc:697] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:58.320114  8179 leader_election.cc:290] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:58.320022  8114 consensus_queue.cc:237] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.310774  7862 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:58.344586  7865 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:58.318657  7739 raft_consensus.cc:2393] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 1: Already voted for candidate 80af46fc024041de81a638d29912c8a3 in this term.
I20260709 13:00:58.348199  7865 ts_tablet_manager.cc:1403] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.002s
I20260709 13:00:58.346084  7862 tablet_bootstrap.cc:654] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.348955  7632 leader_election.cc:304] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:58.349792  8179 raft_consensus.cc:2749] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.363673  7488 catalog_manager.cc:5697] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 1 to 2, leader changed from 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196) to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.366485  7862 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:58.367014  7862 ts_tablet_manager.cc:1403] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.006s
I20260709 13:00:58.370950  7911 raft_consensus.cc:493] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.371501  7911 raft_consensus.cc:515] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.333329  7864 ts_tablet_manager.cc:1434] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.001s
I20260709 13:00:58.374794  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a49f753e0c24447b801656d29b78649" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:58.376308  7864 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
W20260709 13:00:58.376998  7708 leader_election.cc:343] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.377748  7911 leader_election.cc:290] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:58.377884  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a49f753e0c24447b801656d29b78649" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:58.374810  7865 raft_consensus.cc:359] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.379313  7865 raft_consensus.cc:385] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.369743  7862 raft_consensus.cc:359] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:00:58.380313  7707 leader_election.cc:343] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.380774  7707 leader_election.cc:304] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:58.379940  7862 raft_consensus.cc:385] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.382077  7862 raft_consensus.cc:740] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.382344  7911 raft_consensus.cc:2749] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.383231  7862 consensus_queue.cc:260] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.379601  7865 raft_consensus.cc:740] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.386978  7865 consensus_queue.cc:260] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.388778  7862 ts_tablet_manager.cc:1434] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:00:58.390177  7862 tablet_bootstrap.cc:492] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:58.390759  7490 catalog_manager.cc:5697] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.396338  7862 tablet_bootstrap.cc:654] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.407253  7864 tablet_bootstrap.cc:654] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.410979  7862 tablet_bootstrap.cc:492] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:58.411620  7862 ts_tablet_manager.cc:1403] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.002s
I20260709 13:00:58.415226  7862 raft_consensus.cc:359] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.416371  7862 raft_consensus.cc:385] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.416662  7862 raft_consensus.cc:740] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.417543  7862 consensus_queue.cc:260] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.419750  7862 ts_tablet_manager.cc:1434] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:00:58.420622  7862 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:58.425205  7864 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:58.425719  7864 ts_tablet_manager.cc:1403] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.001s
I20260709 13:00:58.426512  7862 tablet_bootstrap.cc:654] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.429347  7864 raft_consensus.cc:359] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.430192  7864 raft_consensus.cc:385] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.430436  7864 raft_consensus.cc:740] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.431104  7864 consensus_queue.cc:260] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.433193  7864 ts_tablet_manager.cc:1434] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:58.433010  7489 catalog_manager.cc:5697] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.437651  7864 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:58.442893  7865 ts_tablet_manager.cc:1434] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.002s
I20260709 13:00:58.444123  7865 tablet_bootstrap.cc:492] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:58.446161  7869 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:58.446692  7869 ts_tablet_manager.cc:1403] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.181s	user 0.016s	sys 0.007s
I20260709 13:00:58.449958  7865 tablet_bootstrap.cc:654] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.449605  7869 raft_consensus.cc:359] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.450356  7869 raft_consensus.cc:385] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.450686  7869 raft_consensus.cc:740] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.451495  7869 consensus_queue.cc:260] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.454802  7869 ts_tablet_manager.cc:1434] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:58.455737  7869 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:58.466543  7864 tablet_bootstrap.cc:654] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.469717  7869 tablet_bootstrap.cc:654] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.483050  7864 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:58.483389  7865 tablet_bootstrap.cc:492] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:58.483590  7864 ts_tablet_manager.cc:1403] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.002s
I20260709 13:00:58.483889  7865 ts_tablet_manager.cc:1403] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:00:58.486483  8179 consensus_queue.cc:1048] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:58.486914  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:58.487023  7865 raft_consensus.cc:359] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.487821  7865 raft_consensus.cc:385] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.488091  7865 raft_consensus.cc:740] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.488160  7864 raft_consensus.cc:359] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.488848  7864 raft_consensus.cc:385] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.488794  7865 consensus_queue.cc:260] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.489228  7864 raft_consensus.cc:740] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.490866  7864 consensus_queue.cc:260] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.491343  7865 ts_tablet_manager.cc:1434] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:58.492268  7865 tablet_bootstrap.cc:492] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:58.495466  7864 ts_tablet_manager.cc:1434] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:00:58.496699  7864 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:58.501036  7865 tablet_bootstrap.cc:654] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.506665  7864 tablet_bootstrap.cc:654] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.514550  8115 raft_consensus.cc:493] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.515179  8115 raft_consensus.cc:515] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.518646  8115 leader_election.cc:290] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:58.520970  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:58.521871  7742 raft_consensus.cc:2468] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:58.524626  7865 tablet_bootstrap.cc:492] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:58.525080  7557 leader_election.cc:304] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:58.525367  7865 ts_tablet_manager.cc:1403] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.002s
I20260709 13:00:58.527485  8117 raft_consensus.cc:2804] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.528220  8117 raft_consensus.cc:493] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.529050  8117 raft_consensus.cc:3060] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.533106  8170 raft_consensus.cc:493] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.533902  8170 raft_consensus.cc:515] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.538247  8170 leader_election.cc:290] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:58.539268  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a49f753e0c24447b801656d29b78649" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:58.541636  7782 leader_election.cc:343] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.547997  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:58.549023  7668 raft_consensus.cc:2468] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:58.553660  7865 raft_consensus.cc:359] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.558305  7865 raft_consensus.cc:385] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.558749  7865 raft_consensus.cc:740] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.561385  8115 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.565814  8115 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.565873  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a49f753e0c24447b801656d29b78649" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:58.568503  7742 raft_consensus.cc:2468] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:58.573354  8179 consensus_queue.cc:1048] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.575675  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:00:58.577169  7557 leader_election.cc:343] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.578536  8115 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:58.579097  7865 consensus_queue.cc:260] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.559803  8117 raft_consensus.cc:515] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.583899  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:58.584812  7666 raft_consensus.cc:3060] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.591423  7865 ts_tablet_manager.cc:1434] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:00:58.602429  7865 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:58.610064  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:58.600651  8117 leader_election.cc:290] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:58.632017  7816 raft_consensus.cc:2468] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:58.627331  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:58.642019  7741 raft_consensus.cc:3060] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.616133  7666 raft_consensus.cc:2468] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:58.638494  7780 leader_election.cc:304] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:58.646466  7557 leader_election.cc:304] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:58.649118  8117 raft_consensus.cc:2804] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.649914  8117 raft_consensus.cc:697] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:58.634984  8174 raft_consensus.cc:493] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.651605  8117 consensus_queue.cc:237] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.652132  8174 raft_consensus.cc:515] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.654759  8174 leader_election.cc:290] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:58.656213  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:58.657544  7708 leader_election.cc:343] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.657582  8115 consensus_queue.cc:1048] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.659000  8170 raft_consensus.cc:2804] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.659425  8170 raft_consensus.cc:493] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.659749  8170 raft_consensus.cc:3060] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.667809  7865 tablet_bootstrap.cc:654] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.669942  7971 consensus_queue.cc:1048] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.676034  7558 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:58.677583  8115 raft_consensus.cc:2804] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.678107  8115 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.678741  8115 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.688344  8115 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.689884  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:58.698879  8115 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:58.699671  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:58.700120  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:58.700575  7816 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:58.701844  7557 leader_election.cc:343] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:58.710904  7706 leader_election.cc:343] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.711412  7706 leader_election.cc:304] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:58.712180  7911 raft_consensus.cc:2749] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.707226  7741 raft_consensus.cc:2468] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:58.714386  7667 raft_consensus.cc:1275] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:58.723242  7911 consensus_queue.cc:1048] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.713590  7864 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:58.732141  7864 ts_tablet_manager.cc:1403] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.236s	user 0.033s	sys 0.037s
I20260709 13:00:58.760746  7869 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:58.761830  7869 ts_tablet_manager.cc:1403] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.306s	user 0.077s	sys 0.090s
I20260709 13:00:58.773486  7999 consensus_queue.cc:1048] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.774415  8174 raft_consensus.cc:493] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.774935  8174 raft_consensus.cc:515] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.775815  7862 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:58.776176  7816 raft_consensus.cc:2468] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:00:58.776363  7862 ts_tablet_manager.cc:1403] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.356s	user 0.031s	sys 0.099s
I20260709 13:00:58.777007  8174 leader_election.cc:290] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:58.777050  8172 raft_consensus.cc:493] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.779201  7862 raft_consensus.cc:359] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.779954  7862 raft_consensus.cc:385] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.779884  8172 raft_consensus.cc:515] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.780387  7862 raft_consensus.cc:740] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.781183  7862 consensus_queue.cc:260] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:58.783844  7869 raft_consensus.cc:359] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.784686  7862 ts_tablet_manager.cc:1434] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:00:58.784686  7869 raft_consensus.cc:385] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.785967  7869 raft_consensus.cc:740] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.786201  7862 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:58.786646  7869 consensus_queue.cc:260] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.787261  8172 leader_election.cc:290] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:58.790655  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba55b3f6e424ec7a65fc13489c43a43" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:58.796429  7869 ts_tablet_manager.cc:1434] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:00:58.797928  7869 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:58.804062  8174 raft_consensus.cc:493] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.809511  7707 leader_election.cc:343] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.810734  8174 raft_consensus.cc:515] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.813232  7964 raft_consensus.cc:493] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.814172  7964 raft_consensus.cc:515] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:58.815487  8174 leader_election.cc:290] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:58.816412  8174 raft_consensus.cc:493] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.816108  7864 raft_consensus.cc:359] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.816622  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:58.817081  7864 raft_consensus.cc:385] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.816879  8174 raft_consensus.cc:515] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
W20260709 13:00:58.818305  7706 leader_election.cc:343] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.818849  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:58.820608  7964 leader_election.cc:290] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
W20260709 13:00:58.821992  7707 leader_election.cc:343] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.822983  7707 leader_election.cc:304] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:58.820464  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:58.824311  7742 raft_consensus.cc:2468] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:58.824517  7911 raft_consensus.cc:2749] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.826148  8170 raft_consensus.cc:515] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.833264  7632 leader_election.cc:304] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:58.833904  7862 tablet_bootstrap.cc:654] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.834453  7964 raft_consensus.cc:2804] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.834995  7964 raft_consensus.cc:493] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.835438  7964 raft_consensus.cc:3060] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.817447  7864 raft_consensus.cc:740] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.829564  7491 catalog_manager.cc:5697] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.839500  8170 leader_election.cc:290] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:58.844578  7865 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:58.845464  7865 ts_tablet_manager.cc:1403] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.243s	user 0.032s	sys 0.040s
W20260709 13:00:58.847445  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 72522.6us
I20260709 13:00:58.847013  7864 consensus_queue.cc:260] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.848572  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba55b3f6e424ec7a65fc13489c43a43" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:58.853385  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e53656f344150a25cb441648dd489" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:58.857196  7666 raft_consensus.cc:2468] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:58.860342  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a49f753e0c24447b801656d29b78649" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:58.858080  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a49f753e0c24447b801656d29b78649" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:58.861069  7740 raft_consensus.cc:3060] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.861150  7594 raft_consensus.cc:3060] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.853726  7558 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:58.863560  8215 raft_consensus.cc:2804] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.864133  8215 raft_consensus.cc:697] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:58.871644  7864 ts_tablet_manager.cc:1434] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.139s	user 0.007s	sys 0.002s
I20260709 13:00:58.873275  7864 tablet_bootstrap.cc:492] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:58.880764  7594 raft_consensus.cc:2468] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:58.864959  8215 consensus_queue.cc:237] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.885465  8115 consensus_queue.cc:1048] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.888805  8170 raft_consensus.cc:493] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.889360  8170 raft_consensus.cc:515] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.889424  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e53656f344150a25cb441648dd489" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:58.891759  7780 leader_election.cc:304] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:00:58.892432  7869 tablet_bootstrap.cc:654] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.894619  8216 raft_consensus.cc:2804] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.894860  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:58.895118  8216 raft_consensus.cc:493] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.896356  8216 raft_consensus.cc:3060] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.902020  7742 raft_consensus.cc:2468] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:58.907927  8170 leader_election.cc:290] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:00:58.897457  7708 leader_election.cc:343] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.909793  7708 leader_election.cc:304] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:58.911656  7782 leader_election.cc:304] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:00:58.915128  8174 leader_election.cc:290] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:58.915839  8174 raft_consensus.cc:2749] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.916054  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce87ae60b2104f579d001664481e7aa8" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:58.913319  8171 raft_consensus.cc:2804] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.916473  7813 raft_consensus.cc:1275] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:58.917062  8171 raft_consensus.cc:697] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:58.918083  8171 consensus_queue.cc:237] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:58.926795  7862 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:58.927564  7862 ts_tablet_manager.cc:1403] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.006s
I20260709 13:00:58.935441  7865 raft_consensus.cc:359] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.936810  7865 raft_consensus.cc:385] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.937186  7865 raft_consensus.cc:740] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.938898  7865 consensus_queue.cc:260] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:58.915235  7964 raft_consensus.cc:515] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
W20260709 13:00:58.950351  7633 leader_election.cc:343] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:58.953897  7782 leader_election.cc:343] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.944572  8219 consensus_queue.cc:1048] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 13:00:58.958467  7782 consensus_peers.cc:597] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:58.947263  7740 raft_consensus.cc:2468] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:58.972122  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce87ae60b2104f579d001664481e7aa8" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:58.974004  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:58.975209  7864 tablet_bootstrap.cc:654] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.976662  7964 leader_election.cc:290] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:58.968537  8175 consensus_queue.cc:1048] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:00:58.981745  8176 consensus_queue.cc:1048] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:58.987239  7708 leader_election.cc:343] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.003587  8216 raft_consensus.cc:515] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.023499  7862 raft_consensus.cc:359] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.024724  7862 raft_consensus.cc:385] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.025074  7862 raft_consensus.cc:740] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
W20260709 13:00:59.032311  7780 leader_election.cc:343] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.033013  7780 leader_election.cc:304] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:59.034070  7865 ts_tablet_manager.cc:1434] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.188s	user 0.027s	sys 0.030s
I20260709 13:00:59.035734  7865 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:59.038427  7862 consensus_queue.cc:260] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.054281  8216 leader_election.cc:290] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:59.054452  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e53656f344150a25cb441648dd489" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:59.054792  8174 raft_consensus.cc:493] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.055172  7669 raft_consensus.cc:3060] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.056051  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:59.048872  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:59.058956  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:59.060105  7869 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:59.060648  7869 ts_tablet_manager.cc:1403] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.263s	user 0.009s	sys 0.013s
I20260709 13:00:59.058791  7739 raft_consensus.cc:3060] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.067319  7864 tablet_bootstrap.cc:492] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:59.067893  7864 ts_tablet_manager.cc:1403] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.014s
I20260709 13:00:59.068827  7669 raft_consensus.cc:2468] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:59.063638  7869 raft_consensus.cc:359] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.075040  7869 raft_consensus.cc:385] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.075413  7869 raft_consensus.cc:740] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.077507  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e53656f344150a25cb441648dd489" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:59.078269  7741 raft_consensus.cc:3060] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.078465  7869 consensus_queue.cc:260] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.044005  8225 raft_consensus.cc:2749] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.074290  8172 consensus_queue.cc:1048] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:59.077745  7706 leader_election.cc:343] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:59.070618  7633 leader_election.cc:343] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.080493  7706 leader_election.cc:304] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:59.083806  7911 raft_consensus.cc:2749] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.085650  7869 ts_tablet_manager.cc:1434] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:00:59.086833  7869 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:59.087666  7862 ts_tablet_manager.cc:1434] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.160s	user 0.006s	sys 0.004s
I20260709 13:00:59.086561  8174 raft_consensus.cc:515] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.100385  7862 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:59.107399  7864 raft_consensus.cc:359] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.108942  7864 raft_consensus.cc:385] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.109225  7864 raft_consensus.cc:740] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.109934  7864 consensus_queue.cc:260] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.125088  8174 leader_election.cc:290] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:59.133730  7999 consensus_queue.cc:1048] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:59.137642  7862 tablet_bootstrap.cc:654] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.140533  7864 ts_tablet_manager.cc:1434] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.003s
I20260709 13:00:59.150179  7864 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:59.153499  7780 leader_election.cc:304] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:00:59.157732  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:59.164049  7489 catalog_manager.cc:5697] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.134343  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:00:59.172927  7707 leader_election.cc:343] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:59.178761  7708 leader_election.cc:343] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.179243  7708 leader_election.cc:304] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:59.179641  7739 raft_consensus.cc:2468] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:59.180914  8222 raft_consensus.cc:2749] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.189200  8216 raft_consensus.cc:493] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.189991  8216 raft_consensus.cc:515] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.192274  8216 leader_election.cc:290] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:59.210564  8223 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.211254  8223 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:59.219167  7632 leader_election.cc:304] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7
I20260709 13:00:59.220343  7865 tablet_bootstrap.cc:654] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.221632  7964 raft_consensus.cc:2804] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.223203  7964 raft_consensus.cc:697] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:59.224370  7964 consensus_queue.cc:237] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.228181  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:59.229192  7817 raft_consensus.cc:2393] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 1: Already voted for candidate 80af46fc024041de81a638d29912c8a3 in this term.
I20260709 13:00:59.232403  7741 raft_consensus.cc:2468] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:59.234329  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:59.234880  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:59.236812  7634 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:59.238297  8228 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.242835  7864 tablet_bootstrap.cc:654] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.249133  7488 catalog_manager.cc:5697] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.256878  8223 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:59.174539  8171 raft_consensus.cc:2804] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.287212  7869 tablet_bootstrap.cc:654] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.307775  8171 raft_consensus.cc:697] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:59.309646  8176 consensus_queue.cc:1048] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:00:59.376418  7862 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:59.377350  7862 ts_tablet_manager.cc:1403] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.278s	user 0.016s	sys 0.018s
I20260709 13:00:59.346617  8171 consensus_queue.cc:237] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.357088  8228 raft_consensus.cc:2749] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.391489  7864 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:59.392119  7864 ts_tablet_manager.cc:1403] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.250s	user 0.017s	sys 0.022s
I20260709 13:00:59.395712  7864 raft_consensus.cc:359] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.385037  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:59.401841  7742 raft_consensus.cc:2393] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:00:59.405242  7862 raft_consensus.cc:359] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.413647  7862 raft_consensus.cc:385] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.414458  7862 raft_consensus.cc:740] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.413193  7864 raft_consensus.cc:385] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.416162  7864 raft_consensus.cc:740] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.417105  7864 consensus_queue.cc:260] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.422183  7864 ts_tablet_manager.cc:1434] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:00:59.424188  7864 tablet_bootstrap.cc:492] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:59.418268  7862 consensus_queue.cc:260] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.426708  7491 catalog_manager.cc:5697] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.431911  7862 ts_tablet_manager.cc:1434] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:00:59.423982  7780 leader_election.cc:304] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:59.433311  7862 tablet_bootstrap.cc:492] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:59.435848  8224 raft_consensus.cc:3060] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.441129  7862 tablet_bootstrap.cc:654] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.433233  7864 tablet_bootstrap.cc:654] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:59.448372  7557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46081, user_credentials={real_user=slave}} blocked reactor thread for 131824us
I20260709 13:00:59.450510  8175 consensus_queue.cc:1048] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.466024  7865 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:59.466562  7865 ts_tablet_manager.cc:1403] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.431s	user 0.018s	sys 0.033s
I20260709 13:00:59.470189  7865 raft_consensus.cc:359] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:59.470943  7865 raft_consensus.cc:385] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.471223  7865 raft_consensus.cc:740] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.482582  7869 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:59.483649  7869 ts_tablet_manager.cc:1403] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.397s	user 0.028s	sys 0.006s
I20260709 13:00:59.484150  8221 raft_consensus.cc:493] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.484673  8221 raft_consensus.cc:515] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.485610  7865 consensus_queue.cc:260] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:59.486824  8221 leader_election.cc:290] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:00:59.488801  7865 ts_tablet_manager.cc:1434] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:00:59.490025  7865 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:59.490239  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:00:59.492224  7708 leader_election.cc:343] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.493248  8225 consensus_queue.cc:1048] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:59.496913  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:59.493942  7964 raft_consensus.cc:493] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.497869  7964 raft_consensus.cc:515] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:59.499449  7865 tablet_bootstrap.cc:654] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.502132  7964 leader_election.cc:290] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:00:59.531409  7706 leader_election.cc:343] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.537842  7706 leader_election.cc:304] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:00:59.545173  7864 tablet_bootstrap.cc:492] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:59.545635  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce87ae60b2104f579d001664481e7aa8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:59.547940  7864 ts_tablet_manager.cc:1403] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.002s
I20260709 13:00:59.549647  7869 raft_consensus.cc:359] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.550549  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce87ae60b2104f579d001664481e7aa8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:59.550858  7869 raft_consensus.cc:385] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.551141  7869 raft_consensus.cc:740] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.551414  8115 raft_consensus.cc:493] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.551932  8115 raft_consensus.cc:515] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.553735  7813 raft_consensus.cc:2468] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:00:59.554150  8115 leader_election.cc:290] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:59.559758  7869 consensus_queue.cc:260] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.568288  7862 tablet_bootstrap.cc:492] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:59.569828  7862 ts_tablet_manager.cc:1403] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.000s
W20260709 13:00:59.584177  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:59.565908  7911 raft_consensus.cc:2749] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:59.565832  7634 leader_election.cc:343] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.599813  7864 raft_consensus.cc:359] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.601491  7864 raft_consensus.cc:385] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.603950  7864 raft_consensus.cc:740] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.609617  7864 consensus_queue.cc:260] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.611053  7869 ts_tablet_manager.cc:1434] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.124s	user 0.006s	sys 0.005s
I20260709 13:00:59.612601  7869 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:59.622795  7864 ts_tablet_manager.cc:1434] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.002s
I20260709 13:00:59.623963  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:00:59.600060  7633 leader_election.cc:304] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:59.633180  7491 catalog_manager.cc:5697] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.593962  8224 raft_consensus.cc:2749] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:59.633114  7633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 55729.3us
I20260709 13:00:59.635962  8228 raft_consensus.cc:2804] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.660048  8242 raft_consensus.cc:493] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.661046  7557 leader_election.cc:343] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.660740  8242 raft_consensus.cc:515] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.663197  8242 leader_election.cc:290] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:59.663324  7862 raft_consensus.cc:359] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.664041  7862 raft_consensus.cc:385] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.664312  7862 raft_consensus.cc:740] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.658278  8175 consensus_queue.cc:1048] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:00:59.668439  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:59.669188  7737 raft_consensus.cc:2468] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:00:59.671222  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:59.656268  8228 raft_consensus.cc:493] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.674450  8228 raft_consensus.cc:3060] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.680835  7869 tablet_bootstrap.cc:654] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.693882  8243 consensus_queue.cc:1048] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:59.700049  7862 consensus_queue.cc:260] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.703511  7862 ts_tablet_manager.cc:1434] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.131s	user 0.005s	sys 0.003s
I20260709 13:00:59.715672  8228 raft_consensus.cc:515] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:59.717921  7865 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:00:59.725119  7865 ts_tablet_manager.cc:1403] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.005s
I20260709 13:00:59.728664  7862 tablet_bootstrap.cc:492] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:59.733741  7865 raft_consensus.cc:359] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.734762  7865 raft_consensus.cc:385] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.728746  7557 leader_election.cc:304] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:59.735740  7865 raft_consensus.cc:740] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.737121  7865 consensus_queue.cc:260] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.741803  7865 ts_tablet_manager.cc:1434] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:00:59.745692  7865 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:00:59.746807  7999 raft_consensus.cc:2804] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.748308  7999 raft_consensus.cc:493] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.748816  7999 raft_consensus.cc:3060] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.756611  7999 raft_consensus.cc:515] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.761941  7999 leader_election.cc:290] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:59.768819  7864 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:00:59.766185  7862 tablet_bootstrap.cc:654] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.781262  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:00:59.782063  7668 raft_consensus.cc:3060] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.788039  7862 tablet_bootstrap.cc:492] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:00:59.788882  7862 ts_tablet_manager.cc:1403] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.006s
I20260709 13:00:59.790889  7865 tablet_bootstrap.cc:654] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.794858  7864 tablet_bootstrap.cc:654] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:59.798688  7707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 107617us
I20260709 13:00:59.800659  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:59.801770  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce87ae60b2104f579d001664481e7aa8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:00:59.802363  8224 raft_consensus.cc:493] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.802996  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce87ae60b2104f579d001664481e7aa8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:00:59.803146  8224 raft_consensus.cc:515] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.803857  7816 raft_consensus.cc:3060] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.805917  7668 raft_consensus.cc:2468] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
W20260709 13:00:59.803053  7634 leader_election.cc:343] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.808693  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba55b3f6e424ec7a65fc13489c43a43" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:00:59.809165  7557 leader_election.cc:304] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
W20260709 13:00:59.810194  7782 leader_election.cc:343] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.812179  8257 raft_consensus.cc:2804] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.812712  8257 raft_consensus.cc:697] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:00:59.813545  7869 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:00:59.814359  7869 ts_tablet_manager.cc:1403] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.202s	user 0.020s	sys 0.012s
I20260709 13:00:59.814577  8224 leader_election.cc:290] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:59.816859  7816 raft_consensus.cc:2468] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:00:59.813545  8257 consensus_queue.cc:237] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:00:59.817056  7869 raft_consensus.cc:359] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:59.817919  7869 raft_consensus.cc:385] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.800973  7862 raft_consensus.cc:359] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.821046  7862 raft_consensus.cc:385] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.821671  7862 raft_consensus.cc:740] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.818220  7869 raft_consensus.cc:740] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.829960  7557 leader_election.cc:304] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:00:59.837077  7869 consensus_queue.cc:260] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:59.838729  7862 consensus_queue.cc:260] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.840147  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba55b3f6e424ec7a65fc13489c43a43" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:59.840467  7862 ts_tablet_manager.cc:1434] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:00:59.840845  7739 raft_consensus.cc:2468] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:59.841360  7862 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:00:59.843231  7780 leader_election.cc:304] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:00:59.841362  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:59.800735  8228 leader_election.cc:290] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:00:59.863495  7864 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:00:59.867489  7864 ts_tablet_manager.cc:1403] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.016s
I20260709 13:00:59.841981  8171 raft_consensus.cc:493] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.874552  7869 ts_tablet_manager.cc:1434] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:00:59.866191  8224 raft_consensus.cc:2804] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.883713  8224 raft_consensus.cc:493] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.884119  8224 raft_consensus.cc:3060] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.884709  7869 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:00:59.895233  8194 raft_consensus.cc:2749] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.871428  7743 raft_consensus.cc:3060] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.895303  8224 raft_consensus.cc:515] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.916256  7593 raft_consensus.cc:3060] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.876353  7633 leader_election.cc:304] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
W20260709 13:00:59.917513  7633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 46458.8us
I20260709 13:00:59.896436  8171 raft_consensus.cc:515] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.919531  7964 raft_consensus.cc:2804] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.919986  7964 raft_consensus.cc:697] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:00:59.920748  7964 consensus_queue.cc:237] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:00:59.925153  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:00:59.926760  7780 leader_election.cc:343] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.910353  8228 consensus_queue.cc:1048] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:00:59.938359  7869 tablet_bootstrap.cc:654] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.920755  8171 leader_election.cc:290] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:00:59.942972  7735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba55b3f6e424ec7a65fc13489c43a43" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:00:59.943658  7735 raft_consensus.cc:3060] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.937812  8254 raft_consensus.cc:493] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.945469  8254 raft_consensus.cc:515] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:00:59.948436  8254 leader_election.cc:290] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:00:59.938086  8223 consensus_queue.cc:1048] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:00:59.949694  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c78d34c2d104e6596872bdbc02005b7" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:00:59.950997  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c78d34c2d104e6596872bdbc02005b7" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:00:59.951462  7707 leader_election.cc:343] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:59.953644  7706 leader_election.cc:343] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:59.954066  7706 leader_election.cc:304] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:00:59.965741  7911 raft_consensus.cc:2749] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:59.940016  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:00:59.966451  7736 raft_consensus.cc:2468] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:00:59.963805  7862 tablet_bootstrap.cc:654] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:59.974068  7780 leader_election.cc:304] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:00:59.974705  7864 raft_consensus.cc:359] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.975762  7864 raft_consensus.cc:385] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:59.975960  8171 raft_consensus.cc:2804] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:59.976181  7864 raft_consensus.cc:740] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:00:59.976467  8171 raft_consensus.cc:493] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.982227  8171 raft_consensus.cc:3060] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:59.984756  7735 raft_consensus.cc:2468] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:00:59.986179  7780 leader_election.cc:304] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:00:59.987298  8170 raft_consensus.cc:2804] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:59.988013  8170 raft_consensus.cc:697] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:00:59.988890  8170 consensus_queue.cc:237] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:00:59.996829  7864 consensus_queue.cc:260] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:00.025017  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba55b3f6e424ec7a65fc13489c43a43" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:00.025876  7865 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:00.026607  7865 ts_tablet_manager.cc:1403] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.281s	user 0.031s	sys 0.010s
W20260709 13:01:00.028294  7782 leader_election.cc:343] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.029019  8114 consensus_queue.cc:1048] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.015584  8224 leader_election.cc:290] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:00.030400  7865 raft_consensus.cc:359] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:00.031481  7865 raft_consensus.cc:385] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.031855  7865 raft_consensus.cc:740] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.032877  7865 consensus_queue.cc:260] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:00.035765  7865 ts_tablet_manager.cc:1434] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:00.037207  7865 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:01:00.040786  8114 raft_consensus.cc:493] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.041375  8114 raft_consensus.cc:515] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:00.051868  7865 tablet_bootstrap.cc:654] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.051267  7735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:00.053416  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
W20260709 13:01:00.055178  7782 leader_election.cc:343] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.052727  7735 raft_consensus.cc:2468] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:01:00.059592  7780 leader_election.cc:304] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:00.061209  8224 raft_consensus.cc:2804] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.061719  8224 raft_consensus.cc:493] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.062561  8224 raft_consensus.cc:3060] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.068809  7743 raft_consensus.cc:2468] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:01:00.072142  8243 consensus_queue.cc:1048] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:00.073818  7489 catalog_manager.cc:5697] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.124010  8114 leader_election.cc:290] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:00.159271  7864 ts_tablet_manager.cc:1434] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.291s	user 0.008s	sys 0.002s
I20260709 13:01:00.160744  7864 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:01:00.113003  8171 raft_consensus.cc:515] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:00.370826  7865 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:00.358247  8171 leader_election.cc:290] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:00.371810  7865 ts_tablet_manager.cc:1403] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.335s	user 0.036s	sys 0.021s
I20260709 13:01:00.384148  7862 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:01:00.384697  7862 ts_tablet_manager.cc:1403] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.544s	user 0.035s	sys 0.058s
W20260709 13:01:00.385715  8272 log.cc:927] Time spent T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:01:00.419999  7864 tablet_bootstrap.cc:654] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.421116  7865 raft_consensus.cc:359] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:00.421905  7865 raft_consensus.cc:385] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.422166  7865 raft_consensus.cc:740] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.410761  8175 raft_consensus.cc:493] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.422840  7865 consensus_queue.cc:260] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:00.423063  8175 raft_consensus.cc:515] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:00.425895  8281 raft_consensus.cc:493] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.426438  8281 raft_consensus.cc:515] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:00.428515  8281 leader_election.cc:290] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:00.425484  7865 ts_tablet_manager.cc:1434] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:01:00.432209  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:00.436411  8224 raft_consensus.cc:515] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:00.444128  8224 leader_election.cc:290] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:01:00.445428  8285 log.cc:927] Time spent T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:01:00.450680  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
W20260709 13:01:00.453603  7782 leader_election.cc:343] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.455359  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:00.456123  7741 raft_consensus.cc:3060] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.459872  8221 raft_consensus.cc:493] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.460494  8221 raft_consensus.cc:515] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:00.464275  7862 raft_consensus.cc:359] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:00.466442  7862 raft_consensus.cc:385] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.467056  7862 raft_consensus.cc:740] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.467861  7862 consensus_queue.cc:260] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:00.468665  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7723aa6994ac4a65710463c633f66" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:00.470889  7632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 343202us
W20260709 13:01:00.471015  7634 leader_election.cc:343] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.476235  8175 leader_election.cc:290] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:01:00.480764  7706 leader_election.cc:343] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.463439  8221 leader_election.cc:290] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:00.487296  7594 raft_consensus.cc:3060] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.488351  7862 ts_tablet_manager.cc:1434] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.001s
I20260709 13:01:00.489423  7862 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
I20260709 13:01:00.491556  7865 tablet_bootstrap.cc:492] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:01:00.493598  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:00.498073  7869 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:00.498716  7869 ts_tablet_manager.cc:1403] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.614s	user 0.033s	sys 0.021s
I20260709 13:01:00.519037  7869 raft_consensus.cc:359] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:00.520248  7869 raft_consensus.cc:385] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.520644  7869 raft_consensus.cc:740] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.524904  7862 tablet_bootstrap.cc:654] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.528640  7492 catalog_manager.cc:5697] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.530319  8115 consensus_queue.cc:1048] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:01:00.538767  8278 consensus_queue.cc:1048] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:01:00.540388  7782 consensus_peers.cc:597] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:00.535759  7869 consensus_queue.cc:260] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:00.547664  7741 raft_consensus.cc:2468] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
W20260709 13:01:00.511936  7707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 46091.7us
I20260709 13:01:00.547752  7864 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:01:00.547847  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce87ae60b2104f579d001664481e7aa8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:00.556625  7864 ts_tablet_manager.cc:1403] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.396s	user 0.024s	sys 0.011s
I20260709 13:01:00.567497  7812 raft_consensus.cc:2393] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:00.574941  7865 tablet_bootstrap.cc:654] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.578336  7869 ts_tablet_manager.cc:1434] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.005s
I20260709 13:01:00.580016  7869 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:00.568310  7864 raft_consensus.cc:359] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:00.581313  7864 raft_consensus.cc:385] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.581758  7864 raft_consensus.cc:740] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.583112  7864 consensus_queue.cc:260] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:00.586853  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:00.604382  7862 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:01:00.605840  7862 ts_tablet_manager.cc:1403] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.005s
I20260709 13:01:00.588083  7738 raft_consensus.cc:3060] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.615653  7869 tablet_bootstrap.cc:654] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.610162  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce87ae60b2104f579d001664481e7aa8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:00.663858  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:00.664800  7740 raft_consensus.cc:2468] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
W20260709 13:01:00.668365  7782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 71634.3us
W20260709 13:01:00.672261  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:00.686530  7862 raft_consensus.cc:359] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:00.687708  7862 raft_consensus.cc:385] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.688016  7862 raft_consensus.cc:740] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:01:00.688711  7862 consensus_queue.cc:260] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:00.689797  7632 leader_election.cc:304] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:00.690685  8223 raft_consensus.cc:2804] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:00.691088  8223 raft_consensus.cc:493] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.683403  8176 consensus_queue.cc:1048] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:01:00.691537  8223 raft_consensus.cc:3060] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:00.716564  7862 ts_tablet_manager.cc:1434] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.000s
I20260709 13:01:00.726810  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7723aa6994ac4a65710463c633f66" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:00.734763  7862 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771: Bootstrap starting.
W20260709 13:01:00.738106  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 139699us
I20260709 13:01:00.738878  7780 leader_election.cc:304] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:00.763103  7864 ts_tablet_manager.cc:1434] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.205s	user 0.019s	sys 0.014s
I20260709 13:01:00.764432  7864 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
W20260709 13:01:00.753018  7707 leader_election.cc:343] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.776280  7707 leader_election.cc:304] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:00.778908  8286 raft_consensus.cc:2749] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:00.784415  7738 raft_consensus.cc:2468] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:01:00.769511  8299 raft_consensus.cc:2804] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:00.787747  7862 tablet_bootstrap.cc:654] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:00.801733  7865 tablet_bootstrap.cc:492] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:00.802347  7865 ts_tablet_manager.cc:1403] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.311s	user 0.034s	sys 0.021s
I20260709 13:01:00.837167  8299 raft_consensus.cc:697] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:00.841729  8286 raft_consensus.cc:493] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.878265  7780 leader_election.cc:343] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:00.858656  8242 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.880388  8221 raft_consensus.cc:493] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.876740  8281 consensus_queue.cc:1048] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:01:00.909399  7865 raft_consensus.cc:359] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:00.912303  7865 raft_consensus.cc:385] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:00.921726  8279 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.912653  7865 raft_consensus.cc:740] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
W20260709 13:01:00.973738  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46081, user_credentials={real_user=slave}} blocked reactor thread for 84884.4us
I20260709 13:01:00.877741  8286 raft_consensus.cc:515] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:00.880046  8223 raft_consensus.cc:515] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:00.913972  7492 catalog_manager.cc:5697] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.981850  8286 leader_election.cc:290] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:00.982829  7862 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771: No bootstrap required, opened a new log
I20260709 13:01:00.983449  7862 ts_tablet_manager.cc:1403] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771: Time spent bootstrapping tablet: real 0.252s	user 0.022s	sys 0.024s
I20260709 13:01:00.985200  7869 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:00.985909  7869 ts_tablet_manager.cc:1403] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.406s	user 0.038s	sys 0.035s
I20260709 13:01:00.982975  8223 leader_election.cc:290] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:00.886538  8242 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:00.909399  8221 raft_consensus.cc:515] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:00.867110  8299 consensus_queue.cc:237] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:00.991355  7780 leader_election.cc:304] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:00.976132  8278 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.986511  7782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 75807.8us
I20260709 13:01:00.922394  8279 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:01.002295  8171 raft_consensus.cc:2804] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:01.027190  7558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 150697us
I20260709 13:01:01.002503  8278 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:01:01.032330  8302 log.cc:927] Time spent T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:01.039183  8221 leader_election.cc:290] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:01.045871  8242 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:01.047106  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:01.047395  8279 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:01.047793  7741 raft_consensus.cc:3060] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.033349  8278 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:01.051434  8171 raft_consensus.cc:697] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:01.056072  7865 consensus_queue.cc:260] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.058984  7865 ts_tablet_manager.cc:1434] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.255s	user 0.010s	sys 0.001s
I20260709 13:01:01.057216  7558 leader_election.cc:304] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:01.060724  7864 tablet_bootstrap.cc:654] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.063822  7862 raft_consensus.cc:359] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:01.064597  7862 raft_consensus.cc:385] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.064857  7862 raft_consensus.cc:740] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.060516  7592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:01.056435  7869 raft_consensus.cc:359] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:01.071808  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:01.065469  7862 consensus_queue.cc:260] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:01.072857  7869 raft_consensus.cc:385] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.073194  7869 raft_consensus.cc:740] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.073899  7869 consensus_queue.cc:260] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:01.075488  7869 ts_tablet_manager.cc:1434] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.000s
I20260709 13:01:01.076445  7869 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:01.081362  7865 tablet_bootstrap.cc:492] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:01:01.084431  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:01.085152  7594 raft_consensus.cc:3060] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.087860  7592 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:01:01.096540  7594 raft_consensus.cc:2468] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:01.101018  7862 ts_tablet_manager.cc:1434] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771: Time spent starting tablet: real 0.117s	user 0.004s	sys 0.004s
I20260709 13:01:01.052901  8171 consensus_queue.cc:237] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:01.067256  8284 raft_consensus.cc:2749] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.098829  8221 raft_consensus.cc:493] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.065229  7741 raft_consensus.cc:2468] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:01.133128  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:01.147380  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:01.148166  7590 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:01.148343  8294 consensus_queue.cc:1048] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:01:01.151360  7869 tablet_bootstrap.cc:654] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.152614  7865 tablet_bootstrap.cc:654] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.132650  7634 leader_election.cc:304] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:01.153712  7964 raft_consensus.cc:2804] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.154950  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:01.155661  7814 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:01:01.156387  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:01.157121  7668 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
W20260709 13:01:01.139287  7633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 94196.3us
I20260709 13:01:01.160043  7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:01.162122  7707 leader_election.cc:343] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.156490  7964 raft_consensus.cc:697] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
W20260709 13:01:01.171519  7706 leader_election.cc:343] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.174499  7558 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:01.169838  7964 consensus_queue.cc:237] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:01.177551  7780 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:01:01.176035  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:01.135720  8221 raft_consensus.cc:515] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:01.191540  8282 raft_consensus.cc:2804] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:01:01.253223  7557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 60889.8us
I20260709 13:01:01.174566  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:01:01.266757  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46081, user_credentials={real_user=slave}} blocked reactor thread for 69584.3us
I20260709 13:01:01.191838  8221 leader_election.cc:290] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:01.253679  8294 raft_consensus.cc:2804] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.255682  8282 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:01.256561  7633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 82126.7us
I20260709 13:01:01.304689  8282 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.299290  7813 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:01.330786  8294 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.331295  8294 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.331626  7634 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
W20260709 13:01:01.305686  7708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 147243us
I20260709 13:01:01.339854  7594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:01.344774  7864 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:01:01.346426  7864 ts_tablet_manager.cc:1403] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.582s	user 0.005s	sys 0.013s
I20260709 13:01:01.358115  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:01.343257  8223 raft_consensus.cc:2804] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.359609  8223 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.360225  8223 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.372589  7869 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:01.373212  7869 ts_tablet_manager.cc:1403] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.297s	user 0.040s	sys 0.051s
W20260709 13:01:01.376159  7782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 54395.9us
I20260709 13:01:01.415267  7911 raft_consensus.cc:493] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.416136  7911 raft_consensus.cc:515] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:01.416328  7864 raft_consensus.cc:359] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:01.417286  7864 raft_consensus.cc:385] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:01.419847  7706 leader_election.cc:343] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.417594  7864 raft_consensus.cc:740] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.422264  7864 consensus_queue.cc:260] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:01.425669  7911 leader_election.cc:290] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:01.426594  8319 raft_consensus.cc:493] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:01.427645  8319 raft_consensus.cc:515] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:01.426756  8294 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:01.457165  8319 leader_election.cc:290] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:01.459883  7869 raft_consensus.cc:359] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:01.462541  7869 raft_consensus.cc:385] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.463299  7869 raft_consensus.cc:740] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.471402  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:01:01.466535  7708 leader_election.cc:343] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.479084  7708 leader_election.cc:304] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
W20260709 13:01:01.480494  7708 leader_election.cc:343] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.480958  7708 leader_election.cc:304] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:01.481685  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:01.482401  7911 raft_consensus.cc:2749] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.485723  7864 ts_tablet_manager.cc:1434] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.139s	user 0.010s	sys 0.000s
I20260709 13:01:01.490521  7864 tablet_bootstrap.cc:492] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:01:01.486899  8221 raft_consensus.cc:2749] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.492550  7865 tablet_bootstrap.cc:492] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:01.511365  7865 ts_tablet_manager.cc:1403] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.430s	user 0.006s	sys 0.022s
I20260709 13:01:01.499171  8228 raft_consensus.cc:493] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.505338  7707 leader_election.cc:343] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.512995  8228 raft_consensus.cc:515] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.473186  8223 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:01.515678  8228 leader_election.cc:290] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:01.492722  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:01.516631  7663 raft_consensus.cc:2393] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:01.518868  8294 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:01.520604  7865 raft_consensus.cc:359] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.522868  7865 raft_consensus.cc:385] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.523308  7865 raft_consensus.cc:740] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.524114  7865 consensus_queue.cc:260] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.526297  7865 ts_tablet_manager.cc:1434] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
W20260709 13:01:01.526737  7708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 46291.1us
I20260709 13:01:01.527446  7865 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
W20260709 13:01:01.527539  7708 leader_election.cc:343] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.528358  7708 leader_election.cc:304] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:01.532876  7869 consensus_queue.cc:260] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:01.533721  7489 catalog_manager.cc:5697] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.535599  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:01.536482  7661 raft_consensus.cc:2393] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:01.535739  8223 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:01.540793  7489 catalog_manager.cc:5697] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:01.486171  7634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 153311us
I20260709 13:01:01.532898  8319 raft_consensus.cc:2749] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.546149  8294 consensus_queue.cc:1048] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:01.541054  8282 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:01.549715  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:01.549809  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:01.552467  7737 raft_consensus.cc:2393] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 1: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:01:01.555646  8282 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:01:01.556157  8321 log.cc:927] Time spent T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:01:01.557662  7869 ts_tablet_manager.cc:1434] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.184s	user 0.011s	sys 0.000s
I20260709 13:01:01.560822  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:01.564743  7590 raft_consensus.cc:2393] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 80af46fc024041de81a638d29912c8a3 in this term.
I20260709 13:01:01.565045  7869 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:01.565349  7632 leader_election.cc:304] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:01.566171  7661 raft_consensus.cc:3060] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.579634  7865 tablet_bootstrap.cc:654] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.578729  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:01.578480  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:01.606024  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d9469ca1534ec2b25b7938331c6600" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:01.606165  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:01.609839  7812 raft_consensus.cc:2393] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:01:01.595147  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:01.613201  7864 tablet_bootstrap.cc:654] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.603595  8299 raft_consensus.cc:493] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.628588  7593 raft_consensus.cc:2393] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 1: Already voted for candidate 80af46fc024041de81a638d29912c8a3 in this term.
I20260709 13:01:01.630409  7782 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:01.617587  8228 raft_consensus.cc:493] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.631579  8228 raft_consensus.cc:515] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.635406  8228 leader_election.cc:290] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:01.623808  8299 raft_consensus.cc:515] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:01.641485  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c78d34c2d104e6596872bdbc02005b7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:01.656708  7738 raft_consensus.cc:2468] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:01.660540  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c78d34c2d104e6596872bdbc02005b7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:01.661602  8299 leader_election.cc:290] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:01.656572  7633 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:01.663679  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d97da3f424447f9987d7c6ab8d99c80" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:01.664656  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:01.665580  7660 raft_consensus.cc:2393] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:01.666708  7964 raft_consensus.cc:2749] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.649580  8279 raft_consensus.cc:2749] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.669415  7632 leader_election.cc:304] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:01.672029  8223 raft_consensus.cc:2804] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:01.672483  8223 raft_consensus.cc:493] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.672833  8223 raft_consensus.cc:3060] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.673159  8324 raft_consensus.cc:2749] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.676839  7708 leader_election.cc:304] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
W20260709 13:01:01.678233  7708 leader_election.cc:343] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.670297  7557 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:01.678778  7708 leader_election.cc:304] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:01.679188  8257 raft_consensus.cc:2749] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.678406  7869 tablet_bootstrap.cc:654] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.685119  8221 raft_consensus.cc:2749] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.685931  8221 raft_consensus.cc:2749] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:01.666356  7782 leader_election.cc:343] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.696481  7864 tablet_bootstrap.cc:492] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:01:01.698252  7864 ts_tablet_manager.cc:1403] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.212s	user 0.024s	sys 0.004s
W20260709 13:01:01.698436  7633 leader_election.cc:343] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.704515  8223 raft_consensus.cc:515] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.719165  8309 consensus_queue.cc:1048] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:01.719722  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c78d34c2d104e6596872bdbc02005b7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:01.725986  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d97da3f424447f9987d7c6ab8d99c80" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:01.730542  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c78d34c2d104e6596872bdbc02005b7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:01.732007  7738 raft_consensus.cc:3060] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.738293  7869 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:01.739715  7869 ts_tablet_manager.cc:1403] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.175s	user 0.016s	sys 0.003s
I20260709 13:01:01.754534  7593 raft_consensus.cc:3060] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:01.749073  7864 raft_consensus.cc:359] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.758569  7864 raft_consensus.cc:385] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.759150  7864 raft_consensus.cc:740] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
W20260709 13:01:01.768152  7633 leader_election.cc:343] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.715767  8223 leader_election.cc:290] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
W20260709 13:01:01.773811  7782 consensus_peers.cc:597] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.760583  7864 consensus_queue.cc:260] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.780942  7869 raft_consensus.cc:359] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:01.782366  7869 raft_consensus.cc:385] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.782783  7869 raft_consensus.cc:740] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.783558  7869 consensus_queue.cc:260] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:01.792721  8228 consensus_queue.cc:1048] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:01.802647  7738 raft_consensus.cc:2468] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:01.807749  7869 ts_tablet_manager.cc:1434] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:01:01.809943  7869 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:01.812609  7632 leader_election.cc:304] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7
W20260709 13:01:01.809293  7780 leader_election.cc:343] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:01.814327  7780 leader_election.cc:304] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:01.814698  7864 ts_tablet_manager.cc:1434] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.116s	user 0.012s	sys 0.000s
I20260709 13:01:01.819844  7864 tablet_bootstrap.cc:492] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:01:01.820381  8294 raft_consensus.cc:2749] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:01.819504  8324 raft_consensus.cc:2804] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:01.814987  8223 consensus_queue.cc:1048] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:01:01.835132  7865 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:01.835703  7865 ts_tablet_manager.cc:1403] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.309s	user 0.010s	sys 0.006s
I20260709 13:01:01.843784  8324 raft_consensus.cc:697] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:01.845083  8324 consensus_queue.cc:237] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:01.860334  7865 raft_consensus.cc:359] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:01.861538  7865 raft_consensus.cc:385] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:01.862380  7865 raft_consensus.cc:740] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:01:01.864548  7865 consensus_queue.cc:260] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:01.868844  7864 tablet_bootstrap.cc:654] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.879849  7865 ts_tablet_manager.cc:1434] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.003s
I20260709 13:01:01.881000  8299 consensus_queue.cc:1048] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:01.938155  7864 tablet_bootstrap.cc:492] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:01:01.938778  7864 ts_tablet_manager.cc:1403] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.123s	user 0.027s	sys 0.000s
I20260709 13:01:01.954769  7869 tablet_bootstrap.cc:654] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.955310  7865 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:01:01.980425  7869 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:01.981276  7869 ts_tablet_manager.cc:1403] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.009s
I20260709 13:01:01.991307  7865 tablet_bootstrap.cc:654] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:01.999759  7864 raft_consensus.cc:359] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.001087  7864 raft_consensus.cc:385] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.001924  7864 raft_consensus.cc:740] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.002203  7869 raft_consensus.cc:359] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.003186  7869 raft_consensus.cc:385] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.003358  7869 raft_consensus.cc:740] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.004383  7869 consensus_queue.cc:260] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.074086  7864 consensus_queue.cc:260] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.110522  7864 ts_tablet_manager.cc:1434] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.171s	user 0.010s	sys 0.007s
W20260709 13:01:02.112303  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:02.114334  7864 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:01:02.178500  8225 raft_consensus.cc:493] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.179823  8225 raft_consensus.cc:515] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.183107  8225 leader_election.cc:290] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.188555  8311 raft_consensus.cc:493] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.189824  8311 raft_consensus.cc:515] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.182830  7869 ts_tablet_manager.cc:1434] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.201s	user 0.008s	sys 0.000s
I20260709 13:01:02.166033  7488 catalog_manager.cc:5697] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.203073  7864 tablet_bootstrap.cc:654] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.207661  7869 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:02.213708  8311 leader_election.cc:290] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.246821  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c78d34c2d104e6596872bdbc02005b7" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:02.241251  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c78d34c2d104e6596872bdbc02005b7" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:02.251286  7737 raft_consensus.cc:2393] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:02.251672  8283 raft_consensus.cc:493] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.252691  8283 raft_consensus.cc:515] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.258934  8266 raft_consensus.cc:493] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.260145  8266 raft_consensus.cc:515] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.262825  7865 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:02.273852  7865 ts_tablet_manager.cc:1403] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.319s	user 0.014s	sys 0.005s
I20260709 13:01:02.279007  8266 leader_election.cc:290] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.284420  7591 raft_consensus.cc:3060] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.284509  8283 leader_election.cc:290] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.290653  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:02.291393  7741 raft_consensus.cc:2468] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:02.312305  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7723aa6994ac4a65710463c633f66" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:02.313192  7737 raft_consensus.cc:2468] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 0.
I20260709 13:01:02.315508  7780 leader_election.cc:304] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:02.317528  8309 raft_consensus.cc:3060] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.321781  7869 tablet_bootstrap.cc:654] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.317528  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7723aa6994ac4a65710463c633f66" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:02.326133  7632 leader_election.cc:304] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:02.331216  8266 raft_consensus.cc:2804] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.331784  8266 raft_consensus.cc:493] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.332185  8266 raft_consensus.cc:3060] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.310830  7865 raft_consensus.cc:359] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.334187  7865 raft_consensus.cc:385] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.336659  7865 raft_consensus.cc:740] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.352308  7864 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:01:02.353024  7864 ts_tablet_manager.cc:1403] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.240s	user 0.012s	sys 0.008s
I20260709 13:01:02.355549  7865 consensus_queue.cc:260] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.358389  7865 ts_tablet_manager.cc:1434] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.002s
I20260709 13:01:02.359400  7864 raft_consensus.cc:359] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.360193  7864 raft_consensus.cc:385] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.360482  7864 raft_consensus.cc:740] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.364197  8309 raft_consensus.cc:2749] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.348327  7780 leader_election.cc:304] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:02.368712  8299 raft_consensus.cc:2804] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.369159  8299 raft_consensus.cc:493] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.369505  8299 raft_consensus.cc:3060] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.375630  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:02.376407  7741 raft_consensus.cc:2468] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:01:02.381506  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:02.382925  7780 leader_election.cc:343] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.366072  7865 tablet_bootstrap.cc:492] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:01:02.361208  7864 consensus_queue.cc:260] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.417342  7864 ts_tablet_manager.cc:1434] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:01:02.418987  7864 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:01:02.423444  8299 raft_consensus.cc:515] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.430428  7964 consensus_queue.cc:1048] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:01:02.430972  8299 leader_election.cc:290] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.434883  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7723aa6994ac4a65710463c633f66" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:02.435913  7740 raft_consensus.cc:3060] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.435470  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:02.437045  7869 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:02.436857  7593 raft_consensus.cc:2468] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:02.437660  7869 ts_tablet_manager.cc:1403] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.231s	user 0.026s	sys 0.018s
I20260709 13:01:02.439335  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7723aa6994ac4a65710463c633f66" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:02.440527  7865 tablet_bootstrap.cc:654] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.442888  8266 raft_consensus.cc:515] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.444437  7667 raft_consensus.cc:2393] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:02.446885  7869 raft_consensus.cc:359] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:02.450537  7780 leader_election.cc:343] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.448490  8223 raft_consensus.cc:493] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.454952  8223 raft_consensus.cc:515] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.464293  8324 consensus_queue.cc:1048] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.465101  8223 leader_election.cc:290] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:02.448465  7557 leader_election.cc:304] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:02.465641  8266 leader_election.cc:290] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.449606  7869 raft_consensus.cc:385] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.468696  8194 raft_consensus.cc:2804] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.468530  7869 raft_consensus.cc:740] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.469993  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d97da3f424447f9987d7c6ab8d99c80" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:02.470229  7869 consensus_queue.cc:260] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.470799  7817 raft_consensus.cc:2468] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:02.469269  8194 raft_consensus.cc:493] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.475206  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:02.475977  7737 raft_consensus.cc:3060] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.476277  7633 leader_election.cc:304] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:01:02.477399  8324 raft_consensus.cc:2804] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.477834  8324 raft_consensus.cc:493] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.478219  8324 raft_consensus.cc:3060] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.475312  8194 raft_consensus.cc:3060] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.475190  7869 ts_tablet_manager.cc:1434] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:01:02.512581  7864 tablet_bootstrap.cc:654] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.500766  8194 raft_consensus.cc:515] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.530176  7869 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:02.534536  7740 raft_consensus.cc:2468] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:01:02.540076  8324 raft_consensus.cc:515] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.542112  7780 leader_election.cc:304] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880
I20260709 13:01:02.547222  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:02.548264  7591 raft_consensus.cc:2393] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 1: Already voted for candidate 80af46fc024041de81a638d29912c8a3 in this term.
I20260709 13:01:02.547482  8283 raft_consensus.cc:2804] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.549264  8283 raft_consensus.cc:697] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:02.550472  8283 consensus_queue.cc:237] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.553233  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d97da3f424447f9987d7c6ab8d99c80" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:02.549360  7869 tablet_bootstrap.cc:654] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.550755  8194 leader_election.cc:290] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.567510  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:02.567641  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:02.568418  7661 raft_consensus.cc:2393] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:02.571123  7737 raft_consensus.cc:2468] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
W20260709 13:01:02.571334  7634 leader_election.cc:343] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.574683  7632 leader_election.cc:304] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:02.575942  8324 leader_election.cc:290] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:02.579757  8223 raft_consensus.cc:2804] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.580858  8223 raft_consensus.cc:697] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:02.580932  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d97da3f424447f9987d7c6ab8d99c80" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:02.581786  7817 raft_consensus.cc:3060] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.581961  8223 consensus_queue.cc:237] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.592728  7864 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:01:02.592762  7865 tablet_bootstrap.cc:492] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:02.593688  7864 ts_tablet_manager.cc:1403] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.175s	user 0.018s	sys 0.002s
I20260709 13:01:02.593782  7865 ts_tablet_manager.cc:1403] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.228s	user 0.030s	sys 0.017s
I20260709 13:01:02.598222  7865 raft_consensus.cc:359] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.598237  7864 raft_consensus.cc:359] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.599757  7864 raft_consensus.cc:385] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.600154  7864 raft_consensus.cc:740] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.603372  7865 raft_consensus.cc:385] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.603825  7865 raft_consensus.cc:740] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.604790  7865 consensus_queue.cc:260] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.623720  7817 raft_consensus.cc:2468] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:02.627918  7864 consensus_queue.cc:260] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.631816  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d97da3f424447f9987d7c6ab8d99c80" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:02.631775  7557 leader_election.cc:304] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:02.641081  7864 ts_tablet_manager.cc:1434] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.001s
I20260709 13:01:02.646481  7865 ts_tablet_manager.cc:1434] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.002s
I20260709 13:01:02.651450  8280 raft_consensus.cc:2749] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.645967  7633 leader_election.cc:304] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:01:02.658684  7869 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:02.658866  8223 raft_consensus.cc:2804] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:02.659183  7634 leader_election.cc:343] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.659519  7869 ts_tablet_manager.cc:1403] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.130s	user 0.007s	sys 0.013s
I20260709 13:01:02.657454  7864 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7: Bootstrap starting.
I20260709 13:01:02.665624  8223 raft_consensus.cc:697] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:02.666916  8223 consensus_queue.cc:237] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.669826  7864 tablet_bootstrap.cc:654] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.674062  7869 raft_consensus.cc:359] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.674867  7869 raft_consensus.cc:385] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.675133  7869 raft_consensus.cc:740] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.675954  7869 consensus_queue.cc:260] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.677891  7865 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:01:02.697021  7869 ts_tablet_manager.cc:1434] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:01:02.696058  7492 catalog_manager.cc:5697] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } }
I20260709 13:01:02.699908  7869 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:02.705382  8280 raft_consensus.cc:493] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.705971  8280 raft_consensus.cc:515] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.715021  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:02.715667  8280 leader_election.cc:290] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:02.715677  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:02.717168  7738 raft_consensus.cc:2468] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:01:02.719476  7557 leader_election.cc:304] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:02.715904  7817 raft_consensus.cc:2468] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:01:02.723398  8194 raft_consensus.cc:2804] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.723677  7864 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7: No bootstrap required, opened a new log
I20260709 13:01:02.723856  8194 raft_consensus.cc:493] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.724282  8194 raft_consensus.cc:3060] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.724995  7869 tablet_bootstrap.cc:654] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.728329  7865 tablet_bootstrap.cc:654] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.734225  7864 ts_tablet_manager.cc:1403] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.016s
I20260709 13:01:02.737952  7864 raft_consensus.cc:359] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.738696  7864 raft_consensus.cc:385] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.738976  7864 raft_consensus.cc:740] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.742331  7864 consensus_queue.cc:260] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.753391  7864 ts_tablet_manager.cc:1434] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:01:02.758507  7869 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:02.747248  7488 catalog_manager.cc:5697] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.759286  7869 ts_tablet_manager.cc:1403] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.002s
I20260709 13:01:02.761013  8194 raft_consensus.cc:515] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.765713  7869 raft_consensus.cc:359] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.766664  7869 raft_consensus.cc:385] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.767023  7869 raft_consensus.cc:740] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.760749  7488 catalog_manager.cc:5697] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.773007  8194 leader_election.cc:290] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:02.774225  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:02.774804  7738 raft_consensus.cc:3060] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.778180  8223 raft_consensus.cc:493] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.778928  8223 raft_consensus.cc:515] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:02.780350  7865 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:02.780954  7865 ts_tablet_manager.cc:1403] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.010s
I20260709 13:01:02.783257  7738 raft_consensus.cc:2468] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:01:02.784068  7865 raft_consensus.cc:359] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.784807  7865 raft_consensus.cc:385] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.787261  7865 raft_consensus.cc:740] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.787714  8223 leader_election.cc:290] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:02.787926  7865 consensus_queue.cc:260] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.789079  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:02.789803  7817 raft_consensus.cc:3060] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.790856  7869 consensus_queue.cc:260] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.791973  7557 leader_election.cc:304] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:02.793295  8311 raft_consensus.cc:2804] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.794267  8311 raft_consensus.cc:697] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:02.795455  8311 consensus_queue.cc:237] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.798072  7869 ts_tablet_manager.cc:1434] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:01:02.799278  7865 ts_tablet_manager.cc:1434] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:01:02.800592  7865 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880: Bootstrap starting.
I20260709 13:01:02.800765  7489 catalog_manager.cc:5697] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.809521  7865 tablet_bootstrap.cc:654] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.814057  7869 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:02.833887  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7723aa6994ac4a65710463c633f66" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:02.838815  7817 raft_consensus.cc:2468] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:01:02.863600  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7723aa6994ac4a65710463c633f66" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:02.865242  7738 raft_consensus.cc:2393] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 1: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:01:02.866696  7632 leader_election.cc:304] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:02.867527  8324 raft_consensus.cc:3060] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.881410  7865 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880: No bootstrap required, opened a new log
I20260709 13:01:02.882046  7865 ts_tablet_manager.cc:1403] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.023s
I20260709 13:01:02.888548  7865 raft_consensus.cc:359] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.889447  7865 raft_consensus.cc:385] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.889812  7865 raft_consensus.cc:740] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.890560  7865 consensus_queue.cc:260] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.892414  7865 ts_tablet_manager.cc:1434] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:01:02.895112  7869 tablet_bootstrap.cc:654] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.909399  8324 raft_consensus.cc:2749] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:02.922142  8283 raft_consensus.cc:493] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.923642  8283 raft_consensus.cc:515] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.925390  8223 raft_consensus.cc:493] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.926008  8223 raft_consensus.cc:515] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:02.926972  8283 leader_election.cc:290] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:02.927140  7869 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:02.927551  7593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:02.928018  7869 ts_tablet_manager.cc:1403] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.013s
I20260709 13:01:02.928650  8223 leader_election.cc:290] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:01:02.929072  7782 leader_election.cc:343] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.931602  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:02.932569  7812 raft_consensus.cc:2468] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:02.934000  7633 leader_election.cc:304] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:01:02.940343  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:02.939076  7869 raft_consensus.cc:359] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.942780  7869 raft_consensus.cc:385] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.943107  7869 raft_consensus.cc:740] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.946074  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:02.946386  8223 raft_consensus.cc:2804] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.947638  7869 consensus_queue.cc:260] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.949592  8281 raft_consensus.cc:493] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.950120  8281 raft_consensus.cc:515] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.952327  8281 leader_election.cc:290] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.946975  8223 raft_consensus.cc:493] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.954463  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
W20260709 13:01:02.956527  7634 leader_election.cc:343] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:02.956760  7737 raft_consensus.cc:2468] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:02.958010  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:02.958359  7632 leader_election.cc:304] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:02.958680  7591 raft_consensus.cc:2468] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 0.
I20260709 13:01:02.961115  8281 raft_consensus.cc:2804] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:02.961598  8281 raft_consensus.cc:493] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.962033  8171 consensus_queue.cc:1048] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:02.962059  8281 raft_consensus.cc:3060] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.956984  8223 raft_consensus.cc:3060] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.971205  7869 ts_tablet_manager.cc:1434] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:01:02.975243  8257 raft_consensus.cc:493] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.975831  8257 raft_consensus.cc:515] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:02.978653  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:02.979322  7737 raft_consensus.cc:2468] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:01:02.980420  7488 catalog_manager.cc:5697] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.981212  8281 raft_consensus.cc:515] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:02.996856  8281 leader_election.cc:290] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:02.997900  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:02.998584  7737 raft_consensus.cc:3060] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.981956  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:03.003042  7812 raft_consensus.cc:2468] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 0.
I20260709 13:01:02.982039  8257 leader_election.cc:290] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:02.981473  7557 leader_election.cc:304] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:02.989358  7869 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:03.006177  8257 raft_consensus.cc:2804] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.006626  8257 raft_consensus.cc:493] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.006945  8257 raft_consensus.cc:3060] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.008471  8225 consensus_queue.cc:1048] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.015887  8228 consensus_queue.cc:1048] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:03.022622  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:03.023294  7591 raft_consensus.cc:3060] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.032065  7591 raft_consensus.cc:2468] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:03.033331  8223 raft_consensus.cc:515] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.034644  7661 raft_consensus.cc:2393] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:03.017373  8257 raft_consensus.cc:515] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:03.042618  7634 leader_election.cc:304] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:03.044379  8228 raft_consensus.cc:2804] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.036793  7780 leader_election.cc:304] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:03.044893  8228 raft_consensus.cc:697] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:03.046185  8225 raft_consensus.cc:3060] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.045835  8228 consensus_queue.cc:237] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:03.055171  8281 consensus_queue.cc:1048] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:01:03.063185  7737 raft_consensus.cc:2468] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:03.063311  8223 leader_election.cc:290] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:03.064050  8223 consensus_queue.cc:1048] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.064831  8257 leader_election.cc:290] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:03.054518  8225 raft_consensus.cc:2749] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:03.070727  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:03.071491  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:03.072209  7815 raft_consensus.cc:3060] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.080802  7488 catalog_manager.cc:5697] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.088936  7817 raft_consensus.cc:2468] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:03.091128  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:03.091825  7737 raft_consensus.cc:3060] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.094084  7591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:03.098017  8257 raft_consensus.cc:493] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.100342  8257 raft_consensus.cc:515] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.097519  7869 tablet_bootstrap.cc:654] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.107239  7633 leader_election.cc:304] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:01:03.119938  7815 raft_consensus.cc:2468] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:01:03.119541  8228 raft_consensus.cc:2804] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:03.132755  7634 leader_election.cc:343] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.132468  8228 raft_consensus.cc:697] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:03.155912  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d97da3f424447f9987d7c6ab8d99c80" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:03.145063  7558 leader_election.cc:304] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:03.157804  8280 raft_consensus.cc:2804] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.158670  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d97da3f424447f9987d7c6ab8d99c80" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:03.153491  8257 leader_election.cc:290] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:03.160233  8280 raft_consensus.cc:697] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:03.193451  8280 consensus_queue.cc:237] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:03.198411  8228 consensus_queue.cc:237] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.199318  7737 raft_consensus.cc:2468] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:01:03.206954  7558 leader_election.cc:304] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:03.207835  8257 raft_consensus.cc:2749] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:03.229014  7869 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: No bootstrap required, opened a new log
I20260709 13:01:03.229687  7869 ts_tablet_manager.cc:1403] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.241s	user 0.022s	sys 0.006s
I20260709 13:01:03.254979  7869 raft_consensus.cc:359] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.255890  7869 raft_consensus.cc:385] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.256182  7869 raft_consensus.cc:740] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
W20260709 13:01:03.257319  8370 log.cc:927] Time spent T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:01:03.277277  8194 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.278112  8194 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.306116  7869 consensus_queue.cc:260] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.307893  7869 ts_tablet_manager.cc:1434] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.000s
W20260709 13:01:03.298261  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 56805.6us
I20260709 13:01:03.313297  8194 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:03.313798  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:03.314515  7812 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
W20260709 13:01:03.299908  7782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 47808.1us
I20260709 13:01:03.322182  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:03.322902  7661 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 1.
I20260709 13:01:03.326581  7557 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:03.331167  8257 raft_consensus.cc:2804] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:03.337080  8257 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.337460  8257 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:03.339514  7589 raft_consensus.cc:3060] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:03.347081  7540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:03.348454  8257 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.350793  8257 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:03.354173  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:03.356349  7661 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:03.362934  8257 consensus_queue.cc:1048] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:03.375931  8228 consensus_queue.cc:1048] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:03.373668  7489 catalog_manager.cc:5697] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.379731  8257 consensus_queue.cc:1048] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:03.378348  7661 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:03.391171  7557 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:03.392096  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:03.392885  7812 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:03.392153  8280 raft_consensus.cc:2804] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:03.398257  8280 raft_consensus.cc:697] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:03.399848  8280 consensus_queue.cc:237] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.407492  7488 catalog_manager.cc:5697] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.425419  7812 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:03.451491  8223 consensus_queue.cc:1048] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.451709  7489 catalog_manager.cc:5697] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.458369  8280 raft_consensus.cc:493] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.458840  8280 raft_consensus.cc:515] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:03.462212  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:03.467147  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:03.467340  7812 raft_consensus.cc:2393] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 1: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:03.463289  8280 leader_election.cc:290] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:03.470642  8223 consensus_queue.cc:1048] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.475193  7557 leader_election.cc:304] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:03.477074  8194 raft_consensus.cc:3060] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.490870  8194 raft_consensus.cc:2749] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:03.614144  8280 consensus_queue.cc:1048] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.619278  8223 consensus_queue.cc:1048] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.644780  8266 consensus_queue.cc:1048] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.650288  8176 consensus_queue.cc:1048] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:03.872707  7667 raft_consensus.cc:1275] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:03.874359  8280 consensus_queue.cc:1048] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:03.886142  7815 raft_consensus.cc:1275] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:03.887933  8280 consensus_queue.cc:1048] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.146898   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:04.166764  7782 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:04.190659  7782 consensus_peers.cc:597] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.192229  7782 consensus_peers.cc:597] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.192912  7782 consensus_peers.cc:597] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.201606  7782 consensus_peers.cc:597] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.203976  7782 consensus_peers.cc:597] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.209007   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:04.210294   431 tablet_replica.cc:333] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.210968   431 raft_consensus.cc:2243] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.212177   431 raft_consensus.cc:2272] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.213649  7634 consensus_peers.cc:597] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.214720   431 tablet_replica.cc:333] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.215425   431 raft_consensus.cc:2243] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.215862   431 raft_consensus.cc:2272] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.218495   431 tablet_replica.cc:333] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.219352   431 raft_consensus.cc:2243] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.219976   431 raft_consensus.cc:2272] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.222440   431 tablet_replica.cc:333] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.223426   431 raft_consensus.cc:2243] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.223866   431 raft_consensus.cc:2272] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.226876   431 tablet_replica.cc:333] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.227603   431 raft_consensus.cc:2243] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.228163   431 raft_consensus.cc:2272] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.230718   431 tablet_replica.cc:333] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.231319   431 raft_consensus.cc:2243] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.231798   431 raft_consensus.cc:2272] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.234613   431 tablet_replica.cc:333] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.235250   431 raft_consensus.cc:2243] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.236033   431 raft_consensus.cc:2272] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.238803   431 tablet_replica.cc:333] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.239663   431 raft_consensus.cc:2243] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.240980   431 raft_consensus.cc:2272] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.243892   431 tablet_replica.cc:333] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.244550   431 raft_consensus.cc:2243] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.245426   431 raft_consensus.cc:2272] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.247727   431 tablet_replica.cc:333] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.248320   431 raft_consensus.cc:2243] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.249186   431 raft_consensus.cc:2272] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.251379   431 tablet_replica.cc:333] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.252013   431 raft_consensus.cc:2243] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.253046   431 raft_consensus.cc:2272] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.255803   431 tablet_replica.cc:333] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.256633   431 raft_consensus.cc:2243] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.257310   431 raft_consensus.cc:2272] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.260260  7634 consensus_peers.cc:597] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.260274   431 tablet_replica.cc:333] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.262048   431 raft_consensus.cc:2243] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.263350   431 raft_consensus.cc:2272] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.265414   431 tablet_replica.cc:333] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.266052   431 raft_consensus.cc:2243] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.266494   431 raft_consensus.cc:2272] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.268870   431 tablet_replica.cc:333] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.269639   431 raft_consensus.cc:2243] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.270141   431 raft_consensus.cc:2272] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.272064   431 tablet_replica.cc:333] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.272794   431 raft_consensus.cc:2243] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.274125   431 raft_consensus.cc:2272] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.276939   431 tablet_replica.cc:333] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.277814   431 raft_consensus.cc:2243] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.278429   431 raft_consensus.cc:2272] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.279852  7634 consensus_peers.cc:597] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.281895   431 tablet_replica.cc:333] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.282640   431 raft_consensus.cc:2243] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.283066   431 raft_consensus.cc:2272] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.285132   431 tablet_replica.cc:333] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.285809   431 raft_consensus.cc:2243] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.286315   431 raft_consensus.cc:2272] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.288749   431 tablet_replica.cc:333] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.289546   431 raft_consensus.cc:2243] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.290704   431 raft_consensus.cc:2272] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.293551   431 tablet_replica.cc:333] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.294397   431 raft_consensus.cc:2243] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.295246   431 raft_consensus.cc:2272] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.297307   431 tablet_replica.cc:333] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.298290   431 raft_consensus.cc:2243] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.298895   431 raft_consensus.cc:2272] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.301815   431 tablet_replica.cc:333] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.302661   431 raft_consensus.cc:2243] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.303244   431 raft_consensus.cc:2272] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.306377   431 tablet_replica.cc:333] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.307103   431 raft_consensus.cc:2243] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.308003   431 raft_consensus.cc:2272] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.311116   431 tablet_replica.cc:333] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.312083   431 raft_consensus.cc:2243] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.312703   431 raft_consensus.cc:2272] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.314045  7634 consensus_peers.cc:597] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.316152   431 tablet_replica.cc:333] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.317149   431 raft_consensus.cc:2243] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.318336   431 raft_consensus.cc:2272] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.321156   431 tablet_replica.cc:333] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.321969   431 raft_consensus.cc:2243] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.322504   431 raft_consensus.cc:2272] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.325362   431 tablet_replica.cc:333] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.326215   431 raft_consensus.cc:2243] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:04.326728  7782 consensus_peers.cc:597] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.327522  7782 consensus_peers.cc:597] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.326761   431 raft_consensus.cc:2272] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.330000   431 tablet_replica.cc:333] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.330636   431 raft_consensus.cc:2243] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.331066   431 raft_consensus.cc:2272] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.332883   431 tablet_replica.cc:333] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.333539   431 raft_consensus.cc:2243] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.334445   431 raft_consensus.cc:2272] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.336993   431 tablet_replica.cc:333] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.337613   431 raft_consensus.cc:2243] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.338164   431 raft_consensus.cc:2272] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.338939  7708 consensus_peers.cc:597] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.340811   431 tablet_replica.cc:333] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
W20260709 13:01:04.341188  7634 consensus_peers.cc:597] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.341511   431 raft_consensus.cc:2243] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.342062   431 raft_consensus.cc:2272] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.346511   431 tablet_replica.cc:333] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.347335   431 raft_consensus.cc:2243] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.347899   431 raft_consensus.cc:2272] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.348762  7782 consensus_peers.cc:597] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.350394   431 tablet_replica.cc:333] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.351042   431 raft_consensus.cc:2243] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.352011   431 raft_consensus.cc:2272] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.354905   431 tablet_replica.cc:333] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.355587   431 raft_consensus.cc:2243] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.356524   431 raft_consensus.cc:2272] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.358950   431 tablet_replica.cc:333] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.359539   431 raft_consensus.cc:2243] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.360301   431 raft_consensus.cc:2272] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.363272   431 tablet_replica.cc:333] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
W20260709 13:01:04.363231  7708 consensus_peers.cc:597] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.364584   431 raft_consensus.cc:2243] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.365736   431 raft_consensus.cc:2272] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.368882   431 tablet_replica.cc:333] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.369654   431 raft_consensus.cc:2243] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.370205   431 raft_consensus.cc:2272] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.372496   431 tablet_replica.cc:333] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.373311   431 raft_consensus.cc:2243] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.374450   431 raft_consensus.cc:2272] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.377082   431 tablet_replica.cc:333] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.377842   431 raft_consensus.cc:2243] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.378782   431 raft_consensus.cc:2272] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.381345   431 tablet_replica.cc:333] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.381979   431 raft_consensus.cc:2243] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.382457   431 raft_consensus.cc:2272] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.385232   431 tablet_replica.cc:333] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.385939   431 raft_consensus.cc:2243] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.386724   431 raft_consensus.cc:2272] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.387765  7708 consensus_peers.cc:597] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.388900  7634 consensus_peers.cc:597] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.389727   431 tablet_replica.cc:333] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.390327   431 raft_consensus.cc:2243] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.390796   431 raft_consensus.cc:2272] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.393215   431 tablet_replica.cc:333] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
I20260709 13:01:04.393891   431 raft_consensus.cc:2243] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.394385   431 raft_consensus.cc:2272] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.397750   431 tablet_replica.cc:333] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: stopping tablet replica
W20260709 13:01:04.398406  7782 consensus_peers.cc:597] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.398432   431 raft_consensus.cc:2243] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.399400   431 raft_consensus.cc:2272] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.407022  7634 consensus_peers.cc:597] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.416023  7782 consensus_peers.cc:597] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.482997   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:04.514221  7634 consensus_peers.cc:597] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.546482  7634 consensus_peers.cc:597] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.558368  7634 consensus_peers.cc:597] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.562660   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:04.571384  8396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:04.585637  8397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:04.588944   431 server_base.cc:1061] running on GCE node
W20260709 13:01:04.590624  8399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:04.595420  7782 consensus_peers.cc:597] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.597942   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:04.598272   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:04.598551   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602064598531 us; error 0 us; skew 500 ppm
I20260709 13:01:04.599275   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:04.603439   431 webserver.cc:533] Webserver started at http://127.0.107.193:45483/ using document root <none> and password file <none>
I20260709 13:01:04.604140   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:04.604379   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:01:04.609498   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:01:04.620708  8405 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:04.623210   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:01:04.623625   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "80af46fc024041de81a638d29912c8a3"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-qv7r"
W20260709 13:01:04.624094  7634 consensus_peers.cc:597] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.624177   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:04.674976   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:04.676446   431 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 13:01:04.676492  7634 consensus_peers.cc:597] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.678202   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:04.684610  8412 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:01:04.753971  7634 consensus_peers.cc:597] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:05.024982   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:01:05.025385   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.342s	user 0.008s	sys 0.000s
I20260709 13:01:05.025939   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:01:05.032131  8412 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.053347  8412 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.054438  8412 tablet_bootstrap.cc:492] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.055154  8412 ts_tablet_manager.cc:1403] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:01:05.058241  8412 raft_consensus.cc:359] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.059005  8412 raft_consensus.cc:740] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.059901  8412 consensus_queue.cc:260] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.072870  8412 ts_tablet_manager.cc:1434] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.015s
I20260709 13:01:05.074187  8412 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.100440  8412 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.101476  8412 tablet_bootstrap.cc:492] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.102188  8412 ts_tablet_manager.cc:1403] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.004s
I20260709 13:01:05.105247  8412 raft_consensus.cc:359] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.106195  8412 raft_consensus.cc:740] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.107913  8412 consensus_queue.cc:260] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.112454  8412 ts_tablet_manager.cc:1434] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:05.113554  8412 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.141705  8412 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.142753  8412 tablet_bootstrap.cc:492] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.143504  8412 ts_tablet_manager.cc:1403] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.004s
I20260709 13:01:05.146386  8412 raft_consensus.cc:359] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.147437  8412 raft_consensus.cc:740] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.148564  8412 consensus_queue.cc:260] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.151881  8412 ts_tablet_manager.cc:1434] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:05.153546  8412 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.155068  8375 raft_consensus.cc:493] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.155882  8375 raft_consensus.cc:515] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.164044  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.163412  8375 leader_election.cc:290] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:01:05.173738  7782 leader_election.cc:336] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.177871  7782 leader_election.cc:304] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:05.180866  8375 raft_consensus.cc:2749] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.185390  8412 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.186312  8412 tablet_bootstrap.cc:492] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.186919  8412 ts_tablet_manager.cc:1403] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.007s
I20260709 13:01:05.189710  8412 raft_consensus.cc:359] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.190289  8412 raft_consensus.cc:740] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.190866  8412 consensus_queue.cc:260] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.193873  8412 ts_tablet_manager.cc:1434] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:05.196076  8412 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.214195  8412 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.215128  8412 tablet_bootstrap.cc:492] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.215734  8412 ts_tablet_manager.cc:1403] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:01:05.218294  8412 raft_consensus.cc:359] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.218958  8412 raft_consensus.cc:740] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.219651  8412 consensus_queue.cc:260] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.221150  8412 ts_tablet_manager.cc:1434] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:01:05.221880  8412 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.236207  8281 raft_consensus.cc:493] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.236852  8281 raft_consensus.cc:515] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.237339  8412 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.238417  8412 tablet_bootstrap.cc:492] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.239131  8412 ts_tablet_manager.cc:1403] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:01:05.239028  8281 leader_election.cc:290] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.242169  8412 raft_consensus.cc:359] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.242923  8412 raft_consensus.cc:740] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.243558  8412 consensus_queue.cc:260] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.245477  8412 ts_tablet_manager.cc:1434] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:05.246330  8412 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
W20260709 13:01:05.246205  7634 leader_election.cc:336] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.246973  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.248745  7632 leader_election.cc:304] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:05.249617  8281 raft_consensus.cc:2749] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.260663  8412 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.261668  8412 tablet_bootstrap.cc:492] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.262383  8412 ts_tablet_manager.cc:1403] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:01:05.264963  8412 raft_consensus.cc:359] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.265501  8412 raft_consensus.cc:740] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.266130  8412 consensus_queue.cc:260] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.267606  8412 ts_tablet_manager.cc:1434] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:05.268481  8412 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.268597  8281 raft_consensus.cc:493] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.269264  8281 raft_consensus.cc:515] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.271394  8281 leader_election.cc:290] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.274729  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0b231c31d34cc19a247378b4e932bf" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:01:05.286932  7634 leader_election.cc:336] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.287382  7634 leader_election.cc:304] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.288908  8324 raft_consensus.cc:2749] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.290768  8412 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.291898  8412 tablet_bootstrap.cc:492] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.292601  8412 ts_tablet_manager.cc:1403] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 13:01:05.296981  8412 raft_consensus.cc:359] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.297559  8412 raft_consensus.cc:740] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.298345  8412 consensus_queue.cc:260] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.300463  8412 ts_tablet_manager.cc:1434] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:01:05.301296  8412 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.316550  8412 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.317507  8412 tablet_bootstrap.cc:492] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.318404  8412 ts_tablet_manager.cc:1403] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:01:05.320914  8412 raft_consensus.cc:359] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.321552  8412 raft_consensus.cc:740] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.322335  8412 consensus_queue.cc:260] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.324432  8412 ts_tablet_manager.cc:1434] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:05.325244  8412 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.342796  8412 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.344072  8412 tablet_bootstrap.cc:492] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.344769  8412 ts_tablet_manager.cc:1403] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:01:05.346966  8412 raft_consensus.cc:359] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.347546  8412 raft_consensus.cc:740] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.348097  8412 consensus_queue.cc:260] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.349660  8412 ts_tablet_manager.cc:1434] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:01:05.350298  8412 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.354156   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:01:05.354470   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.329s	user 0.293s	sys 0.000s
I20260709 13:01:05.363550  8412 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.364811  8412 tablet_bootstrap.cc:492] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.365428  8412 ts_tablet_manager.cc:1403] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:01:05.368496  8412 raft_consensus.cc:359] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.369051  8412 raft_consensus.cc:740] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.369813  8412 consensus_queue.cc:260] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.372367  8412 ts_tablet_manager.cc:1434] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:01:05.373279  8412 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.393791  8281 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.394768  8281 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.396919  8415 raft_consensus.cc:493] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.397747  8375 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.397503  8415 raft_consensus.cc:515] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.398255  8375 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.400171  8415 leader_election.cc:290] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.400421  8375 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.401433  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:05.402299  7815 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 2.
I20260709 13:01:05.403663  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.406200  7633 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
W20260709 13:01:05.407141  7708 leader_election.cc:336] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.407924  8266 raft_consensus.cc:2804] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:05.408514  8266 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.409034  8266 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.409854  8281 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:01:05.418309  7782 leader_election.cc:336] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.419966  7706 leader_election.cc:304] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.420624  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.421188  8415 raft_consensus.cc:2749] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.422183  8281 raft_consensus.cc:493] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.422945  8281 raft_consensus.cc:515] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
W20260709 13:01:05.430871  7634 leader_election.cc:336] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.431471  8412 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.432497  8412 tablet_bootstrap.cc:492] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.432852  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.433974  7740 raft_consensus.cc:2468] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:05.433396  8412 ts_tablet_manager.cc:1403] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.008s
I20260709 13:01:05.435842  7632 leader_election.cc:304] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:05.437726  8412 raft_consensus.cc:359] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.438601  8412 raft_consensus.cc:740] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.438371  8266 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.425105  8281 leader_election.cc:290] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.439989  7667 raft_consensus.cc:2393] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 3: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:05.439617  8412 consensus_queue.cc:260] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.438154  8324 raft_consensus.cc:2804] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.440804  8324 raft_consensus.cc:493] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.441193  8324 raft_consensus.cc:3060] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.442101  8412 ts_tablet_manager.cc:1434] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:05.442790  8415 raft_consensus.cc:493] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.442989  8412 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.443374  8415 raft_consensus.cc:515] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.447552  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:05.449894  8413 raft_consensus.cc:493] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.450469  8413 raft_consensus.cc:515] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.451437  8221 raft_consensus.cc:493] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.451979  8221 raft_consensus.cc:515] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.452739  8413 leader_election.cc:290] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.454077  8221 leader_election.cc:290] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.455502  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:05.457691  7708 leader_election.cc:336] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.458309  7708 leader_election.cc:304] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.462899  8375 raft_consensus.cc:493] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.463153  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.463521  8375 raft_consensus.cc:515] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.464308  8413 raft_consensus.cc:2749] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:05.453842  7634 leader_election.cc:336] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.466600  8375 leader_election.cc:290] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:01:05.469142  7708 leader_election.cc:336] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.469911  8415 leader_election.cc:290] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.472289  8221 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.473230  8221 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.475358  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.476615  7740 raft_consensus.cc:2468] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
W20260709 13:01:05.474155  7782 leader_election.cc:336] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.479115  8221 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.480948  8375 raft_consensus.cc:493] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
W20260709 13:01:05.474382  7708 leader_election.cc:336] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.483680  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:05.483700  8375 raft_consensus.cc:515] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.484150  7708 leader_election.cc:304] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.484472  7815 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.487816  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.488006  8375 leader_election.cc:290] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.489339  8415 raft_consensus.cc:2749] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.493323  8221 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.493904  8221 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.497181  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:05.505798  8412 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.492997  8266 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 3 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.509347  7780 leader_election.cc:304] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.510278  8243 raft_consensus.cc:2804] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.510735  8243 raft_consensus.cc:493] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
W20260709 13:01:05.510278  7708 leader_election.cc:336] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.511258  8243 raft_consensus.cc:3060] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.510785  8221 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.513588  8221 raft_consensus.cc:493] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
W20260709 13:01:05.510315  7782 leader_election.cc:336] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.514125  8221 raft_consensus.cc:515] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.517385  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:05.517256  7782 leader_election.cc:304] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:05.521466  7812 raft_consensus.cc:2468] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:01:05.524394  7707 leader_election.cc:304] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:05.524734  8412 tablet_bootstrap.cc:492] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.525187  8413 raft_consensus.cc:2804] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.525534  8412 ts_tablet_manager.cc:1403] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.004s
I20260709 13:01:05.525648  8413 raft_consensus.cc:493] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.526130  8413 raft_consensus.cc:3060] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.528439  8412 raft_consensus.cc:359] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.529191  8412 raft_consensus.cc:740] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
W20260709 13:01:05.531703  7632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 95952.6us
I20260709 13:01:05.532797  7780 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.534381  8299 raft_consensus.cc:2749] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.535455  8299 raft_consensus.cc:493] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.536548  8281 raft_consensus.cc:493] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.536314  8299 raft_consensus.cc:515] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.537101  8281 raft_consensus.cc:515] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.521974  8415 raft_consensus.cc:493] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.517683  8221 leader_election.cc:290] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.540416  7815 raft_consensus.cc:2468] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 3.
I20260709 13:01:05.547276  8412 consensus_queue.cc:260] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.540931  8221 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.557708  8412 ts_tablet_manager.cc:1434] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:01:05.559507  8412 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.565361  7633 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:01:05.551142  8375 raft_consensus.cc:2749] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:05.554351  8266 raft_consensus.cc:493] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.569177  8453 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.568311  8299 leader_election.cc:290] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.545081  8415 raft_consensus.cc:515] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.580896  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.554075  8221 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.587870  8413 raft_consensus.cc:515] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.575008  8243 raft_consensus.cc:515] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.592962  8281 leader_election.cc:290] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.576871  8266 raft_consensus.cc:515] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.604772  8221 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.605080  8415 leader_election.cc:290] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.605415  8266 leader_election.cc:290] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.594180  8443 raft_consensus.cc:2804] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:05.590171  8324 raft_consensus.cc:515] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.580449  8453 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.610671  8443 raft_consensus.cc:697] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 3 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:05.611861  8243 leader_election.cc:290] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.611795  8443 consensus_queue.cc:237] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.612557  8453 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.612994  8413 leader_election.cc:290] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.610756  8324 leader_election.cc:290] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.613835  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:05.615586  7815 raft_consensus.cc:3060] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.607985  8454 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.624817  8299 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.625459  8299 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:05.627341  7708 leader_election.cc:336] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.627851  7708 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.628228  8299 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.628742  8413 raft_consensus.cc:2749] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:05.628974  7708 leader_election.cc:336] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:05.636305  7782 leader_election.cc:336] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.640213  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:05.622566  8454 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
W20260709 13:01:05.645062  7632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 65437.6us
W20260709 13:01:05.645313  7782 leader_election.cc:336] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.645627  7706 leader_election.cc:304] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.646131  8451 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.646853  8413 raft_consensus.cc:2749] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.647570  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
W20260709 13:01:05.648128  7708 leader_election.cc:336] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:05.648797  7708 leader_election.cc:336] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:05.649284  7708 leader_election.cc:336] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.648243  7740 raft_consensus.cc:3060] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.646775  8451 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.651624  8243 raft_consensus.cc:493] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.652766  8451 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.670866  7740 raft_consensus.cc:2468] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 2.
W20260709 13:01:05.646780  7634 leader_election.cc:336] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.673907  7815 raft_consensus.cc:2468] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
I20260709 13:01:05.652446  8243 raft_consensus.cc:515] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.644367  8454 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.703334  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.704066  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.705933  7707 leader_election.cc:304] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.704224  7667 raft_consensus.cc:2468] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:01:05.699616  8452 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.703310  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.707710  8266 raft_consensus.cc:493] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
W20260709 13:01:05.716589  7782 leader_election.cc:336] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.707561  8415 raft_consensus.cc:493] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
W20260709 13:01:05.733268  7634 leader_election.cc:336] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.734974  8243 leader_election.cc:290] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.730082  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:05.730955  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46081, user_credentials={real_user=slave}} blocked reactor thread for 52074.2us
I20260709 13:01:05.731709  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.737825  7667 raft_consensus.cc:2468] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:01:05.731498  8266 raft_consensus.cc:515] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.722797  8452 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:05.743821  7634 leader_election.cc:336] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.732306  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.744251  8459 raft_consensus.cc:493] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.744611  8452 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.733068  8415 raft_consensus.cc:515] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.744792  8459 raft_consensus.cc:515] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.746411  8266 leader_election.cc:290] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.746984  8415 leader_election.cc:290] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.748067  7740 raft_consensus.cc:2468] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:05.748164  8443 raft_consensus.cc:493] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.749361  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0b231c31d34cc19a247378b4e932bf" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.750051  7661 raft_consensus.cc:2468] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:01:05.741394  7780 leader_election.cc:304] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
W20260709 13:01:05.737460  7782 leader_election.cc:336] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.709954  8221 raft_consensus.cc:2804] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:01:05.744537  7634 leader_election.cc:336] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.752633  8221 raft_consensus.cc:697] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
W20260709 13:01:05.752694  7634 leader_election.cc:336] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.753029  8412 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.753224  7634 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.754065  8412 tablet_bootstrap.cc:492] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:05.753664  8221 consensus_queue.cc:237] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:05.754424  7634 leader_election.cc:336] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.754781  8412 ts_tablet_manager.cc:1403] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.196s	user 0.038s	sys 0.033s
I20260709 13:01:05.756453  8454 raft_consensus.cc:2749] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.756862  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.757694  7739 raft_consensus.cc:2468] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:05.761874  7632 leader_election.cc:304] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:05.749831  8415 raft_consensus.cc:493] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.757455  8412 raft_consensus.cc:359] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.757730  8443 raft_consensus.cc:515] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
W20260709 13:01:05.766853  7708 leader_election.cc:336] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:05.767460  7708 leader_election.cc:336] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.768245  8443 leader_election.cc:290] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.768183  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639d9a3ce83649d6ba3735d7d3d81fc5" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:05.768962  7737 raft_consensus.cc:3060] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.769739  8412 raft_consensus.cc:740] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.770490  8412 consensus_queue.cc:260] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.772156  7632 leader_election.cc:304] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.772617  8412 ts_tablet_manager.cc:1434] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:01:05.778518  7780 leader_election.cc:304] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.770665  7489 catalog_manager.cc:5697] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 2 to 3, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.785171  8375 raft_consensus.cc:2804] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:05.785897  8452 raft_consensus.cc:493] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.786397  8459 leader_election.cc:290] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.786553  8452 raft_consensus.cc:515] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.787042  8461 raft_consensus.cc:2804] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.787482  8461 raft_consensus.cc:493] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.787856  8461 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.788650  8452 leader_election.cc:290] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.744158  7738 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:01:05.790293  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.766871  8415 raft_consensus.cc:515] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.792764  7661 raft_consensus.cc:2468] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:01:05.793788  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.791029  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:05.794366  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.794539  8415 leader_election.cc:290] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.794756  7816 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
W20260709 13:01:05.795361  7782 leader_election.cc:336] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.794449  7739 raft_consensus.cc:2468] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:05.797897  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.798673  7740 raft_consensus.cc:2468] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:05.791803  7632 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.800124  7706 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.800848  8243 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.801365  8243 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.801713  8461 raft_consensus.cc:515] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.802240  8455 raft_consensus.cc:2749] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.802538  7780 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.802858  7667 raft_consensus.cc:2393] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81c129769e24f019dc9045ce8c09771 in current term 2: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:05.801249  7706 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.805737  8266 raft_consensus.cc:2804] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.806146  8266 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.806268  8243 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:05.807626  8457 raft_consensus.cc:2749] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.807878  7737 raft_consensus.cc:2468] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 2.
I20260709 13:01:05.806573  8266 raft_consensus.cc:3060] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.809182  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:05.809844  7816 raft_consensus.cc:2468] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
I20260709 13:01:05.810245  7780 leader_election.cc:304] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.810562  8299 raft_consensus.cc:2804] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.811054  8299 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.811440  8299 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:05.812271  7708 leader_election.cc:336] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:05.812832  7708 leader_election.cc:336] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.814429  7707 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.814639  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:05.815222  7817 raft_consensus.cc:2468] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:05.816318  7706 leader_election.cc:304] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.775058  8454 raft_consensus.cc:2749] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.820125  7632 leader_election.cc:304] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:05.822335  7707 leader_election.cc:304] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.828989  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.831612  7740 raft_consensus.cc:2468] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:01:05.816567  8415 raft_consensus.cc:2804] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:05.831609  7634 leader_election.cc:336] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.825040  7632 leader_election.cc:304] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:05.816972  8375 raft_consensus.cc:697] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:05.840931  7632 leader_election.cc:304] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.819234  8461 leader_election.cc:290] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.824620  8455 raft_consensus.cc:2804] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.844647  8412 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:05.844765  8459 raft_consensus.cc:2804] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.827956  8466 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.847501  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:05.825910  8452 raft_consensus.cc:2804] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.825523  8451 raft_consensus.cc:2804] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.825735  8443 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.853681  7741 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.840688  8453 raft_consensus.cc:2804] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.840013  8415 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.840462  8454 raft_consensus.cc:493] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.866905  8375 consensus_queue.cc:237] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:05.856936  8451 raft_consensus.cc:493] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.870185  8451 raft_consensus.cc:3060] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.872766  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.860713  8415 raft_consensus.cc:3060] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:05.878955  7634 leader_election.cc:336] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.880002  8413 raft_consensus.cc:493] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
W20260709 13:01:05.880437  7634 leader_election.cc:336] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.880648  8413 raft_consensus.cc:515] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.856593  8452 raft_consensus.cc:493] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.852095  8459 raft_consensus.cc:493] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.884812  8452 raft_consensus.cc:3060] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.885023  8459 raft_consensus.cc:3060] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:05.887106  7634 leader_election.cc:336] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:05.888556  7708 leader_election.cc:336] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:05.889770  8413 leader_election.cc:290] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:05.861244  8443 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.892092  8443 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.850345  8455 raft_consensus.cc:493] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.852942  8466 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.897401  7706 leader_election.cc:304] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.859499  8461 raft_consensus.cc:2804] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:05.859130  8453 raft_consensus.cc:493] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.914706  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:05.915676  7740 raft_consensus.cc:2468] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:05.896459  8455 raft_consensus.cc:3060] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.922326  7780 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:05.906000  8466 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.898326  8299 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:05.894101  8454 raft_consensus.cc:515] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.935252  7632 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:05.916942  8453 raft_consensus.cc:3060] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.931027  7488 catalog_manager.cc:5697] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:05.936995  7741 raft_consensus.cc:2468] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 2.
I20260709 13:01:05.940162  8221 raft_consensus.cc:2749] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:05.940601  7632 leader_election.cc:304] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.942157  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:05.942492  8243 raft_consensus.cc:2804] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.942857  7661 raft_consensus.cc:2468] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 1.
W20260709 13:01:05.943991  7633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 116421us
I20260709 13:01:05.944787  7633 leader_election.cc:304] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:05.921685  8461 raft_consensus.cc:697] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:05.946317  8461 consensus_queue.cc:237] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.947539  8266 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.948740  8459 raft_consensus.cc:515] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:05.952206  8443 raft_consensus.cc:2804] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:05.952765  8443 raft_consensus.cc:697] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:05.942883  8243 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:05.953649  8243 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:05.985704  7706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46081, user_credentials={real_user=slave}} blocked reactor thread for 88451.6us
I20260709 13:01:05.939592  8442 raft_consensus.cc:2804] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.009235  8412 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:06.010380  8412 tablet_bootstrap.cc:492] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:06.011286  8412 ts_tablet_manager.cc:1403] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.167s	user 0.021s	sys 0.004s
I20260709 13:01:05.987449  8281 raft_consensus.cc:2804] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.018041  8243 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:06.019656  8454 leader_election.cc:290] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:05.953699  8443 consensus_queue.cc:237] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.028949  8299 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:06.029814  8452 raft_consensus.cc:515] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:06.004297  8415 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
W20260709 13:01:06.035687  7782 leader_election.cc:336] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.013350  8442 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:06.051873  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:06.053637  7741 raft_consensus.cc:2468] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 1.
I20260709 13:01:06.051534  7706 leader_election.cc:304] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.039078  8281 raft_consensus.cc:493] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:06.061427  8415 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:06.058960  8413 raft_consensus.cc:2804] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.063388  8413 raft_consensus.cc:493] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:06.063814  8413 raft_consensus.cc:3060] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.054322  8442 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:06.067888  7782 leader_election.cc:336] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:06.070732  7708 leader_election.cc:336] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.083850  8412 raft_consensus.cc:359] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.116261  8412 raft_consensus.cc:740] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
W20260709 13:01:06.115424  7782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 47580.4us
I20260709 13:01:06.059222  8281 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.074152  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:06.070751  8455 raft_consensus.cc:515] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.124431  7660 raft_consensus.cc:2393] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b81c129769e24f019dc9045ce8c09771 in current term 2: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
I20260709 13:01:06.124928  8452 leader_election.cc:290] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:06.125695  8455 leader_election.cc:290] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:06.125856  7706 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.126639  8455 raft_consensus.cc:2749] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:06.127986  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c3df35a7c4361be5f6570b4d2af91" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:06.129174  7660 raft_consensus.cc:3060] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.135519  8281 raft_consensus.cc:515] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:01:06.115943  7708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 45247.5us
I20260709 13:01:06.070060  8459 leader_election.cc:290] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.083698  8243 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:06.064177  8266 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.140376  8281 leader_election.cc:290] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:06.133677  8466 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:06.140982  7782 leader_election.cc:336] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.145404  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:06.145925  8466 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:06.146045  7632 leader_election.cc:304] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:06.146100  7815 raft_consensus.cc:3060] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.147315  8281 raft_consensus.cc:2804] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.147500  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:06.147815  8281 raft_consensus.cc:493] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:06.148216  8281 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.130812  8413 raft_consensus.cc:515] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.150055  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:06.150682  7738 raft_consensus.cc:3060] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.148296  7741 raft_consensus.cc:2393] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b52243363f04d04862e5e631403e880 in current term 2: Already voted for candidate b81c129769e24f019dc9045ce8c09771 in this term.
I20260709 13:01:06.152650  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:06.153345  7661 raft_consensus.cc:3060] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:06.154026  7708 leader_election.cc:336] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:06.154584  7708 leader_election.cc:336] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.154197  8413 leader_election.cc:290] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:06.074851  8451 raft_consensus.cc:515] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:06.159572  8451 leader_election.cc:290] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:01:06.136006  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 213781us
W20260709 13:01:06.117110  7634 leader_election.cc:336] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.162539  7780 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
W20260709 13:01:06.162642  7634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 45563.2us
I20260709 13:01:06.163404  8243 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.163784  8243 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
W20260709 13:01:06.163825  7782 leader_election.cc:336] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.164271  8243 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.161299  7815 raft_consensus.cc:2468] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
W20260709 13:01:06.165818  7708 leader_election.cc:336] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.176888  7660 raft_consensus.cc:2468] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
I20260709 13:01:06.177459  8442 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
W20260709 13:01:06.178258  7708 leader_election.cc:336] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:06.178792  7708 consensus_peers.cc:597] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.179662  8442 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.183275  7738 raft_consensus.cc:2468] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 2.
I20260709 13:01:06.186719  7706 leader_election.cc:304] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.190371  7492 catalog_manager.cc:5697] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.133074  8453 raft_consensus.cc:515] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.195107  7707 leader_election.cc:304] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.194851  8412 consensus_queue.cc:260] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.200913  8470 raft_consensus.cc:2804] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.201438  8452 raft_consensus.cc:2804] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.209051  8470 raft_consensus.cc:697] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:01:06.209553  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:06.210700  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:06.211427  7740 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.216303  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:06.217242  7817 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.210767  7632 leader_election.cc:304] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:06.209872  8452 raft_consensus.cc:697] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:01:06.220088  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:06.219910  8452 consensus_queue.cc:237] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.220736  7660 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.221302  8474 raft_consensus.cc:2804] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.221899  8474 raft_consensus.cc:697] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:06.223034  8474 consensus_queue.cc:237] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.223693  7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0b231c31d34cc19a247378b4e932bf" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:06.224336  7662 raft_consensus.cc:3060] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.226086  7817 raft_consensus.cc:2468] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 2.
I20260709 13:01:06.227449  8470 consensus_queue.cc:237] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:06.234730  7740 raft_consensus.cc:2468] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 2.
W20260709 13:01:06.234601  7634 leader_election.cc:336] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.235164  7660 raft_consensus.cc:2468] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 2.
I20260709 13:01:06.236565  7632 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:06.236241  7634 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:06.245348  7667 raft_consensus.cc:2393] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b81c129769e24f019dc9045ce8c09771 in current term 2: Already voted for candidate 5b52243363f04d04862e5e631403e880 in this term.
W20260709 13:01:06.247370  7634 leader_election.cc:336] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.245391  8266 raft_consensus.cc:2804] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.245283  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:06.248468  8459 raft_consensus.cc:2749] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:06.250296  8412 ts_tablet_manager.cc:1434] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.239s	user 0.010s	sys 0.009s
I20260709 13:01:06.253001  7738 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.253762  8412 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:06.249818  7661 raft_consensus.cc:2468] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
I20260709 13:01:06.255613  7817 raft_consensus.cc:1275] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:06.250910  8266 raft_consensus.cc:697] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:06.261145  7706 leader_election.cc:304] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
W20260709 13:01:06.266767  7634 leader_election.cc:336] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.265334  8466 consensus_queue.cc:1048] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:06.274312  8243 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:06.277920  7815 raft_consensus.cc:2393] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b81c129769e24f019dc9045ce8c09771 in current term 2: Already voted for candidate 1075f1083cc84c349b3a0bd57774c1e7 in this term.
I20260709 13:01:06.282003  8266 consensus_queue.cc:237] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.266347  8415 raft_consensus.cc:2804] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.283802  7707 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.283987  8415 raft_consensus.cc:697] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:01:06.285125  8415 consensus_queue.cc:237] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.285526  8466 raft_consensus.cc:2749] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:06.300841  8453 leader_election.cc:290] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.301934  7706 leader_election.cc:304] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.303160  8452 raft_consensus.cc:3060] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.256189  8281 raft_consensus.cc:515] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.292482  7633 leader_election.cc:304] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 
I20260709 13:01:06.311848  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7201e09d4ad45e1ac2b617f22ed4a70" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
W20260709 13:01:06.318522  7634 consensus_peers.cc:597] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.320519  7780 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
W20260709 13:01:06.319100  7634 leader_election.cc:336] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:06.322755  7634 leader_election.cc:336] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.327726  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:06.328557  7741 raft_consensus.cc:2393] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1075f1083cc84c349b3a0bd57774c1e7 in current term 2: Already voted for candidate b81c129769e24f019dc9045ce8c09771 in this term.
I20260709 13:01:06.331153  8464 raft_consensus.cc:2804] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.314425  8243 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:06.331744  8464 raft_consensus.cc:697] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:06.332664  8464 consensus_queue.cc:237] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:06.333527  7738 raft_consensus.cc:2468] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 2.
I20260709 13:01:06.334461  8484 raft_consensus.cc:2804] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.335165  8452 raft_consensus.cc:2749] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:06.340569  8281 leader_election.cc:290] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.342669  7813 raft_consensus.cc:1275] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Refusing update from remote peer 5b52243363f04d04862e5e631403e880: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:06.350688  7780 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.363534  7740 raft_consensus.cc:2468] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 2.
I20260709 13:01:06.368495  8478 raft_consensus.cc:2804] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.369011  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
W20260709 13:01:06.369980  7782 leader_election.cc:336] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.371580  7662 raft_consensus.cc:2468] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 2.
I20260709 13:01:06.354744  8484 raft_consensus.cc:697] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:06.377753  7782 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:06.379953  7632 leader_election.cc:304] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:06.381088  7739 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.383217  8266 raft_consensus.cc:2804] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.383741  8266 raft_consensus.cc:697] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:06.382773  8484 consensus_queue.cc:237] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:06.384672  8266 consensus_queue.cc:237] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.379689  8478 raft_consensus.cc:697] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:06.386545  8375 raft_consensus.cc:2749] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:06.386650  8478 consensus_queue.cc:237] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:06.387571  7780 leader_election.cc:304] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.388444  8375 raft_consensus.cc:2804] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.389008  8375 raft_consensus.cc:697] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:06.372747  8443 consensus_queue.cc:1048] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:01:06.400931  7634 leader_election.cc:336] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:06.425484  7634 leader_election.cc:336] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:06.432636  8375 consensus_queue.cc:237] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:06.441365  7739 raft_consensus.cc:2468] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b52243363f04d04862e5e631403e880 in term 2.
W20260709 13:01:06.490643  7634 consensus_peers.cc:597] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.492777  7632 leader_election.cc:304] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:06.502113  7738 raft_consensus.cc:1275] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 1075f1083cc84c349b3a0bd57774c1e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:06.499457  8417 raft_consensus.cc:493] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.504451  8417 raft_consensus.cc:515] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.498584  8474 raft_consensus.cc:2804] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:06.509421  8474 raft_consensus.cc:697] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Leader. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:06.510515  8474 consensus_queue.cc:237] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.512447  8412 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:06.516649  8412 tablet_bootstrap.cc:492] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:06.517413  8412 ts_tablet_manager.cc:1403] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.264s	user 0.015s	sys 0.014s
I20260709 13:01:06.533867  8451 consensus_queue.cc:1048] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:06.597947  8417 leader_election.cc:290] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.598995  8417 raft_consensus.cc:493] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.598496  7488 catalog_manager.cc:5697] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.599797  8417 raft_consensus.cc:515] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:06.601279  7488 catalog_manager.cc:5697] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.593254  8412 raft_consensus.cc:359] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:06.613653  8412 raft_consensus.cc:740] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.612217  7488 catalog_manager.cc:5697] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.617770  8412 consensus_queue.cc:260] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:06.576491  7739 raft_consensus.cc:1275] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 5b52243363f04d04862e5e631403e880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:06.639236  7488 catalog_manager.cc:5697] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.649446  7488 catalog_manager.cc:5697] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.663887  8412 ts_tablet_manager.cc:1434] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.146s	user 0.012s	sys 0.000s
I20260709 13:01:06.665473  8412 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
W20260709 13:01:06.669018  7782 consensus_peers.cc:597] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.661986  8442 consensus_queue.cc:1048] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:01:06.698699  7782 consensus_peers.cc:597] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:06.678332  8519 raft_consensus.cc:493] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.709328  8514 raft_consensus.cc:493] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.710041  8514 raft_consensus.cc:515] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:06.714661  8514 leader_election.cc:290] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:06.695683  8518 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.706533  8521 raft_consensus.cc:493] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.725157  7740 raft_consensus.cc:1275] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 5b52243363f04d04862e5e631403e880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:06.735648  7782 consensus_peers.cc:597] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:06.735240  7708 consensus_peers.cc:597] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.717432  7738 raft_consensus.cc:1275] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 5b52243363f04d04862e5e631403e880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:06.743777  7634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 74190.2us
W20260709 13:01:06.752540  7634 consensus_peers.cc:597] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.733534  8512 log.cc:927] Time spent T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880: Append to log took a long time: real 0.066s	user 0.000s	sys 0.002s
I20260709 13:01:06.749883  8266 consensus_queue.cc:1048] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:06.772907  8417 leader_election.cc:290] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:06.777314  8514 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.722182  8519 raft_consensus.cc:515] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.799891  8514 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:01:06.802791  8515 log.cc:927] Time spent T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7: Append to log took a long time: real 0.142s	user 0.003s	sys 0.000s
I20260709 13:01:06.803952  8514 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:06.726470  8518 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.807754  8519 leader_election.cc:290] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.809703  8518 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.737015  8521 raft_consensus.cc:515] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:06.812222  7492 catalog_manager.cc:5697] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.822700  7492 catalog_manager.cc:5697] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.825129  7492 catalog_manager.cc:5697] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:06.840606  7632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 52443.5us
I20260709 13:01:06.845229  8483 consensus_queue.cc:1048] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:01:06.856251  8521 leader_election.cc:290] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:01:06.859995  7708 consensus_peers.cc:597] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.863866  7814 raft_consensus.cc:1275] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:06.864713  7708 consensus_peers.cc:597] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.865299  8412 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:06.878577  8521 raft_consensus.cc:493] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.879205  8521 raft_consensus.cc:515] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.894918  8412 tablet_bootstrap.cc:492] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:06.895815  8412 ts_tablet_manager.cc:1403] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.231s	user 0.031s	sys 0.027s
I20260709 13:01:06.900630  8518 raft_consensus.cc:493] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.901273  8518 raft_consensus.cc:515] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:06.903504  8518 leader_election.cc:290] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:06.904770  8521 leader_election.cc:290] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
W20260709 13:01:06.916869  7782 consensus_peers.cc:597] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:06.891146  8470 consensus_queue.cc:1048] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:06.943555  7662 raft_consensus.cc:1275] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:06.947598  7708 consensus_peers.cc:597] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:06.951499  8412 raft_consensus.cc:359] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:06.952265  8412 raft_consensus.cc:740] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
W20260709 13:01:06.952833  7782 consensus_peers.cc:597] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.953315  7782 consensus_peers.cc:597] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:06.955047  7740 raft_consensus.cc:1275] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 5b52243363f04d04862e5e631403e880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:06.953405  8412 consensus_queue.cc:260] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:01:06.953811  7782 consensus_peers.cc:597] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:06.959372  7740 raft_consensus.cc:1275] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 5b52243363f04d04862e5e631403e880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:06.960808  8412 ts_tablet_manager.cc:1434] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:01:06.961877  8324 consensus_queue.cc:1048] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:06.971576  7634 consensus_peers.cc:597] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.972070  7634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 46513.8us
W20260709 13:01:06.977833  7780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46081, user_credentials={real_user=slave}} blocked reactor thread for 52291.9us
I20260709 13:01:06.978507  7742 raft_consensus.cc:1275] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 5b52243363f04d04862e5e631403e880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:06.979146  8324 consensus_queue.cc:1048] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:06.974437  7661 raft_consensus.cc:1275] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:06.982098  8521 raft_consensus.cc:493] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.997205  7782 consensus_peers.cc:597] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:06.999204  7782 consensus_peers.cc:597] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:06.986745  8518 raft_consensus.cc:493] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.980337  8413 consensus_queue.cc:1048] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:01:06.991194  8484 consensus_queue.cc:1048] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:01:07.001701  8521 raft_consensus.cc:515] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:07.019330  8521 leader_election.cc:290] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:07.047947  7817 raft_consensus.cc:1275] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer 5b52243363f04d04862e5e631403e880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:07.008008  8518 raft_consensus.cc:515] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:07.091693  8518 leader_election.cc:290] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
W20260709 13:01:07.093012  7782 consensus_peers.cc:597] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.093523  7782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 93628us
I20260709 13:01:07.100054  8459 consensus_queue.cc:1048] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:07.110668  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.111001  7662 raft_consensus.cc:1275] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 1075f1083cc84c349b3a0bd57774c1e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:07.112082  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.113487  7734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f610a99a66b94fc0aa4565a0494013f0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.119100  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.121919  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.122915  7734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.124330  8518 raft_consensus.cc:493] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.124202  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.125053  8518 raft_consensus.cc:515] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.125996  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.127760  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.128405  8518 leader_election.cc:290] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:07.130584  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:07.130798  7634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 155131us
I20260709 13:01:07.127087  7489 catalog_manager.cc:5697] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.147069  7489 catalog_manager.cc:5697] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.135915  8412 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
W20260709 13:01:07.130822  7782 consensus_peers.cc:597] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:07.149101  7489 catalog_manager.cc:5697] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.151882  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.162744  8518 raft_consensus.cc:493] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.134845  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.163373  8518 raft_consensus.cc:515] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:07.132843  7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4495c3f82450cbeb8cf7b1ce76dce" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.165668  7736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.165709  8518 leader_election.cc:290] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:07.133474  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f610a99a66b94fc0aa4565a0494013f0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.142223  8470 consensus_queue.cc:1048] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:07.132881  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.179697  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.182636  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:07.183516  7782 consensus_peers.cc:597] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.187168  7634 consensus_peers.cc:597] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.190099  7634 consensus_peers.cc:597] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:07.198868  7782 consensus_peers.cc:597] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:07.234018  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:07.235566  7782 consensus_peers.cc:597] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:07.236670  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80b3e6d140c42ab83aedacbad5a486d" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
W20260709 13:01:07.241683  7634 consensus_peers.cc:597] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.242611  7634 consensus_peers.cc:597] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:07.246832  7634 consensus_peers.cc:597] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.247393  7634 consensus_peers.cc:597] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:07.248879  7634 consensus_peers.cc:597] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:07.255112  7708 consensus_peers.cc:597] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.255592  7708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 108049us
W20260709 13:01:07.268847  8549 log.cc:927] Time spent T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:01:07.269718  8518 raft_consensus.cc:493] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.270309  8518 raft_consensus.cc:515] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:07.272755  8518 leader_election.cc:290] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:07.274435  7666 raft_consensus.cc:1275] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 1075f1083cc84c349b3a0bd57774c1e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:07.247998  8476 consensus_queue.cc:1048] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:01:07.267932  8406 leader_election.cc:304] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.286530  8406 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.287501  8518 raft_consensus.cc:2749] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.288254  8518 raft_consensus.cc:2749] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.288369  8406 leader_election.cc:304] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.289549  8518 raft_consensus.cc:2749] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.290696  8406 leader_election.cc:304] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.291474  8518 raft_consensus.cc:2749] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.292913  8406 leader_election.cc:304] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.293665  8518 raft_consensus.cc:2749] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:07.299717  7634 consensus_peers.cc:597] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.300316  7634 consensus_peers.cc:597] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.300674  7634 consensus_peers.cc:597] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.301060  7634 consensus_peers.cc:597] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.301427  7634 consensus_peers.cc:597] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:07.308393  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4495c3f82450cbeb8cf7b1ce76dce" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:07.310334  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8295a58ce0dd4fb99fffd754746b8b0a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:07.309863  7743 raft_consensus.cc:1275] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 1075f1083cc84c349b3a0bd57774c1e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:07.312160  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baabbed5310440d19416189e295e3db0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:07.319078  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52fbfcad0d747cfb5758693f2cf5be6" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:07.319170  7812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:07.320756  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:07.317663  7489 catalog_manager.cc:5697] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.326102  7489 catalog_manager.cc:5697] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 reported cstate change: term changed from 1 to 2, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 5b52243363f04d04862e5e631403e880 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5b52243363f04d04862e5e631403e880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:07.327963  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:01:07.344331  7782 consensus_peers.cc:597] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:07.347708  7634 consensus_peers.cc:597] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:07.323081  8406 leader_election.cc:304] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.357550  8518 raft_consensus.cc:2749] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.359835  8406 leader_election.cc:304] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.362226  8518 raft_consensus.cc:2749] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.366448  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.387502  8412 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:07.388653  8412 tablet_bootstrap.cc:492] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:07.389346  8412 ts_tablet_manager.cc:1403] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.254s	user 0.019s	sys 0.010s
I20260709 13:01:07.393791  8412 raft_consensus.cc:359] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.394516  8412 raft_consensus.cc:740] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.396042  8476 consensus_queue.cc:1048] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:07.396620  8412 consensus_queue.cc:260] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.399067  8412 ts_tablet_manager.cc:1434] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:01:07.399866  8412 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:07.420058  8407 leader_election.cc:304] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:07.422355  8518 raft_consensus.cc:2749] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:07.435261  7708 consensus_peers.cc:597] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:07.444859  8407 leader_election.cc:304] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.446250  8407 leader_election.cc:304] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:07.447402  8407 leader_election.cc:304] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:07.448323  8518 raft_consensus.cc:2749] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.448954  8518 raft_consensus.cc:2749] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.449543  8518 raft_consensus.cc:2749] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.485913  8375 consensus_queue.cc:1048] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:07.508276  8412 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:07.514561  8412 tablet_bootstrap.cc:492] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:07.515290  8412 ts_tablet_manager.cc:1403] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.116s	user 0.026s	sys 0.041s
I20260709 13:01:07.518152  8412 raft_consensus.cc:359] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.522862  8412 raft_consensus.cc:740] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.523681  8412 consensus_queue.cc:260] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.529104  8412 ts_tablet_manager.cc:1434] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:01:07.530339  8412 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
W20260709 13:01:07.536484  8407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:41545, user_credentials={real_user=slave}} blocked reactor thread for 89146.5us
I20260709 13:01:07.537619  8407 leader_election.cc:304] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:07.539417  8562 raft_consensus.cc:2749] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.540107  8407 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:07.541142  8562 raft_consensus.cc:2749] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:07.541754  8407 leader_election.cc:304] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:07.549278  8562 raft_consensus.cc:2749] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:07.635754  7634 consensus_peers.cc:597] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:07.636324  7634 consensus_peers.cc:597] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:07.638293  8412 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:07.639420  8412 tablet_bootstrap.cc:492] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:07.640033  8412 ts_tablet_manager.cc:1403] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.110s	user 0.019s	sys 0.004s
I20260709 13:01:07.644191  8412 raft_consensus.cc:359] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:07.644888  8412 raft_consensus.cc:740] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.645740  8412 consensus_queue.cc:260] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:07.649135  8412 ts_tablet_manager.cc:1434] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:07.660032  8412 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
W20260709 13:01:07.660398  7634 consensus_peers.cc:597] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:07.669880  8466 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.670481  8466 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:07.674299  8466 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:07.676275  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.676990  7663 raft_consensus.cc:2468] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
I20260709 13:01:07.679175  7706 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:07.681069  8466 raft_consensus.cc:2804] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:07.681525  8466 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:07.682021  7708 leader_election.cc:336] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:07.682562  8466 raft_consensus.cc:3060] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.691316  8466 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:07.695827  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:07.696547  7663 raft_consensus.cc:3060] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:07.707099  7708 leader_election.cc:336] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:07.721698  8466 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 election: Requested vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:07.727135  7663 raft_consensus.cc:2468] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 3.
I20260709 13:01:07.728701  7706 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:07.729959  8466 raft_consensus.cc:2804] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:07.730846  8466 raft_consensus.cc:697] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 3 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:01:07.731906  8466 consensus_queue.cc:237] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:07.746999  8412 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:07.748205  8412 tablet_bootstrap.cc:492] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:07.749042  8412 ts_tablet_manager.cc:1403] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.038s
I20260709 13:01:07.752261  8412 raft_consensus.cc:359] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.753079  8412 raft_consensus.cc:740] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.755409  8412 consensus_queue.cc:260] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.759214  8412 ts_tablet_manager.cc:1434] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:01:07.760037  8412 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
W20260709 13:01:07.765801  7634 consensus_peers.cc:597] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:07.777541  7492 catalog_manager.cc:5697] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 1 to 3, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:07.800232  8412 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:07.801257  8412 tablet_bootstrap.cc:492] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:07.802196  8412 ts_tablet_manager.cc:1403] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.005s
I20260709 13:01:07.805189  8412 raft_consensus.cc:359] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.806346  8412 raft_consensus.cc:740] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.807294  8412 consensus_queue.cc:260] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:07.810204  8412 ts_tablet_manager.cc:1434] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:07.811159  8412 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:07.887432  8412 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:07.888597  8412 tablet_bootstrap.cc:492] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:07.889273  8412 ts_tablet_manager.cc:1403] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.078s	user 0.039s	sys 0.032s
I20260709 13:01:07.892138  8412 raft_consensus.cc:359] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:07.893038  8412 raft_consensus.cc:740] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.894274  8412 consensus_queue.cc:260] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:07.896183   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38589
I20260709 13:01:07.900187  8412 ts_tablet_manager.cc:1434] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:01:07.900727  8585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38589 every 8 connection(s)
I20260709 13:01:07.903234  8412 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:07.939412  8562 raft_consensus.cc:493] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.950758  8562 raft_consensus.cc:515] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:07.967588  8562 leader_election.cc:290] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:07.969231  8412 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:07.970391  8412 tablet_bootstrap.cc:492] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:07.971088  8412 ts_tablet_manager.cc:1403] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.027s
I20260709 13:01:07.979182  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:07.982256  8412 raft_consensus.cc:359] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:07.983414  8412 raft_consensus.cc:740] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.984158  8412 consensus_queue.cc:260] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:07.985816  8412 ts_tablet_manager.cc:1434] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:01:07.986613  8412 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:07.987042  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:07.996858  8517 raft_consensus.cc:3060] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.015779  8406 leader_election.cc:304] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:08.016695  8562 raft_consensus.cc:2749] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:08.022135  8531 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.026023  8562 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.026595  8562 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.040164  8471 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.065811  8586 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40329
I20260709 13:01:08.066340  8586 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:08.041157  8471 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.067408  8586 heartbeater.cc:507] Master 127.0.107.254:40329 requested a full tablet report, sending...
I20260709 13:01:08.070545  8471 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:08.074368  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:08.075035  7740 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 2.
I20260709 13:01:08.072486  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:08.066268  8562 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:08.076308  8505 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 1.
I20260709 13:01:08.080905  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:08.081737  7740 raft_consensus.cc:2393] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 in current term 2: Already voted for candidate b81c129769e24f019dc9045ce8c09771 in this term.
I20260709 13:01:08.080929  7782 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:08.083007  8471 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:08.083361  8471 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.083688  8471 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.087568  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:08.117668  8471 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.119314  7813 raft_consensus.cc:2368] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 for earlier term 2. Current term is 3.
I20260709 13:01:08.122587  8412 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.123245  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:08.123944  7740 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.127332  8513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3"
I20260709 13:01:08.129892  8513 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.136715  8412 tablet_bootstrap.cc:492] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.138013  8412 ts_tablet_manager.cc:1403] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.019s
I20260709 13:01:08.140254  7740 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 3.
I20260709 13:01:08.127226  8471 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:08.142753  7780 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:08.143656  8471 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:08.144402  8471 raft_consensus.cc:697] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:08.144749  8497 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.144968  8407 leader_election.cc:400] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545) with higher term. Message: Invalid argument: T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 for earlier term 2. Current term is 3.
I20260709 13:01:08.145411  8407 leader_election.cc:403] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.145473  8471 consensus_queue.cc:237] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.158707  8513 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 3.
I20260709 13:01:08.159529  8562 raft_consensus.cc:2749] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545) with higher term. Message: Invalid argument: T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80af46fc024041de81a638d29912c8a3 for earlier term 2. Current term is 3.
I20260709 13:01:08.223527  8513 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.230329  8531 raft_consensus.cc:3060] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.229979  7492 catalog_manager.cc:5697] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 1 to 3, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:08.247162  7663 raft_consensus.cc:1275] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:08.249388  8455 consensus_queue.cc:1048] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:08.260202  8412 raft_consensus.cc:359] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.261049  8412 raft_consensus.cc:740] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.271445  8517 raft_consensus.cc:3060] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.275955  8505 raft_consensus.cc:3060] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.278859  8492 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.282049  8412 consensus_queue.cc:260] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.290177  7492 ts_manager.cc:194] Re-registered known tserver with Master: 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:08.293776  8491 raft_consensus.cc:3060] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.301259  8412 ts_tablet_manager.cc:1434] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.163s	user 0.006s	sys 0.001s
I20260709 13:01:08.302299  8412 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.316650  8531 raft_consensus.cc:3060] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.395380  8505 raft_consensus.cc:1275] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:08.478091  8618 consensus_queue.cc:1048] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.498876  8412 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.499922  8412 tablet_bootstrap.cc:492] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.500567  8412 ts_tablet_manager.cc:1403] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.198s	user 0.045s	sys 0.066s
I20260709 13:01:08.503120  8412 raft_consensus.cc:359] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.503859  8412 raft_consensus.cc:740] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.504541  8412 consensus_queue.cc:260] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.506299  8412 ts_tablet_manager.cc:1434] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:01:08.507802  8412 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.524559  8412 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.525382  8412 tablet_bootstrap.cc:492] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.525976  8412 ts_tablet_manager.cc:1403] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:01:08.527868  8412 raft_consensus.cc:359] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.528398  8412 raft_consensus.cc:740] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.529071  8412 consensus_queue.cc:260] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.539757  7492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52618
I20260709 13:01:08.539868  8412 ts_tablet_manager.cc:1434] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.004s
I20260709 13:01:08.541126  8412 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.554630  8586 heartbeater.cc:499] Master 127.0.107.254:40329 was elected leader, sending a full tablet report...
I20260709 13:01:08.571105  8412 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.573699  8412 tablet_bootstrap.cc:492] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.574447  8412 ts_tablet_manager.cc:1403] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.003s
I20260709 13:01:08.577042  8412 raft_consensus.cc:359] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:08.577749  8412 raft_consensus.cc:740] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.578467  8412 consensus_queue.cc:260] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:08.581080  8412 ts_tablet_manager.cc:1434] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:08.582062  8412 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.607218  8412 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.608186  8412 tablet_bootstrap.cc:492] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.608934  8412 ts_tablet_manager.cc:1403] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.000s
I20260709 13:01:08.611996  8412 raft_consensus.cc:359] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:08.612864  8412 raft_consensus.cc:740] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.613534  8412 consensus_queue.cc:260] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:08.615674  8412 ts_tablet_manager.cc:1434] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:01:08.616544  8412 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.640810  8412 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.641821  8412 tablet_bootstrap.cc:492] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.642398  8412 ts_tablet_manager.cc:1403] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.005s
I20260709 13:01:08.644336  8412 raft_consensus.cc:359] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.644999  8412 raft_consensus.cc:740] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.645682  8412 consensus_queue.cc:260] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.647408  8412 ts_tablet_manager.cc:1434] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:01:08.648447  8412 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.663494  8412 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.664664  8412 tablet_bootstrap.cc:492] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.666033  8412 ts_tablet_manager.cc:1403] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:01:08.671254  8412 raft_consensus.cc:359] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:08.672333  8412 raft_consensus.cc:740] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.672953  8412 consensus_queue.cc:260] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:08.674499  8412 ts_tablet_manager.cc:1434] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:08.675490  8412 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.696671  8412 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.697422  8412 tablet_bootstrap.cc:492] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.698065  8412 ts_tablet_manager.cc:1403] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 13:01:08.699955  8412 raft_consensus.cc:359] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:08.700487  8412 raft_consensus.cc:740] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.701054  8412 consensus_queue.cc:260] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:08.702889  8412 ts_tablet_manager.cc:1434] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:08.704018  8412 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.721323  8412 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.722224  8412 tablet_bootstrap.cc:492] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.723008  8412 ts_tablet_manager.cc:1403] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:01:08.725044  8412 raft_consensus.cc:359] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:08.725600  8412 raft_consensus.cc:740] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.726186  8412 consensus_queue.cc:260] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:08.728201  8412 ts_tablet_manager.cc:1434] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:01:08.729902  8412 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.753159  8412 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.754122  8412 tablet_bootstrap.cc:492] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.754787  8412 ts_tablet_manager.cc:1403] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:01:08.755311  7738 raft_consensus.cc:1275] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Refusing update from remote peer 1075f1083cc84c349b3a0bd57774c1e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:08.757447  8491 raft_consensus.cc:1275] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Refusing update from remote peer 1075f1083cc84c349b3a0bd57774c1e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:08.758036  8478 consensus_queue.cc:1048] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.758150  8412 raft_consensus.cc:359] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.759078  8412 raft_consensus.cc:740] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.759688  8412 consensus_queue.cc:260] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.760115  8478 consensus_queue.cc:1048] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:08.761936  8412 ts_tablet_manager.cc:1434] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:08.762729  8412 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:08.767668  8505 raft_consensus.cc:3060] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.877053  8492 raft_consensus.cc:3060] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.912096  8531 raft_consensus.cc:3060] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.922811  8412 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:08.924137  8412 tablet_bootstrap.cc:492] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:08.924841  8412 ts_tablet_manager.cc:1403] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.162s	user 0.049s	sys 0.090s
I20260709 13:01:08.927623  8412 raft_consensus.cc:359] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.928356  8412 raft_consensus.cc:740] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.929086  8412 consensus_queue.cc:260] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:08.930649  8412 ts_tablet_manager.cc:1434] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:01:08.931720  8412 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
W20260709 13:01:08.957876  7782 consensus_peers.cc:597] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:09.002326  8491 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.027731  8412 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.029230  8412 tablet_bootstrap.cc:492] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.032647  8412 ts_tablet_manager.cc:1403] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.011s
I20260709 13:01:09.035678  8412 raft_consensus.cc:359] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.036453  8412 raft_consensus.cc:740] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.037173  8412 consensus_queue.cc:260] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.040022  8412 ts_tablet_manager.cc:1434] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:09.040855  8412 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.064699  8412 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.065752  8412 tablet_bootstrap.cc:492] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.066421  8412 ts_tablet_manager.cc:1403] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.006s
I20260709 13:01:09.068874  8412 raft_consensus.cc:359] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.069599  8412 raft_consensus.cc:740] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.070374  8412 consensus_queue.cc:260] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.072574  8412 ts_tablet_manager.cc:1434] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:09.073354  8412 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.107872  8412 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.108860  8412 tablet_bootstrap.cc:492] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.109531  8412 ts_tablet_manager.cc:1403] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.018s
I20260709 13:01:09.112126  8412 raft_consensus.cc:359] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:09.112802  8412 raft_consensus.cc:740] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.113477  8412 consensus_queue.cc:260] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:09.115497  8412 ts_tablet_manager.cc:1434] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:09.116292  8412 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.144449  8412 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.145458  8412 tablet_bootstrap.cc:492] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.146128  8412 ts_tablet_manager.cc:1403] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.004s
I20260709 13:01:09.148571  8412 raft_consensus.cc:359] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:09.149215  8412 raft_consensus.cc:740] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.151044  8412 consensus_queue.cc:260] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:09.153163  8412 ts_tablet_manager.cc:1434] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:09.154552  8412 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.172700  8412 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.173444  8412 tablet_bootstrap.cc:492] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.174021  8412 ts_tablet_manager.cc:1403] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:01:09.175961  8412 raft_consensus.cc:359] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.176476  8412 raft_consensus.cc:740] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.177002  8412 consensus_queue.cc:260] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.178857  8412 ts_tablet_manager.cc:1434] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:09.180348  8412 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.200634  8412 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.201399  8412 tablet_bootstrap.cc:492] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.201982  8412 ts_tablet_manager.cc:1403] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 13:01:09.203969  8412 raft_consensus.cc:359] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:09.204454  8412 raft_consensus.cc:740] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.205086  8412 consensus_queue.cc:260] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:09.208053  8412 ts_tablet_manager.cc:1434] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:09.210136  8412 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.226429  8412 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.227181  8412 tablet_bootstrap.cc:492] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.227764  8412 ts_tablet_manager.cc:1403] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:01:09.229918  8412 raft_consensus.cc:359] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.230451  8412 raft_consensus.cc:740] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.231034  8412 consensus_queue.cc:260] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.233826  8412 ts_tablet_manager.cc:1434] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:01:09.235186  8412 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.256431  8412 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.257300  8412 tablet_bootstrap.cc:492] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.257906  8412 ts_tablet_manager.cc:1403] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 13:01:09.259763  8412 raft_consensus.cc:359] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:09.260262  8412 raft_consensus.cc:740] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.260906  8412 consensus_queue.cc:260] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:09.262171  8412 ts_tablet_manager.cc:1434] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:09.262938  8412 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.275221  8412 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.276037  8412 tablet_bootstrap.cc:492] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.276794  8412 ts_tablet_manager.cc:1403] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:01:09.279086  8412 raft_consensus.cc:359] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.279906  8412 raft_consensus.cc:740] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.280572  8412 consensus_queue.cc:260] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:09.281200  8491 raft_consensus.cc:3060] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.282837  8412 ts_tablet_manager.cc:1434] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:09.283710  8412 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Bootstrap starting.
I20260709 13:01:09.335417  8412 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.336382  8412 tablet_bootstrap.cc:492] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Bootstrap complete.
I20260709 13:01:09.337052  8412 ts_tablet_manager.cc:1403] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.027s
I20260709 13:01:09.339396  8412 raft_consensus.cc:359] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:09.340083  8412 raft_consensus.cc:740] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.341037  8412 consensus_queue.cc:260] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:09.343238  8412 ts_tablet_manager.cc:1434] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:09.476073  8491 raft_consensus.cc:3060] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.810070  8491 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:16.091499  7634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.013s
W20260709 13:01:16.092165  7634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.009s	sys 0.013s
I20260709 13:01:16.413945  8674 raft_consensus.cc:493] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b52243363f04d04862e5e631403e880)
I20260709 13:01:16.416042  8674 raft_consensus.cc:515] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:16.427393  8674 leader_election.cc:290] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:16.428097  8674 raft_consensus.cc:493] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b81c129769e24f019dc9045ce8c09771)
I20260709 13:01:16.428701  8674 raft_consensus.cc:515] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:16.452378  8674 leader_election.cc:290] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:16.479156  8676 raft_consensus.cc:493] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.480001  8676 raft_consensus.cc:515] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:16.482682  8681 raft_consensus.cc:493] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.483384  8681 raft_consensus.cc:515] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
W20260709 13:01:16.487592  7635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.006s	sys 0.015s
W20260709 13:01:16.506748  7635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.007s	sys 0.015s
I20260709 13:01:16.490234  8676 leader_election.cc:290] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:16.496692  8658 raft_consensus.cc:493] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b81c129769e24f019dc9045ce8c09771)
I20260709 13:01:16.518057  8658 raft_consensus.cc:515] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:16.521028  8658 leader_election.cc:290] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:16.527647  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.497887  8675 raft_consensus.cc:493] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.498728  8679 raft_consensus.cc:493] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.516273  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.544600  8491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:16.545436  8675 raft_consensus.cc:515] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:16.548625  8679 raft_consensus.cc:515] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:16.550606  8674 raft_consensus.cc:493] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b81c129769e24f019dc9045ce8c09771)
I20260709 13:01:16.558209  8674 raft_consensus.cc:515] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:16.560634  8674 leader_election.cc:290] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:16.563014  8676 raft_consensus.cc:493] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.565827  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f610a99a66b94fc0aa4565a0494013f0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.572328  8679 leader_election.cc:290] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:16.562868  8670 raft_consensus.cc:493] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.563702  8676 raft_consensus.cc:515] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:16.573683  8670 raft_consensus.cc:515] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:16.575541  8676 leader_election.cc:290] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:16.578042  8670 leader_election.cc:290] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:16.578100  8681 leader_election.cc:290] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:16.586261  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:16.589010  8674 raft_consensus.cc:493] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.589699  8674 raft_consensus.cc:515] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:16.588276  8679 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.563994  8675 leader_election.cc:290] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:16.596503  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba55b3f6e424ec7a65fc13489c43a43" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:16.598204  8674 leader_election.cc:290] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:16.598884  8674 raft_consensus.cc:493] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b52243363f04d04862e5e631403e880)
I20260709 13:01:16.599465  8674 raft_consensus.cc:515] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:16.603092  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef8564b08234776a109c3b317ab232e" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.603588  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.604033  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a1233ab4c040ebaf43748e94eaf5b5" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:16.604590  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f610a99a66b94fc0aa4565a0494013f0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:16.605405  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:16.603117  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.607277  8679 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:16.607892  8406 leader_election.cc:304] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:16.609936  8406 leader_election.cc:304] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:16.610659  8680 raft_consensus.cc:2749] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.607869  8674 leader_election.cc:290] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:16.612186  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a76c63217264185bf001378200c92b8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:16.611443  8680 raft_consensus.cc:2749] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.614939  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.615931  8685 raft_consensus.cc:493] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b52243363f04d04862e5e631403e880)
I20260709 13:01:16.615031  8679 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:16.617056  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97aa2293ce6406190f9b27a1f8ee8c8" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:16.616633  8685 raft_consensus.cc:515] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:16.629688  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:16.631949  8685 leader_election.cc:290] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:16.632354  8406 leader_election.cc:304] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:16.633208  8497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:16.634281  8406 leader_election.cc:304] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:16.646164  8674 raft_consensus.cc:2749] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:16.645017  8688 raft_consensus.cc:2749] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.650144  8675 raft_consensus.cc:493] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b52243363f04d04862e5e631403e880)
I20260709 13:01:16.651278  8675 raft_consensus.cc:515] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:16.649525  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5457fe8b6ca4fb299cc0137a81729f8" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.654582  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.653432  8675 leader_election.cc:290] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:16.657536  8670 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1075f1083cc84c349b3a0bd57774c1e7)
I20260709 13:01:16.658110  8670 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:16.660283  8670 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:16.664654  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:16.670228  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba55b3f6e424ec7a65fc13489c43a43" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.675442  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef8564b08234776a109c3b317ab232e" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.676029  8675 raft_consensus.cc:493] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b52243363f04d04862e5e631403e880)
I20260709 13:01:16.678714  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3528a166624614b3565fd49a48c9d2" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.678851  8675 raft_consensus.cc:515] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:16.679073  8497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:16.682154  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd6bf52d5074a8cbfd89d2330e9ca7f" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.684819  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.685838  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daadac41440483ba1ee8e8ff7b4f741" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.686532  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.687769  8675 leader_election.cc:290] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:16.687970  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23d956c8a9a435baf5e03e60d7a052a" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.698351  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b9a02932b4dad97d864deeac40bdb" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:16.714105  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b52243363f04d04862e5e631403e880" is_pre_election: true
I20260709 13:01:16.715529  7707 leader_election.cc:304] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:16.716545  8682 raft_consensus.cc:2749] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.717775  7707 leader_election.cc:304] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:16.718811  8682 raft_consensus.cc:2749] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.720283  7707 leader_election.cc:304] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:16.721037  8682 raft_consensus.cc:2749] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:16.721802  7707 leader_election.cc:304] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:16.722946  8690 raft_consensus.cc:2749] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.724133  7707 leader_election.cc:304] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:16.724895  8682 raft_consensus.cc:2749] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.728102  7707 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:16.729029  8682 raft_consensus.cc:2749] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.729784  7707 leader_election.cc:304] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 5b52243363f04d04862e5e631403e880
I20260709 13:01:16.731122  8682 raft_consensus.cc:2749] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.734928  8497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4dcf12326349beb860a3547c340348" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80af46fc024041de81a638d29912c8a3" is_pre_election: true
I20260709 13:01:16.736624  7780 leader_election.cc:304] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:16.738380  8685 raft_consensus.cc:2749] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.740020  7633 leader_election.cc:304] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:16.740525  7708 leader_election.cc:304] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:16.742301  8682 raft_consensus.cc:2749] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.742556  8670 raft_consensus.cc:2749] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:16.745373  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "5b52243363f04d04862e5e631403e880" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.748760  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab9b354e4c04221a6922c87d2ba22bd" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:16.753836  7780 leader_election.cc:304] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:16.755021  8684 raft_consensus.cc:2749] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:16.759087  7633 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b52243363f04d04862e5e631403e880; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:16.759994  8407 leader_election.cc:304] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80af46fc024041de81a638d29912c8a3; no voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:16.760246  8459 raft_consensus.cc:2749] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:16.761435  8680 raft_consensus.cc:2749] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:16.940920  7690 debug-util.cc:398] Leaking SignalData structure 0x7b080028cb40 after lost signal to thread 434
W20260709 13:01:16.942056  7690 debug-util.cc:398] Leaking SignalData structure 0x7b0800270ee0 after lost signal to thread 7526
W20260709 13:01:16.943193  7690 debug-util.cc:398] Leaking SignalData structure 0x7b08001bb3c0 after lost signal to thread 7693
W20260709 13:01:16.944320  7690 debug-util.cc:398] Leaking SignalData structure 0x7b0800128000 after lost signal to thread 7767
W20260709 13:01:16.945432  7690 debug-util.cc:398] Leaking SignalData structure 0x7b080040b400 after lost signal to thread 7841
W20260709 13:01:16.946532  7690 debug-util.cc:398] Leaking SignalData structure 0x7b08001910e0 after lost signal to thread 8585
I20260709 13:01:18.129524   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:18.204838  7816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9"
dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41786
I20260709 13:01:18.205835  7816 raft_consensus.cc:606] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:18.209520  7816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301"
dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41786
I20260709 13:01:18.210158  7816 raft_consensus.cc:606] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:18.213989  7816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93"
dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41786
I20260709 13:01:18.215392  7816 raft_consensus.cc:606] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:18.230698  7660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:18.231377  7660 raft_consensus.cc:606] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:18.234333  7816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef"
dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41786
I20260709 13:01:18.234932  7816 raft_consensus.cc:606] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:18.237727  7816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc0e53656f344150a25cb441648dd489"
dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
mode: GRACEFUL
new_leader_uuid: "b81c129769e24f019dc9045ce8c09771"
 from {username='slave'} at 127.0.0.1:41786
I20260709 13:01:18.238267  7816 raft_consensus.cc:606] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Received request to transfer leadership to TS b81c129769e24f019dc9045ce8c09771
I20260709 13:01:18.239307   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:18.241153   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:18.345814  8684 raft_consensus.cc:993] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.346622  8684 raft_consensus.cc:1081] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.352993  8497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:39994
I20260709 13:01:18.353755  8497 raft_consensus.cc:493] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.354161  8497 raft_consensus.cc:3060] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.355355  8656 raft_consensus.cc:993] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.355845  8656 raft_consensus.cc:1081] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.358263  8505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:39994
I20260709 13:01:18.358873  8505 raft_consensus.cc:493] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.359226  8505 raft_consensus.cc:3060] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.365532  8497 raft_consensus.cc:515] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:18.371215  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:18.371898  7738 raft_consensus.cc:3060] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.380954  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:18.381793  7811 raft_consensus.cc:3055] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:18.382130  7811 raft_consensus.cc:740] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:18.383199  7811 consensus_queue.cc:260] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:18.386162  8505 raft_consensus.cc:515] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:18.384384  7811 raft_consensus.cc:3060] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.370484  8497 leader_election.cc:290] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:18.391621  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:18.392268  7816 raft_consensus.cc:3055] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:18.393070  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d02dd8c5b7c4a09a55b18dc5b4d7e93" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:18.387557  7738 raft_consensus.cc:2468] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:18.393723  7660 raft_consensus.cc:3060] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.393113  7816 raft_consensus.cc:740] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:18.397712  7816 consensus_queue.cc:260] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:18.398001  8406 leader_election.cc:304] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:18.398916  7816 raft_consensus.cc:3060] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.407160  7660 raft_consensus.cc:2468] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:18.426646  7811 raft_consensus.cc:2468] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:18.392500  8505 leader_election.cc:290] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:18.434979  8660 raft_consensus.cc:993] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.435519  8660 raft_consensus.cc:1081] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.435020  7816 raft_consensus.cc:2468] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:18.436856  8698 raft_consensus.cc:2804] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:18.437844  8406 leader_election.cc:304] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:18.438262  8505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:18.438916  8505 raft_consensus.cc:493] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.439008  8698 raft_consensus.cc:697] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:18.439482  8505 raft_consensus.cc:3060] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.439851  8699 raft_consensus.cc:2804] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:18.440409  8699 raft_consensus.cc:697] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:18.440744  8698 consensus_queue.cc:237] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:18.441447  8699 consensus_queue.cc:237] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:18.449044  8505 raft_consensus.cc:515] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:18.454872  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:18.455090  8505 leader_election.cc:290] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:18.455556  7660 raft_consensus.cc:3055] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:18.455930  7660 raft_consensus.cc:740] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:18.455567  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93820f75ef26417db4b155dd5f3847ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:18.456821  7660 consensus_queue.cc:260] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:18.457530  7738 raft_consensus.cc:3060] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.458437  7660 raft_consensus.cc:3060] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.464355  7488 catalog_manager.cc:5697] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 1 to 2, leader changed from 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.465603  7660 raft_consensus.cc:2468] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:18.466969  7738 raft_consensus.cc:2468] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:18.468086  8406 leader_election.cc:304] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:18.469990  8698 raft_consensus.cc:2804] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:18.470670  8698 raft_consensus.cc:697] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:18.472808  8698 consensus_queue.cc:237] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:18.492359  8656 raft_consensus.cc:993] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7: : Instructing follower b81c129769e24f019dc9045ce8c09771 to start an election
I20260709 13:01:18.492899  8656 raft_consensus.cc:1081] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Signalling peer b81c129769e24f019dc9045ce8c09771 to start an election
I20260709 13:01:18.495431  7738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc0e53656f344150a25cb441648dd489"
dest_uuid: "b81c129769e24f019dc9045ce8c09771"
 from {username='slave'} at 127.0.0.1:49078
I20260709 13:01:18.496022  7738 raft_consensus.cc:493] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.496423  7738 raft_consensus.cc:3060] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.507546  7738 raft_consensus.cc:515] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:18.510248  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e53656f344150a25cb441648dd489" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:18.510913  7660 raft_consensus.cc:3060] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.521916  7660 raft_consensus.cc:2468] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
I20260709 13:01:18.523222  8656 raft_consensus.cc:993] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.522971  7738 leader_election.cc:290] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:18.523970  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e53656f344150a25cb441648dd489" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:18.524567  7816 raft_consensus.cc:3055] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:18.524871  7816 raft_consensus.cc:740] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:18.525970  8684 raft_consensus.cc:1081] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.525799  7816 consensus_queue.cc:260] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:18.525735  7706 leader_election.cc:304] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:18.527949  8690 raft_consensus.cc:2804] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:18.528466  7816 raft_consensus.cc:3060] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.528566  8690 raft_consensus.cc:697] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
I20260709 13:01:18.531243  8492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:39994
I20260709 13:01:18.532120  8492 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.532511  8492 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:18.530292  8690 consensus_queue.cc:237] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } }
I20260709 13:01:18.550577  8492 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:18.555907  7816 raft_consensus.cc:2468] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 2.
I20260709 13:01:18.563524  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:18.564134  7738 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:18.565215  7811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:18.565838  7811 raft_consensus.cc:3055] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:18.566105  7811 raft_consensus.cc:740] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:18.566915  7811 consensus_queue.cc:260] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:18.568022  7811 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:18.569043  7492 catalog_manager.cc:5697] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 1 to 2, leader changed from 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196) to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.566543  7488 catalog_manager.cc:5697] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 1 to 2, leader changed from 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.576478  7738 raft_consensus.cc:2468] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:18.578938  8406 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:18.579412  7488 catalog_manager.cc:5697] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 1 to 2, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.582721  8698 raft_consensus.cc:2804] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:18.588555  8698 raft_consensus.cc:697] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:18.589709  8698 consensus_queue.cc:237] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:18.597895  8492 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:18.606303  7811 raft_consensus.cc:2468] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:18.628912  7488 catalog_manager.cc:5697] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 2 to 3, leader changed from 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.794236  8697 raft_consensus.cc:993] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.794763  8684 raft_consensus.cc:1081] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:18.796500  8513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:39994
I20260709 13:01:18.797066  8513 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.797421  8513 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:18.806964  8513 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:18.809304  8513 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:18.810223  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:18.810575  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0511ad7dfd44065b288a786074949ef" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:18.810864  7816 raft_consensus.cc:3055] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:18.811271  7816 raft_consensus.cc:740] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:18.811308  7663 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:18.812136  7816 consensus_queue.cc:260] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:18.813226  7816 raft_consensus.cc:3060] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:18.820988  7663 raft_consensus.cc:2468] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:18.822501  8406 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:18.821273  7816 raft_consensus.cc:2468] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:18.823598  8698 raft_consensus.cc:2804] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:18.824092  8698 raft_consensus.cc:697] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:18.824992  8698 consensus_queue.cc:237] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:18.839344  7488 catalog_manager.cc:5697] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 2 to 3, leader changed from 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.886416  7816 raft_consensus.cc:1275] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.887840  8698 consensus_queue.cc:1048] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.891402  7663 raft_consensus.cc:1275] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.909330  8699 consensus_queue.cc:1048] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.933339  7811 raft_consensus.cc:1275] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.935819  8700 consensus_queue.cc:1048] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:18.975966  7738 raft_consensus.cc:1275] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.978256  8700 consensus_queue.cc:1048] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.978454  7814 raft_consensus.cc:1275] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.985072  8690 consensus_queue.cc:1048] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.998296  7742 raft_consensus.cc:1275] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:19.000881  8699 consensus_queue.cc:1048] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.014360  7663 raft_consensus.cc:1275] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:19.032100  7663 raft_consensus.cc:1275] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer b81c129769e24f019dc9045ce8c09771: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:19.035426  8700 consensus_queue.cc:1048] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:19.037269  8708 consensus_queue.cc:1048] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:19.191447  7743 raft_consensus.cc:1275] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:19.193228  8700 consensus_queue.cc:1048] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.203603  7811 raft_consensus.cc:1275] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:19.204936  8700 consensus_queue.cc:1048] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.249104   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:19.251819  7663 raft_consensus.cc:1275] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:19.256678  8698 consensus_queue.cc:1048] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.294483  7811 raft_consensus.cc:1275] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:19.296411  8699 consensus_queue.cc:1048] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.362303   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:19.419142  7663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:19.419752  7663 raft_consensus.cc:606] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:19.423215  7811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53"
dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41786
I20260709 13:01:19.423892  7811 raft_consensus.cc:606] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:19.427608  7663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:19.428229  7663 raft_consensus.cc:606] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:19.431954  7814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0"
dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41786
I20260709 13:01:19.432871  7814 raft_consensus.cc:606] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:19.435446  7663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:19.436088  7663 raft_consensus.cc:606] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:19.437597   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:19.439337   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:19.456564  8661 raft_consensus.cc:993] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:19.457520  8660 raft_consensus.cc:1081] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:19.459025  8505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:19.459640  8505 raft_consensus.cc:493] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.460019  8505 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.465847  8505 raft_consensus.cc:515] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:19.468056  8505 leader_election.cc:290] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:19.468582  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:19.468508  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed1559d07294774aa94df29c0b5d59a" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:19.469457  7663 raft_consensus.cc:3055] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:19.469637  7814 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.469862  7663 raft_consensus.cc:740] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:19.470811  7663 consensus_queue.cc:260] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:19.471684  7663 raft_consensus.cc:3060] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.479256  7814 raft_consensus.cc:2468] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:19.480705  8407 leader_election.cc:304] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:19.481747  8698 raft_consensus.cc:2804] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:19.482336  8698 raft_consensus.cc:697] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:19.483335  8698 consensus_queue.cc:237] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:19.499925  7663 raft_consensus.cc:2468] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:19.511775  7489 catalog_manager.cc:5697] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 2 to 3, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.797187  8684 raft_consensus.cc:993] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:19.797734  8684 raft_consensus.cc:1081] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:19.799299  8492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:39994
I20260709 13:01:19.799834  8492 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.800174  8492 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.807857  8492 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:19.810875  8492 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 4 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:19.811584  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:19.812245  7738 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.815078  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:19.816025  7814 raft_consensus.cc:3055] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.816350  7814 raft_consensus.cc:740] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:19.817121  7814 consensus_queue.cc:260] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:19.818468  7814 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.821862  7738 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 4.
I20260709 13:01:19.822733  8661 raft_consensus.cc:993] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:19.823256  8660 raft_consensus.cc:1081] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:19.823663  8406 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:19.825321  8699 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:19.825902  8699 raft_consensus.cc:697] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 4 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:19.827060  8699 consensus_queue.cc:237] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:19.831292  7814 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 4.
I20260709 13:01:19.841235  8505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:19.841948  8505 raft_consensus.cc:493] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.842355  8505 raft_consensus.cc:3060] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.852303  8660 raft_consensus.cc:993] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:19.852867  8660 raft_consensus.cc:1081] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:19.854607  8492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:19.855497  8492 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.855897  8492 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.865725  8492 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:19.870975  8505 raft_consensus.cc:515] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:19.880403  7489 catalog_manager.cc:5697] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 3 to 4, leader changed from 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.899223  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:19.899852  7663 raft_consensus.cc:3055] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:19.900161  7663 raft_consensus.cc:740] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:19.901399  7663 consensus_queue.cc:260] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:19.903890  7663 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.904340  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:19.905001  7743 raft_consensus.cc:3060] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.908963  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15656cdc6f4507ae213e6321baad95" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:19.909893  7660 raft_consensus.cc:3055] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.910252  7660 raft_consensus.cc:740] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:19.911155  7660 consensus_queue.cc:260] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:19.912328  8492 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:19.915021  7663 raft_consensus.cc:2468] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:19.914906  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6cdc86b1e3d4df4a94bc251560f88e7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:19.912748  7660 raft_consensus.cc:3060] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.915659  7738 raft_consensus.cc:3060] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.917186  8505 leader_election.cc:290] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:19.919512  8406 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:19.920547  8698 raft_consensus.cc:2804] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:19.921034  8698 raft_consensus.cc:697] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:19.921980  8698 consensus_queue.cc:237] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:19.923015  7661 raft_consensus.cc:1275] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:19.924122  7738 raft_consensus.cc:2468] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:19.927274  8699 consensus_queue.cc:1048] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.929047  7743 raft_consensus.cc:2468] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:19.934875  8406 leader_election.cc:304] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:19.935876  8699 raft_consensus.cc:2804] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:19.936643  8699 raft_consensus.cc:697] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:19.937713  8699 consensus_queue.cc:237] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:19.945482  7660 raft_consensus.cc:2468] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:19.949275  7488 catalog_manager.cc:5697] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 2 to 3, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.985052  7489 catalog_manager.cc:5697] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 1 to 2, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.004635  8656 raft_consensus.cc:993] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:20.005249  8656 raft_consensus.cc:1081] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:20.008324  8505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:39994
I20260709 13:01:20.007867  7814 raft_consensus.cc:1275] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:20.008976  8505 raft_consensus.cc:493] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.009433  8505 raft_consensus.cc:3060] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.024492  8698 consensus_queue.cc:1048] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:20.034961  8505 raft_consensus.cc:515] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:20.042533  8505 leader_election.cc:290] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545)
I20260709 13:01:20.045823  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:20.047241  7814 raft_consensus.cc:3055] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.047593  7814 raft_consensus.cc:740] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:20.048348  7814 consensus_queue.cc:260] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:20.049959  7814 raft_consensus.cc:3060] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.060418  7814 raft_consensus.cc:2468] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:20.065659  8407 leader_election.cc:304] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:20.066591  8698 raft_consensus.cc:2804] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:20.067428  8698 raft_consensus.cc:697] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:20.072670  8698 consensus_queue.cc:237] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:20.085043  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:20.085913  7743 raft_consensus.cc:3060] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.145149  7489 catalog_manager.cc:5697] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 1 to 2, leader changed from 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.164762  7743 raft_consensus.cc:2468] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:20.363870  7743 raft_consensus.cc:1275] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:20.365445  8698 consensus_queue.cc:1048] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:20.379802  7743 raft_consensus.cc:1275] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:20.383024  8700 consensus_queue.cc:1048] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:20.390225  7813 raft_consensus.cc:1275] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:20.393463  8698 consensus_queue.cc:1048] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:20.433640  8406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38429, user_credentials={real_user=slave}} blocked reactor thread for 52577.9us
I20260709 13:01:20.440275   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:20.472934  7663 raft_consensus.cc:1275] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:20.484097  8699 consensus_queue.cc:1048] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.522081  7660 raft_consensus.cc:1275] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:20.525056  7743 raft_consensus.cc:1275] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:20.533794  8700 consensus_queue.cc:1048] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:20.537910  8700 consensus_queue.cc:1048] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.639544  7743 raft_consensus.cc:1275] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:20.643729  8699 consensus_queue.cc:1048] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.657122   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:20.678119  7811 raft_consensus.cc:1275] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:20.684309  8699 consensus_queue.cc:1048] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.754331  7660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:20.762502  7660 raft_consensus.cc:606] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:20.786680  7660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:20.823207  7660 raft_consensus.cc:606] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:20.827070  7660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:20.827708  7660 raft_consensus.cc:606] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:20.839514  7660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:20.840283  7660 raft_consensus.cc:606] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:20.844695  7660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685"
dest_uuid: "5b52243363f04d04862e5e631403e880"
mode: GRACEFUL
new_leader_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:41640
I20260709 13:01:20.845533  7660 raft_consensus.cc:606] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Received request to transfer leadership to TS 80af46fc024041de81a638d29912c8a3
I20260709 13:01:20.846976   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:20.848830   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:21.012033  8760 raft_consensus.cc:993] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.012540  8661 raft_consensus.cc:1081] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.013968  8492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:21.014524  8492 raft_consensus.cc:493] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.014863  8492 raft_consensus.cc:3060] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.020802  8492 raft_consensus.cc:515] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:21.022393  8492 leader_election.cc:290] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:21.023564  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:21.023775  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0c19d3d9ae4f2d97d738803826bf74" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:21.024293  7660 raft_consensus.cc:3055] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:21.024533  7814 raft_consensus.cc:3060] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.024726  7660 raft_consensus.cc:740] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:21.025862  7660 consensus_queue.cc:260] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:21.026886  7660 raft_consensus.cc:3060] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.036296  8712 raft_consensus.cc:993] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.036875  7814 raft_consensus.cc:2468] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:21.036876  8712 raft_consensus.cc:1081] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.038507  8407 leader_election.cc:304] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:21.039420  8748 raft_consensus.cc:2804] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:21.039901  8748 raft_consensus.cc:697] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:21.040043  8505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:21.040663  8505 raft_consensus.cc:493] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.041261  8505 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.041086  8748 consensus_queue.cc:237] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:21.050850  8505 raft_consensus.cc:515] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.052743  7660 raft_consensus.cc:2468] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:21.056540  8505 leader_election.cc:290] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:21.058483  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:21.059334  7739 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.069811  7739 raft_consensus.cc:2468] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:21.070955  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b65ffc44e9482a9db36207427de2f7" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:21.075362  7660 raft_consensus.cc:3055] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:21.076287  7660 raft_consensus.cc:740] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:21.077769  7660 consensus_queue.cc:260] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.091492  8406 leader_election.cc:304] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:21.092978  8699 raft_consensus.cc:2804] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:21.094913  8699 raft_consensus.cc:697] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:21.097867  8699 consensus_queue.cc:237] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.091861  7660 raft_consensus.cc:3060] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.112612  8712 raft_consensus.cc:993] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.114123  8760 raft_consensus.cc:1081] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.124097  8505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:21.124758  8505 raft_consensus.cc:493] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.125249  8505 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.089912  7488 catalog_manager.cc:5697] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 1 to 2, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.135918  7660 raft_consensus.cc:2468] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:21.166925  8505 raft_consensus.cc:515] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.170190  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:21.170564  8505 leader_election.cc:290] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:21.170756  7660 raft_consensus.cc:3055] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:21.171782  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911523c3e9f45638bdcf0de7430dda4" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:21.172225  7660 raft_consensus.cc:740] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:21.172497  7739 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.173081  7660 consensus_queue.cc:260] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.178123  7660 raft_consensus.cc:3060] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.191180  7660 raft_consensus.cc:2468] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:21.193827  8406 leader_election.cc:304] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:21.194813  8748 raft_consensus.cc:2804] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:21.195505  8748 raft_consensus.cc:697] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:21.197021  7739 raft_consensus.cc:2468] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 3.
I20260709 13:01:21.196732  8748 consensus_queue.cc:237] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.214340  7488 catalog_manager.cc:5697] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 2 to 3, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.216140  7488 catalog_manager.cc:5697] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 2 to 3, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.230108  8712 raft_consensus.cc:993] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.230646  8712 raft_consensus.cc:1081] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.234663  8497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:21.237524  8497 raft_consensus.cc:493] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.238003  8497 raft_consensus.cc:3060] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.252846  8497 raft_consensus.cc:515] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:21.257937  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:21.258216  8497 leader_election.cc:290] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:21.258570  7663 raft_consensus.cc:3055] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:21.258965  7663 raft_consensus.cc:740] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:21.259720  7663 consensus_queue.cc:260] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:21.259969  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb46fd098ba461a871adb4c40c79e93" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:21.260653  7814 raft_consensus.cc:3060] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.261042  7663 raft_consensus.cc:3060] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.268519  7663 raft_consensus.cc:2468] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:21.269753  8406 leader_election.cc:304] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:21.270090  7814 raft_consensus.cc:2468] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:21.270639  8748 raft_consensus.cc:2804] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:21.271356  8748 raft_consensus.cc:697] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:21.272477  8748 consensus_queue.cc:237] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:21.286639  7488 catalog_manager.cc:5697] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 1 to 2, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.397199  8712 raft_consensus.cc:993] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880: : Instructing follower 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.397799  8661 raft_consensus.cc:1081] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Signalling peer 80af46fc024041de81a638d29912c8a3 to start an election
I20260709 13:01:21.401671  8497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685"
dest_uuid: "80af46fc024041de81a638d29912c8a3"
 from {username='slave'} at 127.0.0.1:40000
I20260709 13:01:21.402344  8497 raft_consensus.cc:493] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.403347  8497 raft_consensus.cc:3060] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.410753  8497 raft_consensus.cc:515] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.412778  8497 leader_election.cc:290] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Requested vote from peers 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081), b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429)
I20260709 13:01:21.413759  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b52243363f04d04862e5e631403e880"
I20260709 13:01:21.414366  7663 raft_consensus.cc:3055] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:21.414422  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b712db90ef70445e9ba1d2b20e0ab685" candidate_uuid: "80af46fc024041de81a638d29912c8a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:21.414745  7663 raft_consensus.cc:740] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b52243363f04d04862e5e631403e880, State: Running, Role: LEADER
I20260709 13:01:21.415004  7740 raft_consensus.cc:3060] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.415566  7663 consensus_queue.cc:260] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.416877  7663 raft_consensus.cc:3060] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.425019  7663 raft_consensus.cc:2468] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:21.426254  8406 leader_election.cc:304] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3; no voters: 
I20260709 13:01:21.426904  7740 raft_consensus.cc:2468] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80af46fc024041de81a638d29912c8a3 in term 2.
I20260709 13:01:21.427274  8748 raft_consensus.cc:2804] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:21.428532  8748 raft_consensus.cc:697] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Becoming Leader. State: Replica: 80af46fc024041de81a638d29912c8a3, State: Running, Role: LEADER
I20260709 13:01:21.429498  8748 consensus_queue.cc:237] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:21.444020  7488 catalog_manager.cc:5697] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 reported cstate change: term changed from 1 to 2, leader changed from 5b52243363f04d04862e5e631403e880 (127.0.107.194) to 80af46fc024041de81a638d29912c8a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "80af46fc024041de81a638d29912c8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.521369  7740 raft_consensus.cc:1275] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:21.522790  8749 consensus_queue.cc:1048] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.528496  7813 raft_consensus.cc:1275] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.529939  8749 consensus_queue.cc:1048] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:21.541671  7660 raft_consensus.cc:1275] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:21.543613  8749 consensus_queue.cc:1048] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.615998  7661 raft_consensus.cc:1275] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.620393  8699 consensus_queue.cc:1048] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:21.677898  7740 raft_consensus.cc:1275] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:21.684288  8772 consensus_queue.cc:1048] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:21.684944  7663 raft_consensus.cc:1275] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:21.687446  8699 consensus_queue.cc:1048] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.826001  7661 raft_consensus.cc:1275] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.829391  8772 consensus_queue.cc:1048] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:21.832937  7813 raft_consensus.cc:1275] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.836048  8699 consensus_queue.cc:1048] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:21.851563   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:21.861202  7740 raft_consensus.cc:1275] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.864415  7661 raft_consensus.cc:1275] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Refusing update from remote peer 80af46fc024041de81a638d29912c8a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.872284  8772 consensus_queue.cc:1048] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:21.874322  8699 consensus_queue.cc:1048] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.028412   431 tablet_server.cc:179] TabletServer@127.0.107.193:38589 shutting down...
W20260709 13:01:22.051007  7634 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 292 similar messages]
W20260709 13:01:22.099417  7634 consensus_peers.cc:597] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.100386  7634 consensus_peers.cc:597] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.102484  7782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38589, user_credentials={real_user=slave}} blocked reactor thread for 44282.9us
W20260709 13:01:22.108697  7782 consensus_peers.cc:597] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.109457  7782 consensus_peers.cc:597] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.113314   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:22.133286   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.135080   431 raft_consensus.cc:2243] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.135864   431 raft_consensus.cc:2272] T 2a76c63217264185bf001378200c92b8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.141523   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.142869   431 raft_consensus.cc:2243] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:22.143385  7782 consensus_peers.cc:597] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.142776  7708 consensus_peers.cc:597] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.144588   431 raft_consensus.cc:2272] T d4a36b4572f0444dafd0d51bfc100984 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.145262  7782 consensus_peers.cc:597] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.146317  7782 consensus_peers.cc:597] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.148649   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.149773   431 raft_consensus.cc:2243] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.150415   431 raft_consensus.cc:2272] T 6d7e711bccc84ba9aab8ad5513568455 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.154009   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.155357   431 raft_consensus.cc:2243] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:22.155372  7634 consensus_peers.cc:597] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.156136   431 raft_consensus.cc:2272] T 5496197ab1264ee1887afbf67a081376 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.160219   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.161387   431 raft_consensus.cc:2243] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.162103   431 raft_consensus.cc:2272] T fe0b231c31d34cc19a247378b4e932bf P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.165782   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.166872   431 raft_consensus.cc:2243] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.168133   431 raft_consensus.cc:2272] T 41b65ffc44e9482a9db36207427de2f7 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.173348   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.174517   431 raft_consensus.cc:2243] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.175617   431 raft_consensus.cc:2272] T 4a7a672520974144a4f3fffbc0805301 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.176126  7708 consensus_peers.cc:597] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.176795  7782 consensus_peers.cc:597] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.178712   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.180045   431 raft_consensus.cc:2243] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.180573   431 raft_consensus.cc:2272] T 17d9469ca1534ec2b25b7938331c6600 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.188985   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.189903   431 raft_consensus.cc:2243] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.190402   431 raft_consensus.cc:2272] T 51ea4c1d73af403bb50c3ecab728ec32 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.192898   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.194065   431 raft_consensus.cc:2243] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.194839   431 raft_consensus.cc:2272] T 3bb46fd098ba461a871adb4c40c79e93 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.197750   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.198347   431 raft_consensus.cc:2243] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.198819   431 raft_consensus.cc:2272] T de9b9a02932b4dad97d864deeac40bdb P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.201287   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.202198   431 raft_consensus.cc:2243] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.203172   431 raft_consensus.cc:2272] T f82c3df35a7c4361be5f6570b4d2af91 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.206113   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.207947   431 raft_consensus.cc:2243] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.208513   431 raft_consensus.cc:2272] T 229814a1ef67415c854a94da0c89c7c0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.211752   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.212723   431 raft_consensus.cc:2243] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.213292   431 raft_consensus.cc:2272] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.216140   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.216717   431 raft_consensus.cc:2243] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.217214   431 raft_consensus.cc:2272] T 6109e32453a044d0bc4a18d3bf785518 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.219970   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.220667   431 raft_consensus.cc:2243] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.221225   431 raft_consensus.cc:2272] T fa7816c9f7b54ed198fce1d42596e0f2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.226398   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:01:22.228529  7634 consensus_peers.cc:597] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.227375   431 raft_consensus.cc:2243] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.229444   431 raft_consensus.cc:2272] T b7201e09d4ad45e1ac2b617f22ed4a70 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.232631   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.233494   431 raft_consensus.cc:2243] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.234133   431 raft_consensus.cc:2272] T fd3528a166624614b3565fd49a48c9d2 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.237685   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.238687   431 raft_consensus.cc:2243] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.239233   431 raft_consensus.cc:2272] T 0d97da3f424447f9987d7c6ab8d99c80 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.243818   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.244776   431 raft_consensus.cc:2243] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.245873   431 raft_consensus.cc:2272] T 1581b91c4b8044b294ec8540edf505e9 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.246768  7782 consensus_peers.cc:597] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.254878  7634 consensus_peers.cc:597] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.255920  7634 consensus_peers.cc:597] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.270138  7634 consensus_peers.cc:597] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.272753  7708 consensus_peers.cc:597] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.308826   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.317159   431 raft_consensus.cc:2243] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.319103   431 raft_consensus.cc:2272] T 45a1233ab4c040ebaf43748e94eaf5b5 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.376384  7782 consensus_peers.cc:597] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.387966   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.390954   431 raft_consensus.cc:2243] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:01:22.400326  7634 consensus_peers.cc:597] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.405970   431 raft_consensus.cc:2272] T af3917dc3ec14f558877b66019290ec0 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.402810  7782 consensus_peers.cc:597] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.413619  7634 consensus_peers.cc:597] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.413678   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:01:22.415478  7634 consensus_peers.cc:597] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.416061   431 raft_consensus.cc:2243] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.416975   431 raft_consensus.cc:2272] T cba55b3f6e424ec7a65fc13489c43a43 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.421631   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:01:22.422555  7708 consensus_peers.cc:597] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.423202   431 raft_consensus.cc:2243] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.424397   431 raft_consensus.cc:2272] T baabbed5310440d19416189e295e3db0 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.424890  7708 consensus_peers.cc:597] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:22.425830  7708 consensus_peers.cc:597] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.429905   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.432873   431 raft_consensus.cc:2243] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.435827   431 raft_consensus.cc:2272] T c0511ad7dfd44065b288a786074949ef P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.441419  7708 consensus_peers.cc:597] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.441736   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.447685   431 raft_consensus.cc:2243] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:01:22.449210  7634 consensus_peers.cc:597] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.450243   431 raft_consensus.cc:2272] T 30c245d203f74d999c25bede65ee4f53 P 80af46fc024041de81a638d29912c8a3 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.452981  7708 consensus_peers.cc:597] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.458242   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.459935   431 raft_consensus.cc:2243] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.463913   431 raft_consensus.cc:2272] T 2911523c3e9f45638bdcf0de7430dda4 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.471289   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.473070   431 raft_consensus.cc:2243] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.476122   431 raft_consensus.cc:2272] T 5b0c19d3d9ae4f2d97d738803826bf74 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.481552   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.482925   431 raft_consensus.cc:2243] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.483933   431 raft_consensus.cc:2272] T c80b3e6d140c42ab83aedacbad5a486d P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.488145   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.489517   431 raft_consensus.cc:2243] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.491216   431 raft_consensus.cc:2272] T f52fbfcad0d747cfb5758693f2cf5be6 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.498394   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.499606   431 raft_consensus.cc:2243] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.500579   431 raft_consensus.cc:2272] T 3a49f753e0c24447b801656d29b78649 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.505261   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.506518   431 raft_consensus.cc:2243] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.508632   431 raft_consensus.cc:2272] T 2ed1559d07294774aa94df29c0b5d59a P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.513949   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.516849   431 raft_consensus.cc:2243] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:01:22.522020  7782 consensus_peers.cc:597] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.526868   431 raft_consensus.cc:2272] T d6cdc86b1e3d4df4a94bc251560f88e7 P 80af46fc024041de81a638d29912c8a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.532490   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.533947   431 raft_consensus.cc:2243] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.536394   431 raft_consensus.cc:2272] T 7c15656cdc6f4507ae213e6321baad95 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.542352   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.543813   431 raft_consensus.cc:2243] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.544847   431 raft_consensus.cc:2272] T ce87ae60b2104f579d001664481e7aa8 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.550812   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.552589   431 raft_consensus.cc:2243] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.555016   431 raft_consensus.cc:2272] T b712db90ef70445e9ba1d2b20e0ab685 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.561231   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.562423   431 raft_consensus.cc:2243] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.563373   431 raft_consensus.cc:2272] T 3ab9b354e4c04221a6922c87d2ba22bd P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.568584   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.569540   431 raft_consensus.cc:2243] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.571671   431 raft_consensus.cc:2272] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.576670   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.577526   431 raft_consensus.cc:2243] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.578492   431 raft_consensus.cc:2272] T f97aa2293ce6406190f9b27a1f8ee8c8 P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.582938   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.583859   431 raft_consensus.cc:2243] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.584776   431 raft_consensus.cc:2272] T f1a4495c3f82450cbeb8cf7b1ce76dce P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:22.605759  7634 consensus_peers.cc:597] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.608855   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.610035   431 raft_consensus.cc:2243] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.610765   431 raft_consensus.cc:2272] T f610a99a66b94fc0aa4565a0494013f0 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.615844   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.616770   431 raft_consensus.cc:2243] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.617632   431 raft_consensus.cc:2272] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.621393   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.622658   431 raft_consensus.cc:2243] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:22.624385   431 raft_consensus.cc:2272] T 93820f75ef26417db4b155dd5f3847ef P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.629007   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.629994   431 raft_consensus.cc:2243] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.630859   431 raft_consensus.cc:2272] T 8295a58ce0dd4fb99fffd754746b8b0a P 80af46fc024041de81a638d29912c8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.635740   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:22.636736   431 raft_consensus.cc:2243] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.637707   431 raft_consensus.cc:2272] T 1c4dcf12326349beb860a3547c340348 P 80af46fc024041de81a638d29912c8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.875752   431 tablet_server.cc:196] TabletServer@127.0.107.193:38589 shutdown complete.
I20260709 13:01:23.153914   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:23.160657  7780 consensus_peers.cc:597] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.183797  7706 consensus_peers.cc:597] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.204670  7780 consensus_peers.cc:597] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.210402  7780 consensus_peers.cc:597] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.216513  8793 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.217479  8793 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.225131  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
W20260709 13:01:23.236093  7780 consensus_peers.cc:597] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.251017  8793 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:01:23.252561  7708 leader_election.cc:336] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.264914  7708 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.271821  8724 raft_consensus.cc:2749] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:23.292331  7780 consensus_peers.cc:597] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.307516  7706 consensus_peers.cc:597] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.311843   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:23.313374   431 tablet_replica.cc:333] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.315635   431 raft_consensus.cc:2243] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.317263   431 raft_consensus.cc:2272] T 0d97da3f424447f9987d7c6ab8d99c80 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:23.321445  7706 consensus_peers.cc:597] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.323243   431 tablet_replica.cc:333] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
W20260709 13:01:23.323810  7780 consensus_peers.cc:597] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.324124   431 raft_consensus.cc:2243] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.325178   431 raft_consensus.cc:2272] T 1c4dcf12326349beb860a3547c340348 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.327832   431 tablet_replica.cc:333] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.330304   431 raft_consensus.cc:2243] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.330964   431 raft_consensus.cc:2272] T 7c15656cdc6f4507ae213e6321baad95 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.333686   431 tablet_replica.cc:333] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.335078   431 raft_consensus.cc:2243] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.336671   431 raft_consensus.cc:2272] T baabbed5310440d19416189e295e3db0 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.339569   431 tablet_replica.cc:333] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.340395   431 raft_consensus.cc:2243] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.341410   431 raft_consensus.cc:2272] T c0511ad7dfd44065b288a786074949ef P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.344411   431 tablet_replica.cc:333] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.345255   431 raft_consensus.cc:2243] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.345830   431 raft_consensus.cc:2272] T f82c3df35a7c4361be5f6570b4d2af91 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.348523   431 tablet_replica.cc:333] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.349154   431 raft_consensus.cc:2243] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.350164   431 raft_consensus.cc:2272] T 7daadac41440483ba1ee8e8ff7b4f741 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.353924   431 tablet_replica.cc:333] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.354555   431 raft_consensus.cc:2243] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.355229   431 raft_consensus.cc:2272] T fe0b231c31d34cc19a247378b4e932bf P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.357923   431 tablet_replica.cc:333] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.358827   431 raft_consensus.cc:2243] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.359390   431 raft_consensus.cc:2272] T 3dc7723aa6994ac4a65710463c633f66 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:23.360142  7780 consensus_peers.cc:597] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.362079   431 tablet_replica.cc:333] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.362780   431 raft_consensus.cc:2243] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.363345   431 raft_consensus.cc:2272] T 45a1233ab4c040ebaf43748e94eaf5b5 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.367007   431 tablet_replica.cc:333] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.367801   431 raft_consensus.cc:2243] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:23.368584  7706 consensus_peers.cc:597] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.369486   431 raft_consensus.cc:2272] T 5b0c19d3d9ae4f2d97d738803826bf74 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.373711   431 tablet_replica.cc:333] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.374712   431 raft_consensus.cc:2243] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.375339   431 raft_consensus.cc:2272] T f985608da1404258977e2e929aad7559 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.378942   431 tablet_replica.cc:333] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.379801   431 raft_consensus.cc:2243] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.380288   431 raft_consensus.cc:2272] T c80b3e6d140c42ab83aedacbad5a486d P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.383249   431 tablet_replica.cc:333] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.383837   431 raft_consensus.cc:2243] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.384502   431 raft_consensus.cc:2272] T f5457fe8b6ca4fb299cc0137a81729f8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.387243   431 tablet_replica.cc:333] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.388633   431 raft_consensus.cc:2243] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.389773   431 raft_consensus.cc:2272] T 93820f75ef26417db4b155dd5f3847ef P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.393330   431 tablet_replica.cc:333] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.394425   431 raft_consensus.cc:2243] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.396188   431 raft_consensus.cc:2272] T 5ef8564b08234776a109c3b317ab232e P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:23.398731  7706 consensus_peers.cc:597] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.400542   431 tablet_replica.cc:333] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.401643   431 raft_consensus.cc:2243] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.402505   431 raft_consensus.cc:2272] T 8cc99687adf94edfbef9f24e9d43510b P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.405848   431 tablet_replica.cc:333] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.406612   431 raft_consensus.cc:2243] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.407766   431 raft_consensus.cc:2272] T 5496197ab1264ee1887afbf67a081376 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.412242   431 tablet_replica.cc:333] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.413180   431 raft_consensus.cc:2243] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.413771   431 raft_consensus.cc:2272] T c23d956c8a9a435baf5e03e60d7a052a P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.416620   431 tablet_replica.cc:333] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.417552   431 raft_consensus.cc:2243] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.418489   431 raft_consensus.cc:2272] T 41b65ffc44e9482a9db36207427de2f7 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.421794   431 tablet_replica.cc:333] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.422835   431 raft_consensus.cc:2243] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.423396   431 raft_consensus.cc:2272] T 3bb46fd098ba461a871adb4c40c79e93 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.426837   431 tablet_replica.cc:333] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.427482   431 raft_consensus.cc:2243] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.427987   431 raft_consensus.cc:2272] T 51ea4c1d73af403bb50c3ecab728ec32 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.430579   431 tablet_replica.cc:333] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.431245   431 raft_consensus.cc:2243] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.432178   431 raft_consensus.cc:2272] T 1604dbc6aa844378800263c852a90568 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.434340  8794 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.435379   431 tablet_replica.cc:333] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.434973  8794 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.436775   431 raft_consensus.cc:2243] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.437791   431 raft_consensus.cc:2272] T f1a4495c3f82450cbeb8cf7b1ce76dce P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.438777  8794 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.441636   431 tablet_replica.cc:333] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.442656   431 raft_consensus.cc:2243] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.443343   431 raft_consensus.cc:2272] T 2911523c3e9f45638bdcf0de7430dda4 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:23.443341  7782 leader_election.cc:336] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.443343  8794 raft_consensus.cc:493] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.445549  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:23.445779  8794 raft_consensus.cc:515] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:01:23.446355  7706 consensus_peers.cc:597] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.447666  7780 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 80af46fc024041de81a638d29912c8a3, b81c129769e24f019dc9045ce8c09771
I20260709 13:01:23.447736   431 tablet_replica.cc:333] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.448588  8742 raft_consensus.cc:2749] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:23.451406   431 raft_consensus.cc:2243] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.452505   431 raft_consensus.cc:2272] T 3c78d34c2d104e6596872bdbc02005b7 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:23.452618  7780 leader_election.cc:336] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:23.455765  7782 leader_election.cc:336] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.456166  7782 leader_election.cc:304] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.456656   431 tablet_replica.cc:333] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.456866  8742 raft_consensus.cc:2749] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.448518  8794 leader_election.cc:290] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:23.457610   431 raft_consensus.cc:2243] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.458320   431 raft_consensus.cc:2272] T d6cdc86b1e3d4df4a94bc251560f88e7 P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.461336   431 tablet_replica.cc:333] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.462212   431 raft_consensus.cc:2243] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.463187   431 raft_consensus.cc:2272] T d4a36b4572f0444dafd0d51bfc100984 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.466374   431 tablet_replica.cc:333] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.467012   431 raft_consensus.cc:2243] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.467967   431 raft_consensus.cc:2272] T b7201e09d4ad45e1ac2b617f22ed4a70 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.471333   431 tablet_replica.cc:333] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.472036   431 raft_consensus.cc:2243] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.472579   431 raft_consensus.cc:2272] T f610a99a66b94fc0aa4565a0494013f0 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.475144   431 tablet_replica.cc:333] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.475723   431 raft_consensus.cc:2243] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.476239   431 raft_consensus.cc:2272] T 2ed1559d07294774aa94df29c0b5d59a P 5b52243363f04d04862e5e631403e880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.478814   431 tablet_replica.cc:333] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.479642   431 raft_consensus.cc:2243] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.480229   431 raft_consensus.cc:2272] T 40895010d1874feea26e2f762ab3a77f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.483204   431 tablet_replica.cc:333] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
W20260709 13:01:23.483042  7780 consensus_peers.cc:597] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.484433   431 raft_consensus.cc:2243] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.485414   431 raft_consensus.cc:2272] T 639d9a3ce83649d6ba3735d7d3d81fc5 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.488057   431 tablet_replica.cc:333] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.488903   431 raft_consensus.cc:2243] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.490021   431 raft_consensus.cc:2272] T fa7816c9f7b54ed198fce1d42596e0f2 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.494000  8724 raft_consensus.cc:493] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.494738   431 tablet_replica.cc:333] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.494621  8724 raft_consensus.cc:515] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.495644   431 raft_consensus.cc:2243] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.496449  8724 leader_election.cc:290] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.496522   431 raft_consensus.cc:2272] T dc0e53656f344150a25cb441648dd489 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.497534  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:23.502979   431 tablet_replica.cc:333] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
W20260709 13:01:23.503844  7708 leader_election.cc:336] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.504189   431 raft_consensus.cc:2243] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.506213   431 raft_consensus.cc:2272] T f97aa2293ce6406190f9b27a1f8ee8c8 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.504503  7708 leader_election.cc:304] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
W20260709 13:01:23.507043  7706 consensus_peers.cc:597] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.510154   431 tablet_replica.cc:333] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.511159   431 raft_consensus.cc:2243] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.512193   431 raft_consensus.cc:2272] T 8153e37254134d1494dcd79f992b6967 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.515832   431 tablet_replica.cc:333] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.516685   431 raft_consensus.cc:2243] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.517313   431 raft_consensus.cc:2272] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.520653  8724 raft_consensus.cc:2749] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.520856   431 tablet_replica.cc:333] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.522415   431 raft_consensus.cc:2243] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.523687   431 raft_consensus.cc:2272] T b712db90ef70445e9ba1d2b20e0ab685 P 5b52243363f04d04862e5e631403e880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.531857   431 tablet_replica.cc:333] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.532761   431 raft_consensus.cc:2243] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.534075   431 raft_consensus.cc:2272] T ce87ae60b2104f579d001664481e7aa8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:23.537173  7706 consensus_peers.cc:597] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.539063   431 tablet_replica.cc:333] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.539884   431 raft_consensus.cc:2243] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.540441   431 raft_consensus.cc:2272] T d85d25c4f4df4190af72f86b0328a345 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.543401   431 tablet_replica.cc:333] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.544116   431 raft_consensus.cc:2243] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:23.544646   431 raft_consensus.cc:2272] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.547093  8802 raft_consensus.cc:493] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.548087  8802 raft_consensus.cc:515] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:23.549252   431 tablet_replica.cc:333] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
I20260709 13:01:23.549971   431 raft_consensus.cc:2243] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:23.551182  8802 leader_election.cc:290] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:23.551687   431 raft_consensus.cc:2272] T 2a76c63217264185bf001378200c92b8 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.556128   431 tablet_replica.cc:333] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880: stopping tablet replica
W20260709 13:01:23.556519  7782 leader_election.cc:336] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.556878   431 raft_consensus.cc:2243] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:01:23.557214  7780 leader_election.cc:336] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:23.557660  7780 leader_election.cc:304] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
W20260709 13:01:23.557963  7706 consensus_peers.cc:597] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.558058   431 raft_consensus.cc:2272] T f52fbfcad0d747cfb5758693f2cf5be6 P 5b52243363f04d04862e5e631403e880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:23.558400  8802 raft_consensus.cc:2749] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:23.569324  7706 consensus_peers.cc:597] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 -> Peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Couldn't send request to peer 5b52243363f04d04862e5e631403e880. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.629138  8802 raft_consensus.cc:493] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.629324  8742 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.630102  8742 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.631165  8802 raft_consensus.cc:515] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:23.632414  8742 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.633917  8802 leader_election.cc:290] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:01:23.641289  7780 leader_election.cc:336] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
W20260709 13:01:23.641552  7782 leader_election.cc:336] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:23.642243  7782 leader_election.cc:336] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.642733  7782 leader_election.cc:304] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.643900  8802 raft_consensus.cc:2749] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.645372  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:23.646301  7742 raft_consensus.cc:2468] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 3.
I20260709 13:01:23.649056  8793 raft_consensus.cc:493] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.650352  8802 raft_consensus.cc:493] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.650019  8793 raft_consensus.cc:515] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:23.650969  8802 raft_consensus.cc:515] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.653083  8802 leader_election.cc:290] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.660634  8793 leader_election.cc:290] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:23.661723  8724 raft_consensus.cc:493] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.662367  8724 raft_consensus.cc:515] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
W20260709 13:01:23.663496  7782 leader_election.cc:336] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.664820  8724 leader_election.cc:290] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:23.666373  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:23.667073  7742 raft_consensus.cc:2468] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 2.
I20260709 13:01:23.668103  7780 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.668913  8742 raft_consensus.cc:2804] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:23.669312  8742 raft_consensus.cc:493] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.669677  8742 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:23.669951  7708 leader_election.cc:336] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:23.673353  7708 leader_election.cc:336] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:23.678254  7706 leader_election.cc:336] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
I20260709 13:01:23.678807  7706 leader_election.cc:304] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.679562  8724 raft_consensus.cc:2749] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.679510  8742 raft_consensus.cc:515] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.680820  8793 raft_consensus.cc:493] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.682474  7780 leader_election.cc:304] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.683550  8793 raft_consensus.cc:515] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:23.679723  7706 leader_election.cc:336] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
I20260709 13:01:23.685324  7706 leader_election.cc:304] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.685895  8794 raft_consensus.cc:2804] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:23.686381  8794 raft_consensus.cc:493] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.686491  8724 raft_consensus.cc:2749] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.686781  8794 raft_consensus.cc:3060] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.687306  8793 leader_election.cc:290] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.690114  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:23.691082  8802 raft_consensus.cc:493] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.691787  8802 raft_consensus.cc:515] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
W20260709 13:01:23.698547  7708 leader_election.cc:336] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.699589  7708 leader_election.cc:304] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 1075f1083cc84c349b3a0bd57774c1e7, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.699513  8794 raft_consensus.cc:515] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.700794  8724 raft_consensus.cc:2749] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.702651  8794 leader_election.cc:290] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.705052   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:01:23.710040  8742 leader_election.cc:290] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.717753  8802 leader_election.cc:290] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:23.726137  8724 raft_consensus.cc:493] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.726827  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1581b91c4b8044b294ec8540edf505e9" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
W20260709 13:01:23.727028  7782 leader_election.cc:336] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.727164  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7a672520974144a4f3fffbc0805301" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:23.727455  7742 raft_consensus.cc:3060] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.727784  7740 raft_consensus.cc:3060] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:23.729586  8724 raft_consensus.cc:515] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:23.732537  8724 leader_election.cc:290] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:01:23.734980  7782 leader_election.cc:336] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.740813  7740 raft_consensus.cc:2468] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 4.
I20260709 13:01:23.746887  7742 raft_consensus.cc:2468] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 3.
W20260709 13:01:23.751488  7708 leader_election.cc:336] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:23.753393  7706 leader_election.cc:336] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
W20260709 13:01:23.753711  7782 leader_election.cc:336] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
W20260709 13:01:23.751658  7780 leader_election.cc:336] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
I20260709 13:01:23.755515  7706 leader_election.cc:304] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.755705  8793 raft_consensus.cc:493] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.756174  7780 leader_election.cc:304] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.756655  8793 raft_consensus.cc:515] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:23.757771  8724 raft_consensus.cc:2749] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.758639  8802 raft_consensus.cc:2749] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.758821  8806 raft_consensus.cc:493] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.759641  8806 raft_consensus.cc:515] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.760454  8793 leader_election.cc:290] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:23.763271  8806 leader_election.cc:290] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
W20260709 13:01:23.767890  7706 leader_election.cc:336] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
I20260709 13:01:23.771088  7780 leader_election.cc:304] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.772384  8806 raft_consensus.cc:2804] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:23.773193  8806 raft_consensus.cc:697] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:23.774518  8806 consensus_queue.cc:237] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:23.775599  7708 leader_election.cc:336] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.776209  7708 leader_election.cc:304] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.777308  8793 raft_consensus.cc:2749] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.772729  7780 leader_election.cc:304] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
W20260709 13:01:23.778601  7782 leader_election.cc:336] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.779366  8802 raft_consensus.cc:2804] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:23.780019  8802 raft_consensus.cc:697] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:23.781317  8802 consensus_queue.cc:237] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.791409  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771" is_pre_election: true
I20260709 13:01:23.792222  7742 raft_consensus.cc:2468] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 2.
I20260709 13:01:23.805424  7780 leader_election.cc:304] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.807812  8794 raft_consensus.cc:2804] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:23.808288  8794 raft_consensus.cc:493] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.808827  8794 raft_consensus.cc:3060] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.823361  8794 raft_consensus.cc:515] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.830618  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3917dc3ec14f558877b66019290ec0" candidate_uuid: "1075f1083cc84c349b3a0bd57774c1e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b81c129769e24f019dc9045ce8c09771"
I20260709 13:01:23.831502  7742 raft_consensus.cc:3060] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.834498  7489 catalog_manager.cc:5697] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 3 to 4, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.836882  7489 catalog_manager.cc:5697] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 2 to 3, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:23.839275  7782 leader_election.cc:336] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.840337  8794 leader_election.cc:290] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 election: Requested vote from peers b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.844444  7742 raft_consensus.cc:2468] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1075f1083cc84c349b3a0bd57774c1e7 in term 3.
I20260709 13:01:23.848861  7780 leader_election.cc:304] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 80af46fc024041de81a638d29912c8a3
I20260709 13:01:23.850160  8794 raft_consensus.cc:2804] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:23.850739  8794 raft_consensus.cc:697] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Becoming Leader. State: Replica: 1075f1083cc84c349b3a0bd57774c1e7, State: Running, Role: LEADER
I20260709 13:01:23.851683  8794 consensus_queue.cc:237] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.888739   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:01:23.903596  8793 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.904327  8793 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
I20260709 13:01:23.909399  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7" is_pre_election: true
I20260709 13:01:23.910108  7816 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 4.
I20260709 13:01:23.910161  8793 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.911060  8742 raft_consensus.cc:493] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.912271  8742 raft_consensus.cc:515] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:23.911679  7707 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
I20260709 13:01:23.914410  8742 leader_election.cc:290] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:23.914541  8693 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:23.916488  8693 raft_consensus.cc:493] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.916916  8693 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.932955  7489 catalog_manager.cc:5697] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 reported cstate change: term changed from 2 to 3, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "1075f1083cc84c349b3a0bd57774c1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:23.934069  7782 leader_election.cc:336] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.940799  8693 raft_consensus.cc:515] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:23.947638  7780 consensus_peers.cc:597] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.948318  7780 leader_election.cc:336] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
I20260709 13:01:23.964006  8815 raft_consensus.cc:493] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:23.964169  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c245d203f74d999c25bede65ee4f53" candidate_uuid: "b81c129769e24f019dc9045ce8c09771" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1075f1083cc84c349b3a0bd57774c1e7"
I20260709 13:01:23.965055  7816 raft_consensus.cc:3060] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.964965  8815 raft_consensus.cc:515] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:23.948838  7780 leader_election.cc:304] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
W20260709 13:01:23.974107  7708 leader_election.cc:336] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:23.970400  8742 raft_consensus.cc:2749] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.986836  8815 leader_election.cc:290] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:23.987835  8693 leader_election.cc:290] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 5 election: Requested vote from peers 1075f1083cc84c349b3a0bd57774c1e7 (127.0.107.196:41545), 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589)
I20260709 13:01:23.994771  7816 raft_consensus.cc:2468] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c129769e24f019dc9045ce8c09771 in term 5.
W20260709 13:01:23.995747  7780 consensus_peers.cc:597] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:23.996475  7780 consensus_peers.cc:597] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.996562  7707 leader_election.cc:304] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7, b81c129769e24f019dc9045ce8c09771; no voters: 
W20260709 13:01:23.997023  7780 consensus_peers.cc:597] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.997452  8693 raft_consensus.cc:2804] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:23.998095  8693 raft_consensus.cc:697] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 5 LEADER]: Becoming Leader. State: Replica: b81c129769e24f019dc9045ce8c09771, State: Running, Role: LEADER
W20260709 13:01:24.001864  7780 consensus_peers.cc:597] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.003161  7706 leader_election.cc:336] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
I20260709 13:01:23.998960  8693 consensus_queue.cc:237] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } }
W20260709 13:01:24.004173  7708 leader_election.cc:336] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:24.004731  7708 leader_election.cc:304] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:24.007588  8815 raft_consensus.cc:2749] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:24.014091  7708 leader_election.cc:336] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:24.024084  7489 catalog_manager.cc:5697] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 reported cstate change: term changed from 4 to 5, leader changed from 80af46fc024041de81a638d29912c8a3 (127.0.107.193) to b81c129769e24f019dc9045ce8c09771 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "b81c129769e24f019dc9045ce8c09771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:24.030478  7780 consensus_peers.cc:597] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.040409   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:24.041626   431 tablet_replica.cc:333] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.042374   431 raft_consensus.cc:2243] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.043279   431 raft_consensus.cc:2272] T de9b9a02932b4dad97d864deeac40bdb P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.045511   431 tablet_replica.cc:333] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.046203   431 raft_consensus.cc:2243] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.046725   431 raft_consensus.cc:2272] T 1c4dcf12326349beb860a3547c340348 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.048652   431 tablet_replica.cc:333] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.049263   431 raft_consensus.cc:2243] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.049727   431 raft_consensus.cc:2272] T 1581b91c4b8044b294ec8540edf505e9 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.051666   431 tablet_replica.cc:333] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.052309   431 raft_consensus.cc:2243] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.052925   431 raft_consensus.cc:2272] T 7c15656cdc6f4507ae213e6321baad95 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.055266   431 tablet_replica.cc:333] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.056164   431 raft_consensus.cc:2243] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.056766   431 raft_consensus.cc:2272] T 3a49f753e0c24447b801656d29b78649 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.058923   431 tablet_replica.cc:333] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.059504   431 raft_consensus.cc:2243] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.060303   431 raft_consensus.cc:2272] T f82c3df35a7c4361be5f6570b4d2af91 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.062772   431 tablet_replica.cc:333] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.063464   431 raft_consensus.cc:2243] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.063930   431 raft_consensus.cc:2272] T 7daadac41440483ba1ee8e8ff7b4f741 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.066679   431 tablet_replica.cc:333] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.067474   431 raft_consensus.cc:2243] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.068050   431 raft_consensus.cc:2272] T 17d9469ca1534ec2b25b7938331c6600 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.070363   431 tablet_replica.cc:333] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.071179   431 raft_consensus.cc:2243] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.072142   431 raft_consensus.cc:2272] T dc0e53656f344150a25cb441648dd489 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.077267   431 tablet_replica.cc:333] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
W20260709 13:01:24.077606  7780 consensus_peers.cc:597] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.078351   431 raft_consensus.cc:2243] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.078949   431 raft_consensus.cc:2272] T f97aa2293ce6406190f9b27a1f8ee8c8 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.081429   431 tablet_replica.cc:333] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.082134   431 raft_consensus.cc:2243] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.082613   431 raft_consensus.cc:2272] T 8153e37254134d1494dcd79f992b6967 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.084633   431 tablet_replica.cc:333] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.085251   431 raft_consensus.cc:2243] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.086364   431 raft_consensus.cc:2272] T f985608da1404258977e2e929aad7559 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.088655   431 tablet_replica.cc:333] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.089269   431 raft_consensus.cc:2243] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.090003   431 pending_rounds.cc:70] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771: Trying to abort 1 pending ops.
I20260709 13:01:24.090232   431 pending_rounds.cc:77] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771: Aborting op as it isn't in flight: id { term: 5 index: 4 } timestamp: 7305634136090198016 op_type: NO_OP noop_request { }
I20260709 13:01:24.090533   431 raft_consensus.cc:2889] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:24.090867   431 raft_consensus.cc:2272] T 30c245d203f74d999c25bede65ee4f53 P b81c129769e24f019dc9045ce8c09771 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.094152   431 tablet_replica.cc:333] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.095041   431 raft_consensus.cc:2243] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.095726   431 raft_consensus.cc:2272] T 3dc7723aa6994ac4a65710463c633f66 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.098237   431 tablet_replica.cc:333] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.098970   431 raft_consensus.cc:2243] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.100049   431 raft_consensus.cc:2272] T 45a1233ab4c040ebaf43748e94eaf5b5 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:24.101619  7780 consensus_peers.cc:597] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.102810   431 tablet_replica.cc:333] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.103571   431 raft_consensus.cc:2243] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.104015   431 raft_consensus.cc:2272] T 5ef8564b08234776a109c3b317ab232e P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.107314   431 tablet_replica.cc:333] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.108587   431 raft_consensus.cc:2243] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.109622   431 raft_consensus.cc:2272] T 8295a58ce0dd4fb99fffd754746b8b0a P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.111644  8693 raft_consensus.cc:493] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80af46fc024041de81a638d29912c8a3)
I20260709 13:01:24.112107  8693 raft_consensus.cc:515] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } } peers { permanent_uuid: "b81c129769e24f019dc9045ce8c09771" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38429 } }
I20260709 13:01:24.112528   431 tablet_replica.cc:333] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.113477   431 raft_consensus.cc:2243] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.114071  8693 leader_election.cc:290] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:24.114672   431 raft_consensus.cc:2272] T 229814a1ef67415c854a94da0c89c7c0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.117038   431 tablet_replica.cc:333] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.117767   431 raft_consensus.cc:2243] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:01:24.118420  7706 leader_election.cc:336] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
I20260709 13:01:24.118810   431 raft_consensus.cc:2272] T 1604dbc6aa844378800263c852a90568 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:24.119086  7708 leader_election.cc:336] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:24.119517  7708 leader_election.cc:304] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b81c129769e24f019dc9045ce8c09771; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:24.120123  8693 raft_consensus.cc:2749] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:24.122052   431 tablet_replica.cc:333] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.122816   431 raft_consensus.cc:2243] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.123394   431 raft_consensus.cc:2272] T 6d7e711bccc84ba9aab8ad5513568455 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.126515   431 tablet_replica.cc:333] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.127167   431 raft_consensus.cc:2243] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.127630   431 raft_consensus.cc:2272] T c23d956c8a9a435baf5e03e60d7a052a P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.129787   431 tablet_replica.cc:333] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.130400   431 raft_consensus.cc:2243] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.131013   431 raft_consensus.cc:2272] T 4a7a672520974144a4f3fffbc0805301 P b81c129769e24f019dc9045ce8c09771 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.133029   431 tablet_replica.cc:333] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.133654   431 raft_consensus.cc:2243] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.134114   431 raft_consensus.cc:2272] T 41b65ffc44e9482a9db36207427de2f7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.136675   431 tablet_replica.cc:333] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.137296   431 raft_consensus.cc:2243] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.137854   431 raft_consensus.cc:2272] T f5457fe8b6ca4fb299cc0137a81729f8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.139889   431 tablet_replica.cc:333] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.140426   431 raft_consensus.cc:2243] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.140815   431 raft_consensus.cc:2272] T 93820f75ef26417db4b155dd5f3847ef P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.142860   431 tablet_replica.cc:333] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.143397   431 raft_consensus.cc:2243] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.144161   431 raft_consensus.cc:2272] T f610a99a66b94fc0aa4565a0494013f0 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.146231   431 tablet_replica.cc:333] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.146747   431 raft_consensus.cc:2243] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.147159   431 raft_consensus.cc:2272] T 4e5331e5203b4e18bef7bbf5215bfcd2 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.149294   431 tablet_replica.cc:333] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.150010   431 raft_consensus.cc:2243] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.150647   431 raft_consensus.cc:2272] T 2911523c3e9f45638bdcf0de7430dda4 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.152704   431 tablet_replica.cc:333] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.153296   431 raft_consensus.cc:2243] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.154160   431 raft_consensus.cc:2272] T 40895010d1874feea26e2f762ab3a77f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.156562   431 tablet_replica.cc:333] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.157361   431 raft_consensus.cc:2243] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.158244   431 raft_consensus.cc:2272] T cba55b3f6e424ec7a65fc13489c43a43 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.160837   431 tablet_replica.cc:333] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.161662   431 raft_consensus.cc:2243] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.162214   431 raft_consensus.cc:2272] T af3917dc3ec14f558877b66019290ec0 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:24.163689  7780 consensus_peers.cc:597] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.165089   431 tablet_replica.cc:333] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.165968   431 raft_consensus.cc:2243] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.167009   431 raft_consensus.cc:2272] T 8cc99687adf94edfbef9f24e9d43510b P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.169535   431 tablet_replica.cc:333] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.170306   431 raft_consensus.cc:2243] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.170828   431 raft_consensus.cc:2272] T fd3528a166624614b3565fd49a48c9d2 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.173902   431 tablet_replica.cc:333] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.174676   431 raft_consensus.cc:2243] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:24.174877  7780 consensus_peers.cc:597] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.175336   431 raft_consensus.cc:2272] T b7201e09d4ad45e1ac2b617f22ed4a70 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.177706   431 tablet_replica.cc:333] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.178315   431 raft_consensus.cc:2243] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.178807   431 raft_consensus.cc:2272] T b712db90ef70445e9ba1d2b20e0ab685 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.181339   431 tablet_replica.cc:333] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.182166   431 raft_consensus.cc:2243] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.182780   431 raft_consensus.cc:2272] T 3ab9b354e4c04221a6922c87d2ba22bd P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.185364   431 tablet_replica.cc:333] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.186023   431 raft_consensus.cc:2243] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.186965   431 raft_consensus.cc:2272] T d85d25c4f4df4190af72f86b0328a345 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.189075   431 tablet_replica.cc:333] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.189726   431 raft_consensus.cc:2243] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.190573   431 raft_consensus.cc:2272] T c80b3e6d140c42ab83aedacbad5a486d P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.192775   431 tablet_replica.cc:333] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.193681   431 raft_consensus.cc:2243] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.194252   431 raft_consensus.cc:2272] T 639d9a3ce83649d6ba3735d7d3d81fc5 P b81c129769e24f019dc9045ce8c09771 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.196599   431 tablet_replica.cc:333] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.197135   431 raft_consensus.cc:2243] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.198020   431 raft_consensus.cc:2272] T 6109e32453a044d0bc4a18d3bf785518 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.200169   431 tablet_replica.cc:333] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.200738   431 raft_consensus.cc:2243] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.201160   431 raft_consensus.cc:2272] T 3c78d34c2d104e6596872bdbc02005b7 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.203135   431 tablet_replica.cc:333] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.203641   431 raft_consensus.cc:2243] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.204052   431 raft_consensus.cc:2272] T d6cdc86b1e3d4df4a94bc251560f88e7 P b81c129769e24f019dc9045ce8c09771 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.205991   431 tablet_replica.cc:333] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.206451   431 raft_consensus.cc:2243] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.206844   431 raft_consensus.cc:2272] T ffd6bf52d5074a8cbfd89d2330e9ca7f P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.208675   431 tablet_replica.cc:333] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771: stopping tablet replica
I20260709 13:01:24.209141   431 raft_consensus.cc:2243] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.209617   431 raft_consensus.cc:2272] T 2a76c63217264185bf001378200c92b8 P b81c129769e24f019dc9045ce8c09771 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:24.225880  7780 consensus_peers.cc:597] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.238348  7782 consensus_peers.cc:597] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.262149  7780 consensus_peers.cc:597] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.283947   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:01:24.348485  7782 consensus_peers.cc:597] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.349109  7782 consensus_peers.cc:597] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:24.349534  7782 consensus_peers.cc:597] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:24.360852  7780 consensus_peers.cc:597] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.377059   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:01:24.400871  8742 raft_consensus.cc:493] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5b52243363f04d04862e5e631403e880)
I20260709 13:01:24.403400  8742 raft_consensus.cc:515] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:24.407173  8742 leader_election.cc:290] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
W20260709 13:01:24.409066  7782 consensus_peers.cc:597] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Couldn't send request to peer 80af46fc024041de81a638d29912c8a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.410578  7780 consensus_peers.cc:597] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:24.414953  7780 leader_election.cc:336] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
W20260709 13:01:24.415491  7782 leader_election.cc:336] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:24.416014  7782 leader_election.cc:304] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:24.417057  8742 raft_consensus.cc:2749] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:24.432672  7780 consensus_peers.cc:597] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 -> Peer b81c129769e24f019dc9045ce8c09771 (127.0.107.195:38429): Couldn't send request to peer b81c129769e24f019dc9045ce8c09771. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.440013   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:24.441102   431 tablet_replica.cc:333] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.441911   431 raft_consensus.cc:2243] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.442446   431 raft_consensus.cc:2272] T de9b9a02932b4dad97d864deeac40bdb P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.444509   431 tablet_replica.cc:333] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.445111   431 raft_consensus.cc:2243] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.445993   431 raft_consensus.cc:2272] T fd3528a166624614b3565fd49a48c9d2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.448159   431 tablet_replica.cc:333] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.448789   431 raft_consensus.cc:2243] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.449944   431 raft_consensus.cc:2272] T 3dc7723aa6994ac4a65710463c633f66 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.451934   431 tablet_replica.cc:333] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.452467   431 raft_consensus.cc:2243] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.452840   431 raft_consensus.cc:2272] T 3c78d34c2d104e6596872bdbc02005b7 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.454726   431 tablet_replica.cc:333] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.455263   431 raft_consensus.cc:2243] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.455698   431 raft_consensus.cc:2272] T 0d97da3f424447f9987d7c6ab8d99c80 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.459800   431 tablet_replica.cc:333] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.460659   431 raft_consensus.cc:2243] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.461644   431 pending_rounds.cc:70] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: Trying to abort 1 pending ops.
I20260709 13:01:24.461899   431 pending_rounds.cc:77] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634135191932928 op_type: NO_OP noop_request { }
I20260709 13:01:24.462298   431 raft_consensus.cc:2889] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:24.462663   431 raft_consensus.cc:2272] T 1581b91c4b8044b294ec8540edf505e9 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.465276   431 tablet_replica.cc:333] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.465934   431 raft_consensus.cc:2243] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.466387   431 raft_consensus.cc:2272] T 7daadac41440483ba1ee8e8ff7b4f741 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.468391   431 tablet_replica.cc:333] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.469059   431 raft_consensus.cc:2243] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.469494   431 raft_consensus.cc:2272] T baabbed5310440d19416189e295e3db0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.471474   431 tablet_replica.cc:333] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.472040   431 raft_consensus.cc:2243] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.472469   431 raft_consensus.cc:2272] T c0511ad7dfd44065b288a786074949ef P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.474359   431 tablet_replica.cc:333] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.475404   431 raft_consensus.cc:2243] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.476507   431 raft_consensus.cc:2272] T 17d9469ca1534ec2b25b7938331c6600 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.478658   431 tablet_replica.cc:333] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.479405   431 raft_consensus.cc:2243] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.480396   431 raft_consensus.cc:2272] T fe0b231c31d34cc19a247378b4e932bf P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.483052   431 tablet_replica.cc:333] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.483695   431 raft_consensus.cc:2243] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.484143   431 raft_consensus.cc:2272] T 5b0c19d3d9ae4f2d97d738803826bf74 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.486153   431 tablet_replica.cc:333] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.486718   431 raft_consensus.cc:2243] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.487167   431 raft_consensus.cc:2272] T 30c245d203f74d999c25bede65ee4f53 P 1075f1083cc84c349b3a0bd57774c1e7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.487658  8742 raft_consensus.cc:493] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b52243363f04d04862e5e631403e880)
I20260709 13:01:24.488266  8742 raft_consensus.cc:515] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1075f1083cc84c349b3a0bd57774c1e7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 41545 } } peers { permanent_uuid: "80af46fc024041de81a638d29912c8a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38589 } } peers { permanent_uuid: "5b52243363f04d04862e5e631403e880" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46081 } }
I20260709 13:01:24.490249  8742 leader_election.cc:290] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589), 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081)
I20260709 13:01:24.490376   431 tablet_replica.cc:333] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.491359   431 raft_consensus.cc:2243] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.491977   431 raft_consensus.cc:2272] T f985608da1404258977e2e929aad7559 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.495390   431 tablet_replica.cc:333] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.496299   431 raft_consensus.cc:2243] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:01:24.496381  7780 leader_election.cc:336] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5b52243363f04d04862e5e631403e880 (127.0.107.194:46081): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46081: connect: Connection refused (error 111)
W20260709 13:01:24.496959  7782 leader_election.cc:336] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80af46fc024041de81a638d29912c8a3 (127.0.107.193:38589): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38589: connect: Connection refused (error 111)
I20260709 13:01:24.497294   431 raft_consensus.cc:2272] T 5ef8564b08234776a109c3b317ab232e P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.497325  7782 leader_election.cc:304] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1075f1083cc84c349b3a0bd57774c1e7; no voters: 5b52243363f04d04862e5e631403e880, 80af46fc024041de81a638d29912c8a3
I20260709 13:01:24.498241  8742 raft_consensus.cc:2749] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:24.499862   431 tablet_replica.cc:333] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.500499   431 raft_consensus.cc:2243] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.500931   431 raft_consensus.cc:2272] T 8295a58ce0dd4fb99fffd754746b8b0a P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.502966   431 tablet_replica.cc:333] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.503468   431 raft_consensus.cc:2243] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.503875   431 raft_consensus.cc:2272] T 3bb46fd098ba461a871adb4c40c79e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.505792   431 tablet_replica.cc:333] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.506312   431 raft_consensus.cc:2243] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.506734   431 raft_consensus.cc:2272] T 1604dbc6aa844378800263c852a90568 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.508605   431 tablet_replica.cc:333] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.509526   431 raft_consensus.cc:2243] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.510574   431 raft_consensus.cc:2272] T 51ea4c1d73af403bb50c3ecab728ec32 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.512548   431 tablet_replica.cc:333] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.513291   431 raft_consensus.cc:2243] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.513936   431 raft_consensus.cc:2272] T 229814a1ef67415c854a94da0c89c7c0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.517035   431 tablet_replica.cc:333] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.517949   431 raft_consensus.cc:2243] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.518896   431 raft_consensus.cc:2272] T f1a4495c3f82450cbeb8cf7b1ce76dce P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.521857   431 tablet_replica.cc:333] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.522796   431 raft_consensus.cc:2243] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.523869   431 raft_consensus.cc:2272] T 6d7e711bccc84ba9aab8ad5513568455 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.526289   431 tablet_replica.cc:333] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.526909   431 raft_consensus.cc:2243] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.527926   431 raft_consensus.cc:2272] T 4e5331e5203b4e18bef7bbf5215bfcd2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.530750   431 tablet_replica.cc:333] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.531819   431 raft_consensus.cc:2243] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.532469   431 raft_consensus.cc:2272] T 40895010d1874feea26e2f762ab3a77f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.534642   431 tablet_replica.cc:333] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.535465   431 raft_consensus.cc:2243] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.535863   431 raft_consensus.cc:2272] T 6109e32453a044d0bc4a18d3bf785518 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.537945   431 tablet_replica.cc:333] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.538447   431 raft_consensus.cc:2243] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.538815   431 raft_consensus.cc:2272] T fa7816c9f7b54ed198fce1d42596e0f2 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.540733   431 tablet_replica.cc:333] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.541285   431 raft_consensus.cc:2243] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.542105   431 raft_consensus.cc:2272] T 3a49f753e0c24447b801656d29b78649 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.543999   431 tablet_replica.cc:333] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.544523   431 raft_consensus.cc:2243] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.544893   431 raft_consensus.cc:2272] T 2ed1559d07294774aa94df29c0b5d59a P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.547433   431 tablet_replica.cc:333] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.547989   431 raft_consensus.cc:2243] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.549081   431 raft_consensus.cc:2272] T cba55b3f6e424ec7a65fc13489c43a43 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.551398   431 tablet_replica.cc:333] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.551991   431 raft_consensus.cc:2243] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.552721   431 pending_rounds.cc:70] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: Trying to abort 1 pending ops.
I20260709 13:01:24.552954   431 pending_rounds.cc:77] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634135481851904 op_type: NO_OP noop_request { }
I20260709 13:01:24.553234   431 raft_consensus.cc:2889] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:24.553610   431 raft_consensus.cc:2272] T af3917dc3ec14f558877b66019290ec0 P 1075f1083cc84c349b3a0bd57774c1e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.557130   431 tablet_replica.cc:333] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.557850   431 raft_consensus.cc:2243] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.558636   431 raft_consensus.cc:2272] T ffd6bf52d5074a8cbfd89d2330e9ca7f P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.560770   431 tablet_replica.cc:333] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.561312   431 raft_consensus.cc:2243] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.561815   431 raft_consensus.cc:2272] T 5496197ab1264ee1887afbf67a081376 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.563985   431 tablet_replica.cc:333] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.564491   431 raft_consensus.cc:2243] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.564874   431 raft_consensus.cc:2272] T 8cc99687adf94edfbef9f24e9d43510b P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.567185   431 tablet_replica.cc:333] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.567711   431 raft_consensus.cc:2243] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.568135   431 raft_consensus.cc:2272] T d4a36b4572f0444dafd0d51bfc100984 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.570312   431 tablet_replica.cc:333] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.570832   431 raft_consensus.cc:2243] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.571245   431 raft_consensus.cc:2272] T dc0e53656f344150a25cb441648dd489 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.573284   431 tablet_replica.cc:333] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.573872   431 raft_consensus.cc:2243] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.574293   431 raft_consensus.cc:2272] T 8153e37254134d1494dcd79f992b6967 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.576223   431 tablet_replica.cc:333] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.576817   431 raft_consensus.cc:2243] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.577206   431 raft_consensus.cc:2272] T 6d02dd8c5b7c4a09a55b18dc5b4d7e93 P 1075f1083cc84c349b3a0bd57774c1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.579257   431 tablet_replica.cc:333] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.579733   431 raft_consensus.cc:2243] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.580195   431 raft_consensus.cc:2272] T ce87ae60b2104f579d001664481e7aa8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.582422   431 tablet_replica.cc:333] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.582939   431 raft_consensus.cc:2243] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.583739   431 raft_consensus.cc:2272] T 3ab9b354e4c04221a6922c87d2ba22bd P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.585829   431 tablet_replica.cc:333] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.586345   431 raft_consensus.cc:2243] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.586782   431 raft_consensus.cc:2272] T d85d25c4f4df4190af72f86b0328a345 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.588770   431 tablet_replica.cc:333] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.589265   431 raft_consensus.cc:2243] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.589778   431 raft_consensus.cc:2272] T f52fbfcad0d747cfb5758693f2cf5be6 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.591812   431 tablet_replica.cc:333] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.592288   431 raft_consensus.cc:2243] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.593096   431 raft_consensus.cc:2272] T f5457fe8b6ca4fb299cc0137a81729f8 P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.595152   431 tablet_replica.cc:333] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.595647   431 raft_consensus.cc:2243] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.596469   431 raft_consensus.cc:2272] T c23d956c8a9a435baf5e03e60d7a052a P 1075f1083cc84c349b3a0bd57774c1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.598752   431 tablet_replica.cc:333] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: stopping tablet replica
I20260709 13:01:24.599207   431 raft_consensus.cc:2243] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.599912   431 pending_rounds.cc:70] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: Trying to abort 1 pending ops.
I20260709 13:01:24.600080   431 pending_rounds.cc:77] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305634135150276608 op_type: NO_OP noop_request { }
I20260709 13:01:24.600329   431 raft_consensus.cc:2889] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:24.600572   431 raft_consensus.cc:2272] T 4a7a672520974144a4f3fffbc0805301 P 1075f1083cc84c349b3a0bd57774c1e7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.672221   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:01:24.741412   431 master.cc:562] Master@127.0.107.254:40329 shutting down...
I20260709 13:01:24.772778   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:24.773325   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.773686   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a779864a96d43e4ba8354c8bcd6ab23: stopping tablet replica
I20260709 13:01:24.798838   431 master.cc:584] Master@127.0.107.254:40329 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34480 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:01:24.907666   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:35247
I20260709 13:01:24.908758   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:24.916059  8820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:24.916106  8819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:24.916924   431 server_base.cc:1061] running on GCE node
W20260709 13:01:24.916087  8822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:24.918433   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:24.918619   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:24.918819   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602084918803 us; error 0 us; skew 500 ppm
I20260709 13:01:24.919390   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:24.922279   431 webserver.cc:533] Webserver started at http://127.0.107.254:42699/ using document root <none> and password file <none>
I20260709 13:01:24.922801   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:24.922969   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:24.923285   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:24.924448   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/master-0-root/instance:
uuid: "55adef86ad9d4898a4fc2d80e8875fef"
format_stamp: "Formatted at 2026-07-09 13:01:24 on dist-test-slave-qv7r"
I20260709 13:01:24.929308   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:01:24.933640  8827 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:24.934631   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:01:24.934903   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/master-0-root
uuid: "55adef86ad9d4898a4fc2d80e8875fef"
format_stamp: "Formatted at 2026-07-09 13:01:24 on dist-test-slave-qv7r"
I20260709 13:01:24.935141   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:24.956247   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:24.957942   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:25.001729   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:35247
I20260709 13:01:25.002034  8878 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:35247 every 8 connection(s)
I20260709 13:01:25.006759  8879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.017393  8879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef: Bootstrap starting.
I20260709 13:01:25.022285  8879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.027007  8879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef: No bootstrap required, opened a new log
I20260709 13:01:25.029285  8879 raft_consensus.cc:359] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adef86ad9d4898a4fc2d80e8875fef" member_type: VOTER }
I20260709 13:01:25.029722  8879 raft_consensus.cc:385] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:25.029973  8879 raft_consensus.cc:740] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55adef86ad9d4898a4fc2d80e8875fef, State: Initialized, Role: FOLLOWER
I20260709 13:01:25.030643  8879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adef86ad9d4898a4fc2d80e8875fef" member_type: VOTER }
I20260709 13:01:25.031127  8879 raft_consensus.cc:399] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:25.031352  8879 raft_consensus.cc:493] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:25.031646  8879 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:25.037550  8879 raft_consensus.cc:515] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adef86ad9d4898a4fc2d80e8875fef" member_type: VOTER }
I20260709 13:01:25.038170  8879 leader_election.cc:304] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55adef86ad9d4898a4fc2d80e8875fef; no voters: 
I20260709 13:01:25.039486  8879 leader_election.cc:290] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:25.039826  8882 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:25.041389  8882 raft_consensus.cc:697] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 1 LEADER]: Becoming Leader. State: Replica: 55adef86ad9d4898a4fc2d80e8875fef, State: Running, Role: LEADER
I20260709 13:01:25.042152  8882 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adef86ad9d4898a4fc2d80e8875fef" member_type: VOTER }
I20260709 13:01:25.042793  8879 sys_catalog.cc:565] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:25.047947  8883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55adef86ad9d4898a4fc2d80e8875fef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adef86ad9d4898a4fc2d80e8875fef" member_type: VOTER } }
I20260709 13:01:25.048260  8884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55adef86ad9d4898a4fc2d80e8875fef. Latest consensus state: current_term: 1 leader_uuid: "55adef86ad9d4898a4fc2d80e8875fef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adef86ad9d4898a4fc2d80e8875fef" member_type: VOTER } }
I20260709 13:01:25.048697  8883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:25.048780  8884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:25.052982  8888 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:25.062117  8888 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:25.063150   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:25.072652  8888 catalog_manager.cc:1383] Generated new cluster ID: 33c15f9795d245749bf3760bbc6dfe1f
I20260709 13:01:25.072983  8888 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:25.092291  8888 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:25.093847  8888 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:25.108011  8888 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef: Generated new TSK 0
I20260709 13:01:25.108723  8888 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:25.130306   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:25.137171  8900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:25.138243  8901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:25.140704  8903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:25.140739   431 server_base.cc:1061] running on GCE node
I20260709 13:01:25.142261   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:25.142464   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:25.142580   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602085142568 us; error 0 us; skew 500 ppm
I20260709 13:01:25.143081   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:25.146149   431 webserver.cc:533] Webserver started at http://127.0.107.193:46611/ using document root <none> and password file <none>
I20260709 13:01:25.146642   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:25.146801   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:25.147004   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:25.148159   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root/instance:
uuid: "3587732b67e04543b5dfa6dcf063c4d9"
format_stamp: "Formatted at 2026-07-09 13:01:25 on dist-test-slave-qv7r"
I20260709 13:01:25.152945   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:01:25.157146  8908 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.158035   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:01:25.158393   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "3587732b67e04543b5dfa6dcf063c4d9"
format_stamp: "Formatted at 2026-07-09 13:01:25 on dist-test-slave-qv7r"
I20260709 13:01:25.158716   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:25.175168   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:25.177160   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:25.178807   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:25.181209   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:25.181449   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.181730   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:25.181923   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.227959   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37565
I20260709 13:01:25.228052  8970 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37565 every 8 connection(s)
I20260709 13:01:25.233420   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:25.242707  8975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:25.243013  8976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:25.246245  8979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:25.247956   431 server_base.cc:1061] running on GCE node
I20260709 13:01:25.248996   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:25.249327   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:25.249512   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602085249476 us; error 0 us; skew 500 ppm
I20260709 13:01:25.250205   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:25.253633   431 webserver.cc:533] Webserver started at http://127.0.107.194:41731/ using document root <none> and password file <none>
I20260709 13:01:25.253772  8971 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35247
I20260709 13:01:25.254210  8971 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:25.254300   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:25.254606   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:25.254937   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:25.255147  8971 heartbeater.cc:507] Master 127.0.107.254:35247 requested a full tablet report, sending...
I20260709 13:01:25.256523   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-1-root/instance:
uuid: "f983a1c60fcd482da04a92c3e89ef73c"
format_stamp: "Formatted at 2026-07-09 13:01:25 on dist-test-slave-qv7r"
I20260709 13:01:25.257736  8844 ts_manager.cc:194] Registered new tserver with Master: 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565)
I20260709 13:01:25.259601  8844 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53252
I20260709 13:01:25.261808   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:01:25.266016  8983 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.266842   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:01:25.267278   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-1-root
uuid: "f983a1c60fcd482da04a92c3e89ef73c"
format_stamp: "Formatted at 2026-07-09 13:01:25 on dist-test-slave-qv7r"
I20260709 13:01:25.267623   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:25.281181   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:25.282459   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:25.284057   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:25.286839   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:25.287146   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.287555   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:25.287762   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.333073   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:35371
I20260709 13:01:25.333163  9045 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:35371 every 8 connection(s)
I20260709 13:01:25.338513   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:25.345959  9049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:25.346470  9050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:25.350862  9046 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35247
I20260709 13:01:25.351263  9046 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:25.351956   431 server_base.cc:1061] running on GCE node
I20260709 13:01:25.351963  9046 heartbeater.cc:507] Master 127.0.107.254:35247 requested a full tablet report, sending...
W20260709 13:01:25.353894  9053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:25.354709  8844 ts_manager.cc:194] Registered new tserver with Master: f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:25.354915   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:25.355278   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:25.355538   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602085355520 us; error 0 us; skew 500 ppm
I20260709 13:01:25.356179   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:25.356405  8844 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53258
I20260709 13:01:25.359405   431 webserver.cc:533] Webserver started at http://127.0.107.195:46551/ using document root <none> and password file <none>
I20260709 13:01:25.360020   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:25.360231   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:25.360539   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:25.362047   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-2-root/instance:
uuid: "509818555c354d57b1579f82dcc5d95e"
format_stamp: "Formatted at 2026-07-09 13:01:25 on dist-test-slave-qv7r"
I20260709 13:01:25.366755   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:01:25.370582  9057 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.371484   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:01:25.371789   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-2-root
uuid: "509818555c354d57b1579f82dcc5d95e"
format_stamp: "Formatted at 2026-07-09 13:01:25 on dist-test-slave-qv7r"
I20260709 13:01:25.372105   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:25.383176   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:25.384392   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:25.385975   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:25.388262   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:25.388499   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.388751   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:25.388926   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:25.433508   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35717
I20260709 13:01:25.433647  9119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35717 every 8 connection(s)
I20260709 13:01:25.449483  9120 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35247
I20260709 13:01:25.450023  9120 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:25.450766  9120 heartbeater.cc:507] Master 127.0.107.254:35247 requested a full tablet report, sending...
I20260709 13:01:25.453068  8844 ts_manager.cc:194] Registered new tserver with Master: 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:25.454057   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016625001s
I20260709 13:01:25.454818  8844 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53266
I20260709 13:01:25.483832  8844 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53276:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:25.487049  8844 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:25.585173  8936 tablet_service.cc:1511] Processing CreateTablet for tablet 726c4ef91e3a4ca18f9ba5401f8c7d55 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:25.586757  8936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726c4ef91e3a4ca18f9ba5401f8c7d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.590773  8935 tablet_service.cc:1511] Processing CreateTablet for tablet 7560d8affdd94282aec2facbf8db1894 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:25.592355  8935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7560d8affdd94282aec2facbf8db1894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.598146  8933 tablet_service.cc:1511] Processing CreateTablet for tablet a519c8dfbca44734872eb0db854f142d (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:25.598649  8934 tablet_service.cc:1511] Processing CreateTablet for tablet cf8c0a7d2394400ab07638bae12a8700 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:25.599671  8933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a519c8dfbca44734872eb0db854f142d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.600739  8934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8c0a7d2394400ab07638bae12a8700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.603875  8932 tablet_service.cc:1511] Processing CreateTablet for tablet f04c453b3cb842699d1f408b5c4499f3 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:25.605326  8932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04c453b3cb842699d1f408b5c4499f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.610689  9007 tablet_service.cc:1511] Processing CreateTablet for tablet f04c453b3cb842699d1f408b5c4499f3 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:25.610822  9011 tablet_service.cc:1511] Processing CreateTablet for tablet 726c4ef91e3a4ca18f9ba5401f8c7d55 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:25.612401  9085 tablet_service.cc:1511] Processing CreateTablet for tablet 726c4ef91e3a4ca18f9ba5401f8c7d55 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:25.614212  9085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726c4ef91e3a4ca18f9ba5401f8c7d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.614733  9009 tablet_service.cc:1511] Processing CreateTablet for tablet cf8c0a7d2394400ab07638bae12a8700 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:25.610456  8931 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9a07317ab847189f0a611b2217ae21 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:25.615886  9010 tablet_service.cc:1511] Processing CreateTablet for tablet 7560d8affdd94282aec2facbf8db1894 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:25.617121  8931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9a07317ab847189f0a611b2217ae21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.613473  9008 tablet_service.cc:1511] Processing CreateTablet for tablet a519c8dfbca44734872eb0db854f142d (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:25.612445  9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04c453b3cb842699d1f408b5c4499f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.619349  9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726c4ef91e3a4ca18f9ba5401f8c7d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.620389  9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a519c8dfbca44734872eb0db854f142d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.621486  9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8c0a7d2394400ab07638bae12a8700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.621295  9084 tablet_service.cc:1511] Processing CreateTablet for tablet 7560d8affdd94282aec2facbf8db1894 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:25.622810  9084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7560d8affdd94282aec2facbf8db1894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.625619  9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7560d8affdd94282aec2facbf8db1894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.639968  9083 tablet_service.cc:1511] Processing CreateTablet for tablet cf8c0a7d2394400ab07638bae12a8700 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:25.642143  9083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8c0a7d2394400ab07638bae12a8700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.644042  8930 tablet_service.cc:1511] Processing CreateTablet for tablet f645be290c1c44fca08695ae79d12490 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:25.645521  8930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f645be290c1c44fca08695ae79d12490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.648101  9082 tablet_service.cc:1511] Processing CreateTablet for tablet a519c8dfbca44734872eb0db854f142d (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:25.649839  9082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a519c8dfbca44734872eb0db854f142d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.653349  9081 tablet_service.cc:1511] Processing CreateTablet for tablet f04c453b3cb842699d1f408b5c4499f3 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:25.654973  9081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04c453b3cb842699d1f408b5c4499f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.668077  9080 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9a07317ab847189f0a611b2217ae21 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:25.671780  9006 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9a07317ab847189f0a611b2217ae21 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:25.675364  9080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9a07317ab847189f0a611b2217ae21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.675819  9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9a07317ab847189f0a611b2217ae21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.698472  9079 tablet_service.cc:1511] Processing CreateTablet for tablet f645be290c1c44fca08695ae79d12490 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:25.700042  9079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f645be290c1c44fca08695ae79d12490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.699579  9005 tablet_service.cc:1511] Processing CreateTablet for tablet f645be290c1c44fca08695ae79d12490 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:25.701095  9005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f645be290c1c44fca08695ae79d12490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.740093  9007 tablet_service.cc:1511] Processing CreateTablet for tablet b9592647eeae45368d0e6be79d6dae61 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:25.741660  9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9592647eeae45368d0e6be79d6dae61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.743218  8936 tablet_service.cc:1511] Processing CreateTablet for tablet b9592647eeae45368d0e6be79d6dae61 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:25.745189  8936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9592647eeae45368d0e6be79d6dae61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.748870  9084 tablet_service.cc:1511] Processing CreateTablet for tablet b9592647eeae45368d0e6be79d6dae61 (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:25.750711  9084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9592647eeae45368d0e6be79d6dae61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.764617  8930 tablet_service.cc:1511] Processing CreateTablet for tablet 91bd10d9eb7d4caea02143569000d5ca (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:25.768692  8930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bd10d9eb7d4caea02143569000d5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.770093  9135 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:25.783905  9010 tablet_service.cc:1511] Processing CreateTablet for tablet 91bd10d9eb7d4caea02143569000d5ca (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:25.785298  9136 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:25.785399  9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bd10d9eb7d4caea02143569000d5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.786836  9083 tablet_service.cc:1511] Processing CreateTablet for tablet 91bd10d9eb7d4caea02143569000d5ca (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:25.788806  9083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bd10d9eb7d4caea02143569000d5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.809706  9135 tablet_bootstrap.cc:654] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.813719  9137 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:25.823643  9137 tablet_bootstrap.cc:654] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.823918  8932 tablet_service.cc:1511] Processing CreateTablet for tablet 7192328be1fb419087548a2b3b9f11db (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:25.825693  8932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7192328be1fb419087548a2b3b9f11db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.842089  9135 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:25.841981  9009 tablet_service.cc:1511] Processing CreateTablet for tablet 7192328be1fb419087548a2b3b9f11db (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:25.842739  9135 ts_tablet_manager.cc:1403] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.008s
I20260709 13:01:25.843905  9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7192328be1fb419087548a2b3b9f11db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.835917  9080 tablet_service.cc:1511] Processing CreateTablet for tablet 7192328be1fb419087548a2b3b9f11db (DEFAULT_TABLE table=test-workload [id=f292ef12aad44525a4e537190c228736]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:25.847270  9080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7192328be1fb419087548a2b3b9f11db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.847445  9135 raft_consensus.cc:359] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.848309  9135 raft_consensus.cc:385] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:25.848721  9137 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:25.849289  9137 ts_tablet_manager.cc:1403] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.000s
I20260709 13:01:25.848642  9135 raft_consensus.cc:740] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:25.850849  9135 consensus_queue.cc:260] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.849685  9136 tablet_bootstrap.cc:654] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.853057  9137 raft_consensus.cc:359] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.853955  9137 raft_consensus.cc:385] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:25.854244  9137 raft_consensus.cc:740] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:25.856142  9137 consensus_queue.cc:260] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.867033  9135 ts_tablet_manager.cc:1434] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.008s
I20260709 13:01:25.867964  8971 heartbeater.cc:499] Master 127.0.107.254:35247 was elected leader, sending a full tablet report...
I20260709 13:01:25.868510  9120 heartbeater.cc:499] Master 127.0.107.254:35247 was elected leader, sending a full tablet report...
I20260709 13:01:25.867074  9137 ts_tablet_manager.cc:1434] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:01:25.870898  9136 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:25.871773  9136 ts_tablet_manager.cc:1403] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.003s
I20260709 13:01:25.884696  9135 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:25.881486  9136 raft_consensus.cc:359] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:25.890017  9136 raft_consensus.cc:385] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:25.890407  9136 raft_consensus.cc:740] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:25.890050  9137 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:25.893134  9136 consensus_queue.cc:260] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:25.894199  9135 tablet_bootstrap.cc:654] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.905058  9136 ts_tablet_manager.cc:1434] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.033s	user 0.013s	sys 0.003s
I20260709 13:01:25.906602  9137 tablet_bootstrap.cc:654] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.907991  9145 raft_consensus.cc:493] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.908597  9145 raft_consensus.cc:515] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:25.910626  9046 heartbeater.cc:499] Master 127.0.107.254:35247 was elected leader, sending a full tablet report...
I20260709 13:01:25.915787  9136 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:25.917757  9145 leader_election.cc:290] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:25.925011  9135 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:25.925769  9135 ts_tablet_manager.cc:1403] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.020s
I20260709 13:01:25.928916  9135 raft_consensus.cc:359] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.931452  9136 tablet_bootstrap.cc:654] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.933748  9135 raft_consensus.cc:385] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:25.933328  9137 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:25.938211  9135 raft_consensus.cc:740] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:25.938458  9137 ts_tablet_manager.cc:1403] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.014s
W20260709 13:01:25.938488  9121 tablet.cc:2406] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:25.939495  9135 consensus_queue.cc:260] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.941972  9137 raft_consensus.cc:359] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.942888  9137 raft_consensus.cc:385] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:25.943210  9137 raft_consensus.cc:740] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:25.943964  9137 consensus_queue.cc:260] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.946698  9137 ts_tablet_manager.cc:1434] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:01:25.948040  9137 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:25.942426  9135 ts_tablet_manager.cc:1434] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:01:25.950918  9135 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:25.950711  9142 raft_consensus.cc:493] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.951596  9142 raft_consensus.cc:515] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.962047  9135 tablet_bootstrap.cc:654] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.967913  9140 raft_consensus.cc:493] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.968918  9137 tablet_bootstrap.cc:654] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:25.968506  9140 raft_consensus.cc:515] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:25.974509  9142 leader_election.cc:290] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:25.976567  9140 leader_election.cc:290] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.037310  9137 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:26.049490  9137 ts_tablet_manager.cc:1403] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.033s
I20260709 13:01:26.053996  9136 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:26.054706  9136 ts_tablet_manager.cc:1403] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.139s	user 0.037s	sys 0.025s
W20260709 13:01:26.056708  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:26.056896  9137 raft_consensus.cc:359] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:26.058463  9137 raft_consensus.cc:385] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.060876  9137 raft_consensus.cc:740] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.061178  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.061735  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:26.062592  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.062830  9136 raft_consensus.cc:359] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.063560  9136 raft_consensus.cc:385] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:26.065666  8909 leader_election.cc:343] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.066100  9136 raft_consensus.cc:740] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
W20260709 13:01:26.067509  8912 leader_election.cc:343] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.066030  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:26.070188  9137 consensus_queue.cc:260] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:26.072060  8912 leader_election.cc:304] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9; no voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c
W20260709 13:01:26.074106  8987 leader_election.cc:343] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.073890  9136 consensus_queue.cc:260] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.076745  9136 ts_tablet_manager.cc:1434] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:01:26.073930  9137 ts_tablet_manager.cc:1434] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:01:26.077818  9140 raft_consensus.cc:2749] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:26.078471  9137 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:26.076654  9135 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:26.079846  9135 ts_tablet_manager.cc:1403] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.129s	user 0.040s	sys 0.024s
I20260709 13:01:26.086187  9137 tablet_bootstrap.cc:654] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.081192  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.087163  9135 raft_consensus.cc:359] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.089811  9135 raft_consensus.cc:385] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.090232  9135 raft_consensus.cc:740] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.090986  9135 consensus_queue.cc:260] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.093080  9135 ts_tablet_manager.cc:1434] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:26.094405  9135 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
W20260709 13:01:26.096354  9061 leader_election.cc:343] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.103513  9095 raft_consensus.cc:2468] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 0.
I20260709 13:01:26.105005  9135 tablet_bootstrap.cc:654] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.082944  9136 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:26.106596  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.106631  9137 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:26.107810  9137 ts_tablet_manager.cc:1403] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 13:01:26.108176  9140 raft_consensus.cc:493] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:26.110826  9058 leader_election.cc:343] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.112458  9058 leader_election.cc:304] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e; no voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:26.114156  8987 leader_election.cc:304] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 3587732b67e04543b5dfa6dcf063c4d9
I20260709 13:01:26.109256  9140 raft_consensus.cc:515] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.116176  9145 raft_consensus.cc:2804] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.116596  9145 raft_consensus.cc:493] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.117316  9145 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.118983  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.119511  9136 tablet_bootstrap.cc:654] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:26.121603  8909 leader_election.cc:343] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.122685  9142 raft_consensus.cc:2749] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:26.128732  9145 raft_consensus.cc:515] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:26.132227  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:26.112604  9137 raft_consensus.cc:359] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
W20260709 13:01:26.135337  8987 leader_election.cc:343] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.135903  9140 leader_election.cc:290] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.135375  9136 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:26.137045  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:26.138155  9136 ts_tablet_manager.cc:1403] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.014s
W20260709 13:01:26.139132  8912 leader_election.cc:343] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.139621  9135 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:26.139784  8912 leader_election.cc:304] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9; no voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:26.139822  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:26.140264  9135 ts_tablet_manager.cc:1403] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.023s
I20260709 13:01:26.140690  9095 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.141361  9140 raft_consensus.cc:2749] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:26.135897  9137 raft_consensus.cc:385] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.142427  9137 raft_consensus.cc:740] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.142246  9136 raft_consensus.cc:359] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.143273  9136 raft_consensus.cc:385] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.143621  9136 raft_consensus.cc:740] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.143657  9135 raft_consensus.cc:359] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.144599  9135 raft_consensus.cc:385] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.144558  9142 raft_consensus.cc:493] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.144702  9136 consensus_queue.cc:260] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.145411  9142 raft_consensus.cc:515] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.145608  9137 consensus_queue.cc:260] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.147326  9145 leader_election.cc:290] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.147622  9136 ts_tablet_manager.cc:1434] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:26.149204  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560d8affdd94282aec2facbf8db1894" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.149834  9135 raft_consensus.cc:740] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.150220  8946 raft_consensus.cc:2468] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.151299  9135 consensus_queue.cc:260] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.152112  9061 leader_election.cc:304] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:26.154326  9135 ts_tablet_manager.cc:1434] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:01:26.154803  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560d8affdd94282aec2facbf8db1894" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.149300  9142 leader_election.cc:290] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.155969  9021 raft_consensus.cc:2468] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.156739  9136 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:26.158962  9137 ts_tablet_manager.cc:1434] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.005s
I20260709 13:01:26.160845  9142 raft_consensus.cc:2804] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.161422  9142 raft_consensus.cc:493] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.161784  9142 raft_consensus.cc:3060] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.162643  9095 raft_consensus.cc:2468] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 1.
I20260709 13:01:26.164011  9136 tablet_bootstrap.cc:654] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.164224  9137 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:26.168942  8987 leader_election.cc:304] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 3587732b67e04543b5dfa6dcf063c4d9
I20260709 13:01:26.169641  9135 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:26.170969  9145 raft_consensus.cc:2804] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.171653  9145 raft_consensus.cc:697] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:26.176069  9135 tablet_bootstrap.cc:654] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.172787  9145 consensus_queue.cc:237] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:26.186129  9137 tablet_bootstrap.cc:654] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.187480  9136 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:26.187903  9142 raft_consensus.cc:515] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.188269  9136 ts_tablet_manager.cc:1403] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.003s
I20260709 13:01:26.195674  9136 raft_consensus.cc:359] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.198910  9142 leader_election.cc:290] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.199791  9136 raft_consensus.cc:385] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.200498  9136 raft_consensus.cc:740] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.201025  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560d8affdd94282aec2facbf8db1894" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:26.202205  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560d8affdd94282aec2facbf8db1894" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:26.201779  9136 consensus_queue.cc:260] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.203068  8946 raft_consensus.cc:3060] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.201944  9021 raft_consensus.cc:3060] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.206090  9136 ts_tablet_manager.cc:1434] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:01:26.207682  9136 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:26.219266  9136 tablet_bootstrap.cc:654] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.225428  9021 raft_consensus.cc:2468] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.227376  9058 leader_election.cc:304] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.228958  9142 raft_consensus.cc:2804] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.229298  8946 raft_consensus.cc:2468] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.229538  9142 raft_consensus.cc:697] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:26.230885  9135 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:26.231451  9135 ts_tablet_manager.cc:1403] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.011s
I20260709 13:01:26.231674  9142 consensus_queue.cc:237] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.240685  8844 catalog_manager.cc:5697] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 0 to 1, leader changed from <none> to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.249173  9135 raft_consensus.cc:359] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:26.250460  9135 raft_consensus.cc:385] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.250787  9135 raft_consensus.cc:740] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.251220  9145 raft_consensus.cc:493] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.252305  9145 raft_consensus.cc:515] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.254205  9137 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:26.254544  9145 leader_election.cc:290] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.255014  9137 ts_tablet_manager.cc:1403] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.091s	user 0.023s	sys 0.029s
I20260709 13:01:26.258076  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:26.254890  8843 catalog_manager.cc:5697] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 0 to 1, leader changed from <none> to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.260658  9135 consensus_queue.cc:260] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:26.260986  9137 raft_consensus.cc:359] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.262884  9137 raft_consensus.cc:385] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.263269  9137 raft_consensus.cc:740] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
W20260709 13:01:26.263636  8987 leader_election.cc:343] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.264078  9137 consensus_queue.cc:260] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.265377  9135 ts_tablet_manager.cc:1434] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 13:01:26.265913  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.269171  9137 ts_tablet_manager.cc:1434] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:01:26.269230  8946 raft_consensus.cc:2468] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 0.
I20260709 13:01:26.266659  9136 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:26.269766  9135 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:26.270323  9136 ts_tablet_manager.cc:1403] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.012s
I20260709 13:01:26.270462  9137 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:26.270960  8987 leader_election.cc:304] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:26.272264  9145 raft_consensus.cc:2804] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.272647  9145 raft_consensus.cc:493] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.273010  9145 raft_consensus.cc:3060] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.273885  9136 raft_consensus.cc:359] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.274770  9136 raft_consensus.cc:385] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.275099  9136 raft_consensus.cc:740] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.276103  9136 consensus_queue.cc:260] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.277585  9135 tablet_bootstrap.cc:654] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.277631  9137 tablet_bootstrap.cc:654] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.279107  9136 ts_tablet_manager.cc:1434] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:26.280611  9136 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:26.281461  9145 raft_consensus.cc:515] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.286049  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:26.286886  8946 raft_consensus.cc:3060] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.291455  9135 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:26.291759  9136 tablet_bootstrap.cc:654] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.292166  9135 ts_tablet_manager.cc:1403] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 13:01:26.292423  9137 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:26.293044  9137 ts_tablet_manager.cc:1403] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 13:01:26.296290  9135 raft_consensus.cc:359] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.297446  9135 raft_consensus.cc:385] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.297907  9135 raft_consensus.cc:740] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.298039  9137 raft_consensus.cc:359] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.299355  9137 raft_consensus.cc:385] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.298923  9135 consensus_queue.cc:260] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.299793  9137 raft_consensus.cc:740] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.300117  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:26.300830  9145 leader_election.cc:290] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.302310  9135 ts_tablet_manager.cc:1434] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:01:26.302112  9142 raft_consensus.cc:493] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.302945  9142 raft_consensus.cc:515] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.304220  8946 raft_consensus.cc:2468] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 1.
I20260709 13:01:26.305835  8987 leader_election.cc:304] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.306399  9136 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:26.306764  9145 raft_consensus.cc:2804] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.306491  9137 consensus_queue.cc:260] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.307284  8945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.307396  9145 raft_consensus.cc:697] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:26.307186  9136 ts_tablet_manager.cc:1403] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.005s
I20260709 13:01:26.307863  9095 raft_consensus.cc:3060] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.308491  9140 raft_consensus.cc:493] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.308570  9145 consensus_queue.cc:237] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.309123  9140 raft_consensus.cc:515] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:26.311847  9140 leader_election.cc:290] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.312987  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.313301  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:26.311792  9136 raft_consensus.cc:359] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.314263  9094 raft_consensus.cc:2393] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3587732b67e04543b5dfa6dcf063c4d9 in current term 1: Already voted for candidate f983a1c60fcd482da04a92c3e89ef73c in this term.
I20260709 13:01:26.314306  9136 raft_consensus.cc:385] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.314849  9136 raft_consensus.cc:740] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.315876  9136 consensus_queue.cc:260] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.317898  8912 leader_election.cc:304] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9; no voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:26.318960  9136 ts_tablet_manager.cc:1434] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
W20260709 13:01:26.316543  9061 leader_election.cc:343] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.321884  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.322606  9140 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.317277  9095 raft_consensus.cc:2468] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 1.
W20260709 13:01:26.323541  9058 leader_election.cc:343] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.324038  9058 leader_election.cc:304] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e; no voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:26.324272  9136 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:26.324946  9142 leader_election.cc:290] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.324986  9162 raft_consensus.cc:2749] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:26.326902  9135 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:26.329088  9137 ts_tablet_manager.cc:1434] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.005s
I20260709 13:01:26.330236  9137 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:26.333945  9135 tablet_bootstrap.cc:654] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.337122  9137 tablet_bootstrap.cc:654] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.334143  9136 tablet_bootstrap.cc:654] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.338682  9140 raft_consensus.cc:2749] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:26.350503  9137 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:26.350657  9135 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:26.351208  9137 ts_tablet_manager.cc:1403] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.010s
I20260709 13:01:26.351701  9135 ts_tablet_manager.cc:1403] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:01:26.355027  9137 raft_consensus.cc:359] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.356315  9137 raft_consensus.cc:385] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.356635  9137 raft_consensus.cc:740] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.357576  9137 consensus_queue.cc:260] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.361040  9137 ts_tablet_manager.cc:1434] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:01:26.359936  9135 raft_consensus.cc:359] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.362679  9135 raft_consensus.cc:385] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.363046  9137 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:26.368031  9143 raft_consensus.cc:493] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.368860  9143 raft_consensus.cc:515] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.363083  9135 raft_consensus.cc:740] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.371840  9135 consensus_queue.cc:260] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.373826  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.373849  9140 raft_consensus.cc:493] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.374708  9143 leader_election.cc:290] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.374821  9140 raft_consensus.cc:515] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.375722  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
W20260709 13:01:26.376124  8987 leader_election.cc:343] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.378499  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.378823  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:26.379222  9021 raft_consensus.cc:2468] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3587732b67e04543b5dfa6dcf063c4d9 in term 0.
I20260709 13:01:26.379467  9136 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
W20260709 13:01:26.379099  8987 leader_election.cc:343] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.380137  9136 ts_tablet_manager.cc:1403] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.028s
I20260709 13:01:26.380195  8987 leader_election.cc:304] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f983a1c60fcd482da04a92c3e89ef73c; no voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:26.381274  8909 leader_election.cc:304] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.382128  9143 raft_consensus.cc:2749] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:26.379419  9140 leader_election.cc:290] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.379498  9095 raft_consensus.cc:2468] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3587732b67e04543b5dfa6dcf063c4d9 in term 0.
I20260709 13:01:26.383322  9140 raft_consensus.cc:2804] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.383987  9140 raft_consensus.cc:493] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.384661  9140 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.384733  9136 raft_consensus.cc:359] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.385996  9136 raft_consensus.cc:385] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.386310  9136 raft_consensus.cc:740] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.391966  9137 tablet_bootstrap.cc:654] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.391793  9136 consensus_queue.cc:260] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.394584  9136 ts_tablet_manager.cc:1434] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:01:26.395929  9136 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:26.400599  8844 catalog_manager.cc:5697] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 0 to 1, leader changed from <none> to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.406158  9135 ts_tablet_manager.cc:1434] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.005s
I20260709 13:01:26.409917  9136 tablet_bootstrap.cc:654] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.414124  9135 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:26.408918  9140 raft_consensus.cc:515] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.419929  9140 leader_election.cc:290] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 election: Requested vote from peers f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.422322  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:26.423084  9095 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.425526  9136 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:26.426642  9136 ts_tablet_manager.cc:1403] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.007s
I20260709 13:01:26.429554  9136 raft_consensus.cc:359] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.430493  9136 raft_consensus.cc:385] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.430838  9136 raft_consensus.cc:740] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.431573  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:26.431672  9135 tablet_bootstrap.cc:654] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.432410  9021 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.431743  9136 consensus_queue.cc:260] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.435719  9136 ts_tablet_manager.cc:1434] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:01:26.438668  9136 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:26.442647  9021 raft_consensus.cc:2468] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3587732b67e04543b5dfa6dcf063c4d9 in term 1.
I20260709 13:01:26.447791  9095 raft_consensus.cc:2468] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3587732b67e04543b5dfa6dcf063c4d9 in term 1.
I20260709 13:01:26.448414  9135 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:26.449007  9135 ts_tablet_manager.cc:1403] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.002s
I20260709 13:01:26.449959  8912 leader_election.cc:304] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:26.450629  9137 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:26.451184  9137 ts_tablet_manager.cc:1403] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.016s
I20260709 13:01:26.451977  9135 raft_consensus.cc:359] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.453171  9135 raft_consensus.cc:385] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.451929  9181 raft_consensus.cc:2804] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.453467  9135 raft_consensus.cc:740] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.453624  9136 tablet_bootstrap.cc:654] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.454028  9181 raft_consensus.cc:697] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 LEADER]: Becoming Leader. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Running, Role: LEADER
I20260709 13:01:26.455183  9135 consensus_queue.cc:260] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.456349  9137 raft_consensus.cc:359] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.457239  9137 raft_consensus.cc:385] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.457597  9137 raft_consensus.cc:740] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.455053  9181 consensus_queue.cc:237] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.458621  9137 consensus_queue.cc:260] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.459519  9135 ts_tablet_manager.cc:1434] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:01:26.460700  9135 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:26.462039  9137 ts_tablet_manager.cc:1434] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:01:26.463650  9137 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:26.471794  9135 tablet_bootstrap.cc:654] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.475555  9137 tablet_bootstrap.cc:654] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.479624  9136 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:26.480420  9136 ts_tablet_manager.cc:1403] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.008s
I20260709 13:01:26.484725  9136 raft_consensus.cc:359] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.485833  9136 raft_consensus.cc:385] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.486245  9136 raft_consensus.cc:740] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.487206  9136 consensus_queue.cc:260] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.492187  9136 ts_tablet_manager.cc:1434] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:01:26.495077  8844 catalog_manager.cc:5697] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3587732b67e04543b5dfa6dcf063c4d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.498589  9137 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:26.499222  9137 ts_tablet_manager.cc:1403] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.008s
I20260709 13:01:26.502072  9136 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c: Bootstrap starting.
I20260709 13:01:26.503412  9137 raft_consensus.cc:359] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.504371  9137 raft_consensus.cc:385] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.504763  9137 raft_consensus.cc:740] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.505535  9137 consensus_queue.cc:260] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.508332  9137 ts_tablet_manager.cc:1434] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:01:26.509545  9137 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e: Bootstrap starting.
I20260709 13:01:26.516510  9136 tablet_bootstrap.cc:654] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.512537  9181 raft_consensus.cc:493] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.516942  9135 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:26.517649  9135 ts_tablet_manager.cc:1403] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.009s
I20260709 13:01:26.517508  9181 raft_consensus.cc:515] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.521420  9135 raft_consensus.cc:359] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.522526  9135 raft_consensus.cc:385] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.522830  9135 raft_consensus.cc:740] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.523919  9135 consensus_queue.cc:260] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.524396  9137 tablet_bootstrap.cc:654] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.526866  9142 raft_consensus.cc:493] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.527421  9142 raft_consensus.cc:515] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.531111  9181 leader_election.cc:290] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.532526  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645be290c1c44fca08695ae79d12490" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:26.532642  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645be290c1c44fca08695ae79d12490" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.534070  9021 raft_consensus.cc:2468] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3587732b67e04543b5dfa6dcf063c4d9 in term 0.
I20260709 13:01:26.534495  9142 leader_election.cc:290] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.535748  9135 ts_tablet_manager.cc:1434] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:01:26.534874  9095 raft_consensus.cc:2468] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3587732b67e04543b5dfa6dcf063c4d9 in term 0.
I20260709 13:01:26.536317  8909 leader_election.cc:304] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.537313  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bd10d9eb7d4caea02143569000d5ca" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.540133  9135 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:26.540462  9181 raft_consensus.cc:2804] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.541920  8946 raft_consensus.cc:2468] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.543098  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bd10d9eb7d4caea02143569000d5ca" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.545869  9136 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c: No bootstrap required, opened a new log
I20260709 13:01:26.545711  9021 raft_consensus.cc:2468] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.545481  9061 leader_election.cc:304] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:26.546939  9136 ts_tablet_manager.cc:1403] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.005s
I20260709 13:01:26.547395  9142 raft_consensus.cc:2804] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.547997  9142 raft_consensus.cc:493] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.548651  9142 raft_consensus.cc:3060] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.549758  9136 raft_consensus.cc:359] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.550531  9136 raft_consensus.cc:385] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.550871  9136 raft_consensus.cc:740] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.543285  9181 raft_consensus.cc:493] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.551790  9136 consensus_queue.cc:260] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.553349  9181 raft_consensus.cc:3060] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.560545  9142 raft_consensus.cc:515] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.565999  9136 ts_tablet_manager.cc:1434] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:01:26.570030  9137 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e: No bootstrap required, opened a new log
I20260709 13:01:26.571516  9137 ts_tablet_manager.cc:1403] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.017s
I20260709 13:01:26.571012  9181 raft_consensus.cc:515] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.573668  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bd10d9eb7d4caea02143569000d5ca" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:26.574381  8946 raft_consensus.cc:3060] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.575014  9137 raft_consensus.cc:359] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.575785  9137 raft_consensus.cc:385] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:26.576064  9137 raft_consensus.cc:740] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.576805  9137 consensus_queue.cc:260] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.577481  9142 leader_election.cc:290] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.578914  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645be290c1c44fca08695ae79d12490" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:26.578982  9137 ts_tablet_manager.cc:1434] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:01:26.579663  9021 raft_consensus.cc:3060] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.581758  9181 leader_election.cc:290] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 election: Requested vote from peers f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.586056  9020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bd10d9eb7d4caea02143569000d5ca" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:26.586812  9020 raft_consensus.cc:3060] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.582675  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645be290c1c44fca08695ae79d12490" candidate_uuid: "3587732b67e04543b5dfa6dcf063c4d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:26.588524  9095 raft_consensus.cc:3060] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.592355  9021 raft_consensus.cc:2468] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3587732b67e04543b5dfa6dcf063c4d9 in term 1.
I20260709 13:01:26.593946  8909 leader_election.cc:304] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.594998  9140 raft_consensus.cc:2804] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.595959  9020 raft_consensus.cc:2468] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.597360  9058 leader_election.cc:304] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.597846  8946 raft_consensus.cc:2468] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.600436  9162 raft_consensus.cc:2804] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.600960  9162 raft_consensus.cc:697] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:26.601318  9163 raft_consensus.cc:493] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.602144  9163 raft_consensus.cc:515] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.602912  9162 consensus_queue.cc:237] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.613435  9142 raft_consensus.cc:493] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.614189  9142 raft_consensus.cc:515] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.614440  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.607578  9163 leader_election.cc:290] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.615204  8946 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.617053  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.618817  9021 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.619144  9061 leader_election.cc:304] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:26.620107  9163 raft_consensus.cc:2804] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.620585  9163 raft_consensus.cc:493] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.620949  9163 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.623308  9142 leader_election.cc:290] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.625000  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.627146  9021 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.628039  9135 tablet_bootstrap.cc:654] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:26.628770  9058 leader_election.cc:304] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.629856  9142 raft_consensus.cc:2804] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.630350  9142 raft_consensus.cc:493] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.630278  9163 raft_consensus.cc:515] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.630927  9142 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.626423  9095 raft_consensus.cc:2468] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3587732b67e04543b5dfa6dcf063c4d9 in term 1.
I20260709 13:01:26.626407  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.633515  8946 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.634137  8945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:26.635108  8945 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.625658  9140 raft_consensus.cc:697] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 LEADER]: Becoming Leader. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Running, Role: LEADER
I20260709 13:01:26.637032  9140 consensus_queue.cc:237] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.640105  9163 leader_election.cc:290] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.642256  9020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:26.643999  9020 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.648591  9163 consensus_queue.cc:1048] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:26.650935  9163 raft_consensus.cc:493] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.651571  9163 raft_consensus.cc:515] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.649601  9135 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: No bootstrap required, opened a new log
I20260709 13:01:26.654137  9135 ts_tablet_manager.cc:1403] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.001s
I20260709 13:01:26.656368  9020 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.656791  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.657857  9058 leader_election.cc:304] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.658135  9018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:26.658952  9018 raft_consensus.cc:2468] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 0.
I20260709 13:01:26.661458  9163 leader_election.cc:290] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.662169  9163 raft_consensus.cc:2804] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.665536  9163 raft_consensus.cc:697] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:26.666383  9145 consensus_queue.cc:1048] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:26.666484  9163 consensus_queue.cc:237] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.670348  8945 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.662089  9058 leader_election.cc:304] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.670472  9135 raft_consensus.cc:359] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.671283  9135 raft_consensus.cc:385] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:26.671344  9061 leader_election.cc:343] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:26.672437  9193 raft_consensus.cc:2804] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.673113  9193 raft_consensus.cc:493] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.673467  9193 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.671615  9135 raft_consensus.cc:740] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:26.675828  9135 consensus_queue.cc:260] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.675534  9142 raft_consensus.cc:515] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.683020  9135 ts_tablet_manager.cc:1434] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:01:26.684690  9142 leader_election.cc:290] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.686985  8945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:26.687685  8945 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.690646  8843 catalog_manager.cc:5697] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 0 to 1, leader changed from <none> to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.692960  8841 catalog_manager.cc:5697] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3587732b67e04543b5dfa6dcf063c4d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.696579  9193 raft_consensus.cc:515] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.699069  9020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:26.707114  9020 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.708235  8946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:26.709224  8946 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.714241  8945 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.715374  9021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:26.716323  9021 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.717120  9061 leader_election.cc:304] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:26.725713  9193 leader_election.cc:290] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:26.726715  9193 raft_consensus.cc:2804] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.727685  9193 raft_consensus.cc:697] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:26.729161  9193 consensus_queue.cc:237] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.733971  9021 raft_consensus.cc:2468] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.735925  9058 leader_election.cc:304] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.737196  9162 raft_consensus.cc:2804] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.738099  9162 raft_consensus.cc:697] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:26.739257  9162 consensus_queue.cc:237] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.749210  9020 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.769851  8946 raft_consensus.cc:2468] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
I20260709 13:01:26.773365  9142 consensus_queue.cc:1048] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:26.777091  9145 consensus_queue.cc:1048] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:26.810570  9206 raft_consensus.cc:493] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.809855  8841 catalog_manager.cc:5697] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 0 to 1, leader changed from <none> to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.811146  9206 raft_consensus.cc:515] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.812363  8841 catalog_manager.cc:5697] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 0 to 1, leader changed from <none> to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.814179  8841 catalog_manager.cc:5697] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 0 to 1, leader changed from <none> to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.815407  8944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9" is_pre_election: true
I20260709 13:01:26.816175  8944 raft_consensus.cc:2468] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 0.
I20260709 13:01:26.816282  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:26.817449  9094 raft_consensus.cc:2468] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 0.
I20260709 13:01:26.818940  8987 leader_election.cc:304] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.819867  9143 raft_consensus.cc:2804] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:26.820098  9206 leader_election.cc:290] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.820549  9143 raft_consensus.cc:493] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.821062  9143 raft_consensus.cc:3060] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.829829  9206 consensus_queue.cc:1048] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:26.836041  9143 raft_consensus.cc:515] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.839648  8945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:26.840330  8945 raft_consensus.cc:3060] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.840883  9143 leader_election.cc:290] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:26.845369  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:26.845948  8945 raft_consensus.cc:2468] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 1.
I20260709 13:01:26.846154  9095 raft_consensus.cc:3060] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:26.847268  8987 leader_election.cc:304] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:26.848095  9143 raft_consensus.cc:2804] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:26.853992  9095 raft_consensus.cc:2468] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 1.
I20260709 13:01:26.859086  9143 raft_consensus.cc:697] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:26.860126  9143 consensus_queue.cc:237] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:26.861325  9206 consensus_queue.cc:1048] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:26.865871  9140 consensus_queue.cc:1048] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:26.870618  8841 catalog_manager.cc:5697] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 0 to 1, leader changed from <none> to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.887287  9181 consensus_queue.cc:1048] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:26.987114  9193 consensus_queue.cc:1048] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:26.998394  9163 consensus_queue.cc:1048] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:27.069039   431 ts_manager.cc:295] Set tserver state for 3587732b67e04543b5dfa6dcf063c4d9 to MAINTENANCE_MODE
I20260709 13:01:27.070509   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:01:27.076964  9181 consensus_queue.cc:1048] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:27.096411  9181 consensus_queue.cc:1048] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:27.124015  9061 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 224 similar messages]
W20260709 13:01:27.135650  9061 consensus_peers.cc:597] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.138056  9061 consensus_peers.cc:597] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.143074  9163 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:27.163731   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:27.166383   431 tablet_replica.cc:333] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.167287   431 raft_consensus.cc:2243] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.167733   431 raft_consensus.cc:2272] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.171070   431 tablet_replica.cc:333] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.171926   431 raft_consensus.cc:2243] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.172431   431 raft_consensus.cc:2272] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.174474   431 tablet_replica.cc:333] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.175033   431 raft_consensus.cc:2243] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.175433   431 raft_consensus.cc:2272] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.177197   431 tablet_replica.cc:333] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.177819   431 raft_consensus.cc:2243] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.178609   431 raft_consensus.cc:2272] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.181244   431 tablet_replica.cc:333] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.181918   431 raft_consensus.cc:2243] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.182403   431 raft_consensus.cc:2272] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.184749   431 tablet_replica.cc:333] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.185369   431 raft_consensus.cc:2243] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.186280   431 raft_consensus.cc:2272] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.188681   431 tablet_replica.cc:333] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.189478   431 raft_consensus.cc:2243] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.190059   431 raft_consensus.cc:2272] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.192777   431 tablet_replica.cc:333] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.193470   431 raft_consensus.cc:2243] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.194485   431 raft_consensus.cc:2272] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.195694  9193 consensus_queue.cc:1048] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:27.198148   431 tablet_replica.cc:333] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.198921   431 raft_consensus.cc:2243] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.199471   431 raft_consensus.cc:2272] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.203087   431 tablet_replica.cc:333] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: stopping tablet replica
I20260709 13:01:27.203907   431 raft_consensus.cc:2243] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.204425   431 raft_consensus.cc:2272] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.214906  9061 consensus_peers.cc:597] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.240376   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:01:27.244031  9162 consensus_queue.cc:1048] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:27.248898  8987 consensus_peers.cc:597] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.263355  8987 consensus_peers.cc:597] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.290412  9212 consensus_queue.cc:1048] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:27.332830  9061 consensus_peers.cc:597] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.390578  8987 consensus_peers.cc:597] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.507596  9061 consensus_peers.cc:597] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:28.085099  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:28.388053  9142 raft_consensus.cc:493] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3587732b67e04543b5dfa6dcf063c4d9)
I20260709 13:01:28.388725  9142 raft_consensus.cc:515] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:28.390447  9142 leader_election.cc:290] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:28.391173  9231 raft_consensus.cc:493] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3587732b67e04543b5dfa6dcf063c4d9)
I20260709 13:01:28.391765  9020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
I20260709 13:01:28.392472  9231 raft_consensus.cc:515] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:28.393328  9020 raft_consensus.cc:2468] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 1.
W20260709 13:01:28.393399  9061 leader_election.cc:336] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111)
I20260709 13:01:28.394593  9231 leader_election.cc:290] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:28.395498  9058 leader_election.cc:304] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 3587732b67e04543b5dfa6dcf063c4d9
I20260709 13:01:28.396436  9142 raft_consensus.cc:2804] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.397027  9142 raft_consensus.cc:493] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3587732b67e04543b5dfa6dcf063c4d9)
I20260709 13:01:28.397426  9142 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.397348  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
W20260709 13:01:28.399382  8987 leader_election.cc:336] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111)
I20260709 13:01:28.403542  9142 raft_consensus.cc:515] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:28.404734  9094 raft_consensus.cc:2393] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f983a1c60fcd482da04a92c3e89ef73c in current term 2: Already voted for candidate 509818555c354d57b1579f82dcc5d95e in this term.
I20260709 13:01:28.405736  9142 leader_election.cc:290] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:28.406971  9020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:28.407699  9020 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.407555  8987 leader_election.cc:304] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f983a1c60fcd482da04a92c3e89ef73c; no voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e
W20260709 13:01:28.409637  9061 leader_election.cc:336] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111)
I20260709 13:01:28.413028  9020 raft_consensus.cc:2468] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 2.
I20260709 13:01:28.413554  9231 raft_consensus.cc:2749] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.414233  9058 leader_election.cc:304] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 3587732b67e04543b5dfa6dcf063c4d9
I20260709 13:01:28.415159  9142 raft_consensus.cc:2804] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.416105  9142 raft_consensus.cc:697] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:28.417098  9142 consensus_queue.cc:237] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:28.425060  8843 catalog_manager.cc:5697] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 1 to 2, leader changed from 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193) to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.600183  9142 raft_consensus.cc:493] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3587732b67e04543b5dfa6dcf063c4d9)
I20260709 13:01:28.600720  9142 raft_consensus.cc:515] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:28.602782  9142 leader_election.cc:290] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:28.604197  9020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645be290c1c44fca08695ae79d12490" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c" is_pre_election: true
W20260709 13:01:28.606953  9061 leader_election.cc:336] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111)
I20260709 13:01:28.607353  9061 leader_election.cc:304] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e; no voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:28.608139  9142 raft_consensus.cc:2749] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.611855  9231 raft_consensus.cc:493] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3587732b67e04543b5dfa6dcf063c4d9)
I20260709 13:01:28.612478  9231 raft_consensus.cc:515] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:28.614764  9231 leader_election.cc:290] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:28.616528  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645be290c1c44fca08695ae79d12490" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e" is_pre_election: true
I20260709 13:01:28.617271  9094 raft_consensus.cc:2468] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 1.
I20260709 13:01:28.618505  8987 leader_election.cc:304] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
W20260709 13:01:28.619330  8987 leader_election.cc:336] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111)
I20260709 13:01:28.619343  9231 raft_consensus.cc:2804] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.619903  9231 raft_consensus.cc:493] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3587732b67e04543b5dfa6dcf063c4d9)
I20260709 13:01:28.620200  9231 raft_consensus.cc:3060] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.626241  9231 raft_consensus.cc:515] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:28.628310  9231 leader_election.cc:290] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:28.630188  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645be290c1c44fca08695ae79d12490" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:28.630784  9094 raft_consensus.cc:3060] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:28.632489  8987 leader_election.cc:336] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111)
I20260709 13:01:28.638445  9094 raft_consensus.cc:2468] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:28.639801  8987 leader_election.cc:304] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 509818555c354d57b1579f82dcc5d95e, f983a1c60fcd482da04a92c3e89ef73c; no voters: 3587732b67e04543b5dfa6dcf063c4d9
I20260709 13:01:28.640595  9231 raft_consensus.cc:2804] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.641752  9231 raft_consensus.cc:697] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:28.642750  9231 consensus_queue.cc:237] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:28.650540  8843 catalog_manager.cc:5697] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 1 to 2, leader changed from 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:29.024600  9061 consensus_peers.cc:597] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.028833  9020 raft_consensus.cc:1275] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.030143  9142 consensus_queue.cc:1048] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.083223  9094 raft_consensus.cc:1275] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.085382  9231 consensus_queue.cc:1048] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:29.086319  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:01:29.101210  8987 consensus_peers.cc:597] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.676319  8987 consensus_peers.cc:597] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.679025  8987 consensus_peers.cc:597] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.772169  9061 consensus_peers.cc:597] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.830283  9061 consensus_peers.cc:597] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.841091  8987 consensus_peers.cc:597] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.874209  9061 consensus_peers.cc:597] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.926741  9061 consensus_peers.cc:597] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.983225  9061 consensus_peers.cc:597] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:30.087519  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:01:31.088688  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:01:31.259440  9061 consensus_peers.cc:597] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:31.830224  8987 consensus_peers.cc:597] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:31.941385  8987 consensus_peers.cc:597] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:32.089859  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:01:32.153070  9061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111) [suppressed 99 similar messages]
W20260709 13:01:32.156221  9061 consensus_peers.cc:597] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.267669   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:32.275588  9249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:32.277321  9250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:32.277479  9252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:32.280754   431 server_base.cc:1061] running on GCE node
I20260709 13:01:32.281849   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:32.282070   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:32.282279   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602092282262 us; error 0 us; skew 500 ppm
I20260709 13:01:32.282876   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:32.286512   431 webserver.cc:533] Webserver started at http://127.0.107.193:46611/ using document root <none> and password file <none>
I20260709 13:01:32.287114   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:32.287286   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:01:32.291461   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:01:32.296228  9257 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:32.297114   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:01:32.297536   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "3587732b67e04543b5dfa6dcf063c4d9"
format_stamp: "Formatted at 2026-07-09 13:01:25 on dist-test-slave-qv7r"
I20260709 13:01:32.297885   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:01:32.307548  9061 consensus_peers.cc:597] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.317024   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:32.318423   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:32.319911   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:32.323791  9264 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:01:32.360746  8987 consensus_peers.cc:597] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.413949   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:01:32.415053   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.092s	user 0.000s	sys 0.004s
I20260709 13:01:32.415817   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:01:32.434857  9264 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
W20260709 13:01:32.461210  8987 consensus_peers.cc:597] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.463621  9264 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.464867  9264 tablet_bootstrap.cc:492] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.465570  9264 ts_tablet_manager.cc:1403] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.012s
W20260709 13:01:32.468982  9061 consensus_peers.cc:597] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.469770  9264 raft_consensus.cc:359] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.471323  9264 raft_consensus.cc:740] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.472395  9264 consensus_queue.cc:260] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.476305  9264 ts_tablet_manager.cc:1434] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:01:32.477440  9264 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
W20260709 13:01:32.479663  9061 consensus_peers.cc:597] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.498070  9264 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.498952  9264 tablet_bootstrap.cc:492] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.499658  9264 ts_tablet_manager.cc:1403] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 13:01:32.502149  9264 raft_consensus.cc:359] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.502686   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:01:32.502770  9264 raft_consensus.cc:740] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.503093   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.087s	user 0.070s	sys 0.016s
I20260709 13:01:32.503851  9264 consensus_queue.cc:260] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.506304  9264 ts_tablet_manager.cc:1434] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:32.507189  9264 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:32.525303  9264 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.526214  9264 tablet_bootstrap.cc:492] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.526885  9264 ts_tablet_manager.cc:1403] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:01:32.530349  9264 raft_consensus.cc:359] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.531580  9264 raft_consensus.cc:740] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.533192  9264 consensus_queue.cc:260] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.536895  9264 ts_tablet_manager.cc:1434] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:32.538225  9264 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:32.560801  9264 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.561704  9264 tablet_bootstrap.cc:492] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.562258  9264 ts_tablet_manager.cc:1403] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 13:01:32.565351  9264 raft_consensus.cc:359] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:32.566239  9264 raft_consensus.cc:740] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.567179  9264 consensus_queue.cc:260] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:32.569523  9264 ts_tablet_manager.cc:1434] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:01:32.570487  9264 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
W20260709 13:01:32.572525  9061 consensus_peers.cc:597] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:32.587134  9264 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.588017  9264 tablet_bootstrap.cc:492] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.588595  9264 ts_tablet_manager.cc:1403] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:01:32.590879  9264 raft_consensus.cc:359] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.591437  9264 raft_consensus.cc:740] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.592154  9264 consensus_queue.cc:260] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.593600   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37565
I20260709 13:01:32.593878  9264 ts_tablet_manager.cc:1434] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:01:32.593847  9328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37565 every 8 connection(s)
I20260709 13:01:32.595132  9264 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:32.600919   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:32.624584  9264 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.626729  9264 tablet_bootstrap.cc:492] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.629063  9264 ts_tablet_manager.cc:1403] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.005s
I20260709 13:01:32.633354  9264 raft_consensus.cc:359] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.634267  9264 raft_consensus.cc:740] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.634418  9329 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35247
I20260709 13:01:32.635088  9329 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:32.635041  9264 consensus_queue.cc:260] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.636416  9329 heartbeater.cc:507] Master 127.0.107.254:35247 requested a full tablet report, sending...
I20260709 13:01:32.637511  9264 ts_tablet_manager.cc:1434] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:01:32.638501  9264 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:32.645088  8841 ts_manager.cc:194] Re-registered known tserver with Master: 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565)
I20260709 13:01:32.647338  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
mode: GRACEFUL
new_leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:01:32.648221  9095 raft_consensus.cc:606] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Received request to transfer leadership to TS f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:32.661356  8841 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35700
I20260709 13:01:32.662312  9264 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.663424  9264 tablet_bootstrap.cc:492] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.664115  9264 ts_tablet_manager.cc:1403] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.016s
I20260709 13:01:32.665854  9329 heartbeater.cc:499] Master 127.0.107.254:35247 was elected leader, sending a full tablet report...
I20260709 13:01:32.667304  9264 raft_consensus.cc:359] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.668099  9264 raft_consensus.cc:740] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.668891  9264 consensus_queue.cc:260] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.669741  9019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
mode: GRACEFUL
new_leader_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:35944
I20260709 13:01:32.670523  9019 raft_consensus.cc:606] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Received request to transfer leadership to TS 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:32.671411  9264 ts_tablet_manager.cc:1434] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:01:32.672307  9264 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:32.674157  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
mode: GRACEFUL
new_leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:01:32.674855  9095 raft_consensus.cc:606] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Received request to transfer leadership to TS f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:32.676798   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:32.677500   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:32.678362   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:32.686480  9264 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.687443  9264 tablet_bootstrap.cc:492] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.688199  9264 ts_tablet_manager.cc:1403] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:01:32.690307  9264 raft_consensus.cc:359] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.690881  9264 raft_consensus.cc:740] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.691560  9264 consensus_queue.cc:260] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.693863  9264 ts_tablet_manager.cc:1434] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:01:32.694660  9264 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:32.706482  9264 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.707197  9264 tablet_bootstrap.cc:492] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.707767  9264 ts_tablet_manager.cc:1403] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:01:32.709674  9264 raft_consensus.cc:359] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.710196  9264 raft_consensus.cc:740] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.710796  9264 consensus_queue.cc:260] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.712540  9264 ts_tablet_manager.cc:1434] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:32.713539  9264 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap starting.
I20260709 13:01:32.730549  9264 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.732336  9264 tablet_bootstrap.cc:492] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Bootstrap complete.
I20260709 13:01:32.733124  9264 ts_tablet_manager.cc:1403] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.011s
I20260709 13:01:32.736538  9264 raft_consensus.cc:359] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.737835  9264 raft_consensus.cc:740] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3587732b67e04543b5dfa6dcf063c4d9, State: Initialized, Role: FOLLOWER
I20260709 13:01:32.738826  9264 consensus_queue.cc:260] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.741636  9264 ts_tablet_manager.cc:1434] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:01:32.751652  9303 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.780823  9345 raft_consensus.cc:993] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c: : Instructing follower 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:32.781351  9345 raft_consensus.cc:1081] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Signalling peer 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:32.782954  9095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:33768
I20260709 13:01:32.783627  9095 raft_consensus.cc:493] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.783977  9095 raft_consensus.cc:3060] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.790350  9095 raft_consensus.cc:515] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.792189  9095 leader_election.cc:290] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:32.793367  9303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:32.793507  9019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9592647eeae45368d0e6be79d6dae61" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:32.794269  9019 raft_consensus.cc:3055] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.794269  9303 raft_consensus.cc:3060] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.794795  9019 raft_consensus.cc:740] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:32.796043  9019 consensus_queue.cc:260] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.797941  9019 raft_consensus.cc:3060] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.803424  9303 raft_consensus.cc:2468] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 2.
I20260709 13:01:32.805135  9061 leader_election.cc:304] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:32.806114  9266 raft_consensus.cc:2804] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.806644  9266 raft_consensus.cc:697] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:32.807152  9019 raft_consensus.cc:2468] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 2.
I20260709 13:01:32.807951  9266 consensus_queue.cc:237] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:32.816311  8841 catalog_manager.cc:5697] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 1 to 2, leader changed from f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194) to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.843684  9303 raft_consensus.cc:3060] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.992924  9248 raft_consensus.cc:993] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e: : Instructing follower f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:32.993427  9248 raft_consensus.cc:1081] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Signalling peer f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:32.995620  9019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:01:32.996151  9019 raft_consensus.cc:493] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.996899  9019 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.003103  9019 raft_consensus.cc:515] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.004704  9019 leader_election.cc:290] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:33.005707  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:33.005906  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:33.006407  9302 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.006524  9095 raft_consensus.cc:3055] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.007021  9095 raft_consensus.cc:740] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:33.008021  9095 consensus_queue.cc:260] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.009454  9095 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.014127  9302 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:33.015671  8987 leader_election.cc:304] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:33.015789  9095 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:33.016687  9345 raft_consensus.cc:2804] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.017299  9345 raft_consensus.cc:697] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:33.018425  9345 consensus_queue.cc:237] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.026362  8841 catalog_manager.cc:5697] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 1 to 2, leader changed from 509818555c354d57b1579f82dcc5d95e (127.0.107.195) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.050925  9266 raft_consensus.cc:993] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e: : Instructing follower f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:33.051468  9248 raft_consensus.cc:1081] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Signalling peer f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:33.053088  9019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:01:33.053679  9019 raft_consensus.cc:493] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.053987  9019 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.059669  9019 raft_consensus.cc:515] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.061492  9019 leader_election.cc:290] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:33.062266  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:33.062919  9302 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.063313  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:33.063827  9095 raft_consensus.cc:3055] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.064375  9095 raft_consensus.cc:740] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:33.065348  9095 consensus_queue.cc:260] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.066521  9095 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.068547  9302 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:33.069777  8987 leader_election.cc:304] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:33.070600  9345 raft_consensus.cc:2804] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.071147  9345 raft_consensus.cc:697] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:33.072088  9345 consensus_queue.cc:237] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.073841  9095 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:33.080140  8841 catalog_manager.cc:5697] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 1 to 2, leader changed from 509818555c354d57b1579f82dcc5d95e (127.0.107.195) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:33.091171  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:33.273339  9302 raft_consensus.cc:1275] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.275442  9248 consensus_queue.cc:1048] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:33.289983  9019 raft_consensus.cc:1275] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.291400  9358 consensus_queue.cc:1048] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:33.503238  9095 raft_consensus.cc:1275] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.505005  9245 consensus_queue.cc:1048] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:33.516831  9303 raft_consensus.cc:1275] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.519035  9355 consensus_queue.cc:1048] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:33.673908  9303 raft_consensus.cc:1275] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.675354  9095 raft_consensus.cc:1275] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:33.675313  9355 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:33.676800  9355 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:33.689087   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:33.699991  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
mode: GRACEFUL
new_leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:01:33.700625  9095 raft_consensus.cc:606] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Received request to transfer leadership to TS f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:33.703640  9019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
mode: GRACEFUL
new_leader_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:35944
I20260709 13:01:33.704203  9019 raft_consensus.cc:606] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Received request to transfer leadership to TS 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:33.707098  9019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
mode: GRACEFUL
new_leader_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:35944
I20260709 13:01:33.707711  9019 raft_consensus.cc:606] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Received request to transfer leadership to TS 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:33.708845   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:33.709383   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:33.710111   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:33.804428  9345 raft_consensus.cc:993] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c: : Instructing follower 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:33.804973  9355 raft_consensus.cc:1081] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Signalling peer 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:33.806569  9095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:33768
I20260709 13:01:33.807235  9095 raft_consensus.cc:493] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.807629  9095 raft_consensus.cc:3060] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.813321  9095 raft_consensus.cc:515] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.815205  9095 leader_election.cc:290] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:33.816293  9303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:33.816421  9019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a519c8dfbca44734872eb0db854f142d" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:33.817093  9303 raft_consensus.cc:3060] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.817163  9019 raft_consensus.cc:3055] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.817763  9019 raft_consensus.cc:740] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:33.818805  9019 consensus_queue.cc:260] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.820188  9019 raft_consensus.cc:3060] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.824208  9303 raft_consensus.cc:2468] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 2.
I20260709 13:01:33.825343  9061 leader_election.cc:304] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:33.826156  9266 raft_consensus.cc:2804] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.826188  9019 raft_consensus.cc:2468] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 2.
I20260709 13:01:33.826709  9266 raft_consensus.cc:697] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:33.827813  9266 consensus_queue.cc:237] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.835233  8843 catalog_manager.cc:5697] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 1 to 2, leader changed from f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194) to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.906754  9248 raft_consensus.cc:993] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e: : Instructing follower f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:33.907212  9266 raft_consensus.cc:1081] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Signalling peer f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:33.908789  9019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:01:33.909301  9019 raft_consensus.cc:493] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.909593  9019 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.915520  9019 raft_consensus.cc:515] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.917045  9019 leader_election.cc:290] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:33.918008  9303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:33.918288  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:33.918709  9303 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.919001  9095 raft_consensus.cc:3055] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.919353  9095 raft_consensus.cc:740] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:33.920058  9095 consensus_queue.cc:260] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.921317  9095 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.925917  9303 raft_consensus.cc:2468] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:33.927163  8987 leader_election.cc:304] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:33.927435  9095 raft_consensus.cc:2468] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:33.927932  9355 raft_consensus.cc:2804] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.928454  9355 raft_consensus.cc:697] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:33.929325  9355 consensus_queue.cc:237] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:33.936038  8843 catalog_manager.cc:5697] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 1 to 2, leader changed from 509818555c354d57b1579f82dcc5d95e (127.0.107.195) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:34.092460  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:34.131779  9245 raft_consensus.cc:993] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c: : Instructing follower 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:34.132470  9355 raft_consensus.cc:1081] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Signalling peer 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:34.134200  9095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:33768
I20260709 13:01:34.134791  9095 raft_consensus.cc:493] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.135160  9095 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.140221  9095 raft_consensus.cc:515] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:34.141875  9095 leader_election.cc:290] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 3 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:34.142803  9303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:34.142894  9019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:34.143731  9303 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.143731  9019 raft_consensus.cc:3055] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:34.144377  9019 raft_consensus.cc:740] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:34.145219  9019 consensus_queue.cc:260] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:34.146520  9019 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.151435  9303 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 3.
I20260709 13:01:34.152900  9061 leader_election.cc:304] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:34.153456  9019 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 3.
I20260709 13:01:34.153671  9266 raft_consensus.cc:2804] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:34.154275  9266 raft_consensus.cc:697] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:34.155083  9266 consensus_queue.cc:237] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:34.161706  8843 catalog_manager.cc:5697] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 2 to 3, leader changed from f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194) to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:34.284235  9303 raft_consensus.cc:1275] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.285801  9266 consensus_queue.cc:1048] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.296319  9019 raft_consensus.cc:1275] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.298062  9248 consensus_queue.cc:1048] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.333199  9302 raft_consensus.cc:1275] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.334650  9355 consensus_queue.cc:1048] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.343834  9095 raft_consensus.cc:1275] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.346170  9245 consensus_queue.cc:1048] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.686640  9303 raft_consensus.cc:1275] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:34.688634  9266 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:34.698521  9019 raft_consensus.cc:1275] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:34.700380  9378 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:34.716619   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:34.728291  9019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
mode: GRACEFUL
new_leader_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:35944
I20260709 13:01:34.728994  9019 raft_consensus.cc:606] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Received request to transfer leadership to TS 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:34.733469  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91bd10d9eb7d4caea02143569000d5ca"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
mode: GRACEFUL
new_leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:01:34.734041  9095 raft_consensus.cc:606] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Received request to transfer leadership to TS f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:34.739727  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
mode: GRACEFUL
new_leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:01:34.740424  9095 raft_consensus.cc:606] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Received request to transfer leadership to TS f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:34.742143   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:34.743232   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:34.744321   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:34.984905  9378 raft_consensus.cc:993] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e: : Instructing follower f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:34.985550  9248 raft_consensus.cc:1081] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Signalling peer f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:34.987138  9019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91bd10d9eb7d4caea02143569000d5ca"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:01:34.987674  9019 raft_consensus.cc:493] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.987960  9019 raft_consensus.cc:3060] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.993449  9019 raft_consensus.cc:515] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:34.995200  9019 leader_election.cc:290] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:34.996097  9303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bd10d9eb7d4caea02143569000d5ca" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:34.996241  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bd10d9eb7d4caea02143569000d5ca" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:34.996832  9303 raft_consensus.cc:3060] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.997073  9095 raft_consensus.cc:3055] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:34.997455  9095 raft_consensus.cc:740] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:34.998338  9095 consensus_queue.cc:260] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:34.999396  9095 raft_consensus.cc:3060] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.003031  9303 raft_consensus.cc:2468] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:35.004244  8987 leader_election.cc:304] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:35.005084  9095 raft_consensus.cc:2468] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 2.
I20260709 13:01:35.005254  9381 raft_consensus.cc:2804] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:35.006013  9381 raft_consensus.cc:697] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:35.006964  9381 consensus_queue.cc:237] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:35.014963  8841 catalog_manager.cc:5697] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 1 to 2, leader changed from 509818555c354d57b1579f82dcc5d95e (127.0.107.195) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.090471  9266 raft_consensus.cc:993] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e: : Instructing follower f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:35.091018  9248 raft_consensus.cc:1081] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Signalling peer f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:35.092800  9019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:01:35.093463  9019 raft_consensus.cc:493] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:01:35.093623  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:35.093858  9019 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.099512  9019 raft_consensus.cc:515] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:35.101468  9019 leader_election.cc:290] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 4 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:35.102321  9303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:35.102485  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:35.103127  9303 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.103128  9095 raft_consensus.cc:3055] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:35.103775  9095 raft_consensus.cc:740] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:35.104552  9095 consensus_queue.cc:260] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:35.105760  9095 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.111119  9303 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 4.
I20260709 13:01:35.112664  9095 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 4.
I20260709 13:01:35.112679  8987 leader_election.cc:304] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:35.113751  9381 raft_consensus.cc:2804] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:35.114234  9381 raft_consensus.cc:697] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 4 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:35.114897  9381 consensus_queue.cc:237] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:35.121539  8841 catalog_manager.cc:5697] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 3 to 4, leader changed from 509818555c354d57b1579f82dcc5d95e (127.0.107.195) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.173147  9380 raft_consensus.cc:993] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c: : Instructing follower 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:35.173722  9381 raft_consensus.cc:1081] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Signalling peer 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:35.175621  9095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:33768
I20260709 13:01:35.176419  9095 raft_consensus.cc:493] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.176868  9095 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.183194  9095 raft_consensus.cc:515] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:35.185518  9095 leader_election.cc:290] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:35.186462  9303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:35.186671  9019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:35.187212  9303 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.187341  9019 raft_consensus.cc:3055] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.187752  9019 raft_consensus.cc:740] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:35.188462  9019 consensus_queue.cc:260] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:35.189404  9019 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.192843  9303 raft_consensus.cc:2468] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 2.
I20260709 13:01:35.194293  9061 leader_election.cc:304] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:35.195063  9248 raft_consensus.cc:2804] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:35.195063  9019 raft_consensus.cc:2468] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 2.
I20260709 13:01:35.195860  9248 raft_consensus.cc:697] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:35.196921  9248 consensus_queue.cc:237] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:35.206224  8841 catalog_manager.cc:5697] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 1 to 2, leader changed from f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194) to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.457613  9095 raft_consensus.cc:1275] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.459064  9380 consensus_queue.cc:1048] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.470064  9303 raft_consensus.cc:1275] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.471796  9390 consensus_queue.cc:1048] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.532159  9095 raft_consensus.cc:1275] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 4 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:35.534493  9390 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:35.543390  9303 raft_consensus.cc:1275] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 4 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:35.545542  9390 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:35.577067  9303 raft_consensus.cc:1275] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.578544  9248 consensus_queue.cc:1048] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.582348  9019 raft_consensus.cc:1275] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.583719  9266 consensus_queue.cc:1048] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.765725   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:35.773799  9019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
mode: GRACEFUL
new_leader_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:35944
I20260709 13:01:35.774329  9019 raft_consensus.cc:606] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Received request to transfer leadership to TS 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:35.777136  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
mode: GRACEFUL
new_leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:01:35.777995  9095 raft_consensus.cc:606] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Received request to transfer leadership to TS f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:35.781443  9019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
mode: GRACEFUL
new_leader_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:35944
I20260709 13:01:35.782014  9019 raft_consensus.cc:606] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 4 LEADER]: Received request to transfer leadership to TS 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:35.783226   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:35.783771   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:35.784403   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:35.989059  9381 raft_consensus.cc:993] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c: : Instructing follower 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:35.989593  9390 raft_consensus.cc:1081] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Signalling peer 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:35.991161  9095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:33768
I20260709 13:01:35.991729  9095 raft_consensus.cc:493] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.991992  9095 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.996819  9095 raft_consensus.cc:515] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:35.998376  9095 leader_election.cc:290] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 3 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:35.999194  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:35.999547  9019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:36.000029  9302 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.000180  9019 raft_consensus.cc:3055] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.000630  9019 raft_consensus.cc:740] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:36.001241  9019 consensus_queue.cc:260] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.002195  9019 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.005497  9302 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 3.
I20260709 13:01:36.006743  9061 leader_election.cc:304] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:36.007465  9019 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 3.
I20260709 13:01:36.007558  9248 raft_consensus.cc:2804] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.008195  9248 raft_consensus.cc:697] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:36.008915  9248 consensus_queue.cc:237] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.016628  8843 catalog_manager.cc:5697] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 2 to 3, leader changed from f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194) to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:36.094689  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:36.141706  9381 raft_consensus.cc:993] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c: : Instructing follower 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:36.142385  9390 raft_consensus.cc:1081] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 4 LEADER]: Signalling peer 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:36.143891  9095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:33768
I20260709 13:01:36.144299  9095 raft_consensus.cc:493] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.144537  9095 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.149710  9095 raft_consensus.cc:515] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.151224  9095 leader_election.cc:290] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 5 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:36.152143  9019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:36.152143  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04c453b3cb842699d1f408b5c4499f3" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:36.152839  9019 raft_consensus.cc:3055] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:36.153100  9302 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.153187  9019 raft_consensus.cc:740] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:36.154202  9019 consensus_queue.cc:260] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.155539  9019 raft_consensus.cc:3060] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.159394  9302 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 5.
I20260709 13:01:36.160342  9019 raft_consensus.cc:2468] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 5.
I20260709 13:01:36.160620  9061 leader_election.cc:304] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:36.161497  9248 raft_consensus.cc:2804] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:36.162011  9248 raft_consensus.cc:697] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 5 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:36.162834  9248 consensus_queue.cc:237] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.171288  8843 catalog_manager.cc:5697] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 4 to 5, leader changed from f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194) to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 5 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.177104  9396 raft_consensus.cc:993] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e: : Instructing follower f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:36.177619  9248 raft_consensus.cc:1081] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Signalling peer f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:36.179502  9019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:01:36.180155  9019 raft_consensus.cc:493] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.180509  9019 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.185146  9019 raft_consensus.cc:515] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.186574  9019 leader_election.cc:290] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 3 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:36.187541  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:36.187777  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8c0a7d2394400ab07638bae12a8700" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:36.188104  9302 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.188450  9095 raft_consensus.cc:3055] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.188741  9095 raft_consensus.cc:740] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:36.189509  9095 consensus_queue.cc:260] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.190603  9095 raft_consensus.cc:3060] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.193219  9302 raft_consensus.cc:2468] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 3.
I20260709 13:01:36.194499  8987 leader_election.cc:304] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:36.195259  9390 raft_consensus.cc:2804] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.195822  9390 raft_consensus.cc:697] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 3 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:36.195768  9095 raft_consensus.cc:2468] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 3.
I20260709 13:01:36.197237  9390 consensus_queue.cc:237] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.206735  8843 catalog_manager.cc:5697] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 2 to 3, leader changed from 509818555c354d57b1579f82dcc5d95e (127.0.107.195) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.435310  9019 raft_consensus.cc:1275] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:36.436702  9248 consensus_queue.cc:1048] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.448252  9302 raft_consensus.cc:1275] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:36.449980  9248 consensus_queue.cc:1048] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.543718  9019 raft_consensus.cc:1275] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 5 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:36.544893  9248 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:36.553354  9302 raft_consensus.cc:1275] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 5 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:36.554956  9396 consensus_queue.cc:1048] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:36.674024  9302 raft_consensus.cc:1275] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:36.675414  9390 consensus_queue.cc:1048] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:36.684315  9095 raft_consensus.cc:1275] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:36.685950  9390 consensus_queue.cc:1048] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:36.792814   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:36.800585  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
mode: GRACEFUL
new_leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:01:36.801162  9095 raft_consensus.cc:606] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Received request to transfer leadership to TS f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:36.804247  9019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
mode: GRACEFUL
new_leader_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:35944
I20260709 13:01:36.804783  9019 raft_consensus.cc:606] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Received request to transfer leadership to TS 509818555c354d57b1579f82dcc5d95e
I20260709 13:01:36.807554  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
mode: GRACEFUL
new_leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:01:36.808063  9095 raft_consensus.cc:606] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Received request to transfer leadership to TS f983a1c60fcd482da04a92c3e89ef73c
I20260709 13:01:36.809580   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:36.810132   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:36.810750   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:36.835742  9405 raft_consensus.cc:993] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e: : Instructing follower f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:36.836316  9396 raft_consensus.cc:1081] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Signalling peer f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:36.837882  9019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:01:36.838449  9019 raft_consensus.cc:493] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.838719  9019 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.844350  9019 raft_consensus.cc:515] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:36.847589  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:36.848059  9019 leader_election.cc:290] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 3 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:36.848199  9302 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.848991  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726c4ef91e3a4ca18f9ba5401f8c7d55" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:36.850716  9095 raft_consensus.cc:3055] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.851073  9095 raft_consensus.cc:740] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:36.851820  9095 consensus_queue.cc:260] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:36.853030  9095 raft_consensus.cc:3060] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.854580  9302 raft_consensus.cc:2468] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 3.
I20260709 13:01:36.855810  8987 leader_election.cc:304] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:36.856608  9390 raft_consensus.cc:2804] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.857168  9390 raft_consensus.cc:697] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 3 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:36.857977  9390 consensus_queue.cc:237] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } }
I20260709 13:01:36.858510  9095 raft_consensus.cc:2468] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 3.
I20260709 13:01:36.865931  8844 catalog_manager.cc:5697] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 2 to 3, leader changed from 509818555c354d57b1579f82dcc5d95e (127.0.107.195) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.936612  9405 raft_consensus.cc:993] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e: : Instructing follower f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:36.937142  9396 raft_consensus.cc:1081] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Signalling peer f983a1c60fcd482da04a92c3e89ef73c to start an election
I20260709 13:01:36.938661  9019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21"
dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:01:36.939117  9019 raft_consensus.cc:493] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.939394  9019 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.944201  9019 raft_consensus.cc:515] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.945830  9019 leader_election.cc:290] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 4 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), 509818555c354d57b1579f82dcc5d95e (127.0.107.195:35717)
I20260709 13:01:36.946739  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "509818555c354d57b1579f82dcc5d95e"
I20260709 13:01:36.946646  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9a07317ab847189f0a611b2217ae21" candidate_uuid: "f983a1c60fcd482da04a92c3e89ef73c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:36.947497  9095 raft_consensus.cc:3055] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:36.947575  9302 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.947813  9095 raft_consensus.cc:740] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:36.948590  9095 consensus_queue.cc:260] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.949504  9095 raft_consensus.cc:3060] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.952795  9302 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 4.
I20260709 13:01:36.953841  8987 leader_election.cc:304] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, f983a1c60fcd482da04a92c3e89ef73c; no voters: 
I20260709 13:01:36.954025  9095 raft_consensus.cc:2468] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f983a1c60fcd482da04a92c3e89ef73c in term 4.
I20260709 13:01:36.954485  9390 raft_consensus.cc:2804] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:36.954986  9390 raft_consensus.cc:697] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 4 LEADER]: Becoming Leader. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:36.955843  9390 consensus_queue.cc:237] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:36.962496  8844 catalog_manager.cc:5697] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c reported cstate change: term changed from 3 to 4, leader changed from 509818555c354d57b1579f82dcc5d95e (127.0.107.195) to f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f983a1c60fcd482da04a92c3e89ef73c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:37.095742  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:37.242658  9419 raft_consensus.cc:993] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c: : Instructing follower 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:37.243409  9413 raft_consensus.cc:1081] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Signalling peer 509818555c354d57b1579f82dcc5d95e to start an election
I20260709 13:01:37.245199  9095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db"
dest_uuid: "509818555c354d57b1579f82dcc5d95e"
 from {username='slave'} at 127.0.0.1:33768
I20260709 13:01:37.245921  9095 raft_consensus.cc:493] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:37.246203  9095 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.250730  9095 raft_consensus.cc:515] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:37.252430  9095 leader_election.cc:290] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 3 election: Requested vote from peers 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565), f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194:35371)
I20260709 13:01:37.253289  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3587732b67e04543b5dfa6dcf063c4d9"
I20260709 13:01:37.254004  9302 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.253945  9020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7192328be1fb419087548a2b3b9f11db" candidate_uuid: "509818555c354d57b1579f82dcc5d95e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f983a1c60fcd482da04a92c3e89ef73c"
I20260709 13:01:37.254833  9020 raft_consensus.cc:3055] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:37.255173  9020 raft_consensus.cc:740] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f983a1c60fcd482da04a92c3e89ef73c, State: Running, Role: LEADER
I20260709 13:01:37.256033  9020 consensus_queue.cc:260] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:37.257181  9020 raft_consensus.cc:3060] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.261008  9302 raft_consensus.cc:2468] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 3.
I20260709 13:01:37.262332  9061 leader_election.cc:304] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3587732b67e04543b5dfa6dcf063c4d9, 509818555c354d57b1579f82dcc5d95e; no voters: 
I20260709 13:01:37.263229  9020 raft_consensus.cc:2468] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509818555c354d57b1579f82dcc5d95e in term 3.
I20260709 13:01:37.263412  9396 raft_consensus.cc:2804] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:37.264071  9396 raft_consensus.cc:697] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Becoming Leader. State: Replica: 509818555c354d57b1579f82dcc5d95e, State: Running, Role: LEADER
I20260709 13:01:37.264832  9396 consensus_queue.cc:237] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } }
I20260709 13:01:37.272413  8844 catalog_manager.cc:5697] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e reported cstate change: term changed from 2 to 3, leader changed from f983a1c60fcd482da04a92c3e89ef73c (127.0.107.194) to 509818555c354d57b1579f82dcc5d95e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "509818555c354d57b1579f82dcc5d95e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.342036  9302 raft_consensus.cc:1275] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 4 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:37.343282  9413 consensus_queue.cc:1048] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:37.355414  9095 raft_consensus.cc:1275] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 4 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:37.356907  9419 consensus_queue.cc:1048] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:37.396996  9095 raft_consensus.cc:1275] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:37.398532  9419 consensus_queue.cc:1048] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "509818555c354d57b1579f82dcc5d95e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:37.407612  9302 raft_consensus.cc:1275] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Refusing update from remote peer f983a1c60fcd482da04a92c3e89ef73c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:37.410131  9390 consensus_queue.cc:1048] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:37.647863  9302 raft_consensus.cc:1275] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:37.649173  9396 consensus_queue.cc:1048] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3587732b67e04543b5dfa6dcf063c4d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:37.658881  9020 raft_consensus.cc:1275] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Refusing update from remote peer 509818555c354d57b1579f82dcc5d95e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:37.660441  9396 consensus_queue.cc:1048] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f983a1c60fcd482da04a92c3e89ef73c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:37.817621   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:37.843549   431 tablet_server.cc:179] TabletServer@127.0.107.193:37565 shutting down...
I20260709 13:01:37.868660   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:37.869463   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.870164   431 raft_consensus.cc:2243] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.870633   431 raft_consensus.cc:2272] T a519c8dfbca44734872eb0db854f142d P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:37.872433  9061 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:01:37.872946   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.874022   431 raft_consensus.cc:2243] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.874483   431 raft_consensus.cc:2272] T 2c9a07317ab847189f0a611b2217ae21 P 3587732b67e04543b5dfa6dcf063c4d9 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:37.876979  9061 consensus_peers.cc:597] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:37.878993   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.879594   431 raft_consensus.cc:2243] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.880013   431 raft_consensus.cc:2272] T f645be290c1c44fca08695ae79d12490 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.881899   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.882393   431 raft_consensus.cc:2243] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.882751   431 raft_consensus.cc:2272] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.885023   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.885700   431 raft_consensus.cc:2243] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.886101   431 raft_consensus.cc:2272] T 7192328be1fb419087548a2b3b9f11db P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.888253   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.888804   431 raft_consensus.cc:2243] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.889209   431 raft_consensus.cc:2272] T f04c453b3cb842699d1f408b5c4499f3 P 3587732b67e04543b5dfa6dcf063c4d9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.890973   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.891444   431 raft_consensus.cc:2243] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.891841   431 raft_consensus.cc:2272] T 91bd10d9eb7d4caea02143569000d5ca P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.893524   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.894057   431 raft_consensus.cc:2243] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.894364   431 raft_consensus.cc:2272] T 7560d8affdd94282aec2facbf8db1894 P 3587732b67e04543b5dfa6dcf063c4d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.895977   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.896407   431 raft_consensus.cc:2243] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.896756   431 raft_consensus.cc:2272] T b9592647eeae45368d0e6be79d6dae61 P 3587732b67e04543b5dfa6dcf063c4d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.898483   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:37.898903   431 raft_consensus.cc:2243] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.899263   431 raft_consensus.cc:2272] T cf8c0a7d2394400ab07638bae12a8700 P 3587732b67e04543b5dfa6dcf063c4d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.927804   431 tablet_server.cc:196] TabletServer@127.0.107.193:37565 shutdown complete.
I20260709 13:01:37.948745   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:01:37.973456   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:37.974438   431 tablet_replica.cc:333] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:37.975630   431 raft_consensus.cc:2243] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:37.976760   431 raft_consensus.cc:2272] T 2c9a07317ab847189f0a611b2217ae21 P f983a1c60fcd482da04a92c3e89ef73c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.979911   431 tablet_replica.cc:333] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:37.980538   431 raft_consensus.cc:2243] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:37.981297   431 raft_consensus.cc:2272] T f645be290c1c44fca08695ae79d12490 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.983615   431 tablet_replica.cc:333] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:37.984186   431 raft_consensus.cc:2243] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.984622   431 raft_consensus.cc:2272] T a519c8dfbca44734872eb0db854f142d P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.986692   431 tablet_replica.cc:333] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:37.987242   431 raft_consensus.cc:2243] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.987695   431 raft_consensus.cc:2272] T b9592647eeae45368d0e6be79d6dae61 P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.989778   431 tablet_replica.cc:333] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:37.990458   431 raft_consensus.cc:2243] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:37.991420   431 raft_consensus.cc:2272] T cf8c0a7d2394400ab07638bae12a8700 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.994905   431 tablet_replica.cc:333] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:37.995649   431 raft_consensus.cc:2243] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:01:37.996618  9061 consensus_peers.cc:597] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:37.996675   431 raft_consensus.cc:2272] T 91bd10d9eb7d4caea02143569000d5ca P f983a1c60fcd482da04a92c3e89ef73c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:37.997251  9061 consensus_peers.cc:597] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e -> Peer 3587732b67e04543b5dfa6dcf063c4d9 (127.0.107.193:37565): Couldn't send request to peer 3587732b67e04543b5dfa6dcf063c4d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:37.999305   431 tablet_replica.cc:333] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:37.999980   431 raft_consensus.cc:2243] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.000473   431 raft_consensus.cc:2272] T 7560d8affdd94282aec2facbf8db1894 P f983a1c60fcd482da04a92c3e89ef73c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.002755   431 tablet_replica.cc:333] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:38.003365   431 raft_consensus.cc:2243] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.003793   431 raft_consensus.cc:2272] T 7192328be1fb419087548a2b3b9f11db P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.006283   431 tablet_replica.cc:333] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:38.006865   431 raft_consensus.cc:2243] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.007342   431 raft_consensus.cc:2272] T f04c453b3cb842699d1f408b5c4499f3 P f983a1c60fcd482da04a92c3e89ef73c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.009325   431 tablet_replica.cc:333] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c: stopping tablet replica
I20260709 13:01:38.009877   431 raft_consensus.cc:2243] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.010689   431 raft_consensus.cc:2272] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P f983a1c60fcd482da04a92c3e89ef73c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.044381   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:01:38.069785   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:38.096832  8892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:38.107626   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:38.108490   431 tablet_replica.cc:333] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.109176   431 raft_consensus.cc:2243] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.110095   431 raft_consensus.cc:2272] T 7192328be1fb419087548a2b3b9f11db P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.113111   431 tablet_replica.cc:333] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.113797   431 raft_consensus.cc:2243] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.114588   431 raft_consensus.cc:2272] T f04c453b3cb842699d1f408b5c4499f3 P 509818555c354d57b1579f82dcc5d95e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.116736   431 tablet_replica.cc:333] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.117285   431 raft_consensus.cc:2243] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.117841   431 raft_consensus.cc:2272] T 2c9a07317ab847189f0a611b2217ae21 P 509818555c354d57b1579f82dcc5d95e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.120908   431 tablet_replica.cc:333] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.121546   431 raft_consensus.cc:2243] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.122395   431 raft_consensus.cc:2272] T a519c8dfbca44734872eb0db854f142d P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.124410   431 tablet_replica.cc:333] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.124977   431 raft_consensus.cc:2243] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.125458   431 raft_consensus.cc:2272] T f645be290c1c44fca08695ae79d12490 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.127609   431 tablet_replica.cc:333] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.128125   431 raft_consensus.cc:2243] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.128553   431 raft_consensus.cc:2272] T 726c4ef91e3a4ca18f9ba5401f8c7d55 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.131278   431 tablet_replica.cc:333] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.131868   431 raft_consensus.cc:2243] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.132283   431 raft_consensus.cc:2272] T cf8c0a7d2394400ab07638bae12a8700 P 509818555c354d57b1579f82dcc5d95e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.134539   431 tablet_replica.cc:333] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.135207   431 raft_consensus.cc:2243] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.135982   431 raft_consensus.cc:2272] T b9592647eeae45368d0e6be79d6dae61 P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.138226   431 tablet_replica.cc:333] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.138734   431 raft_consensus.cc:2243] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.139146   431 raft_consensus.cc:2272] T 91bd10d9eb7d4caea02143569000d5ca P 509818555c354d57b1579f82dcc5d95e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.141069   431 tablet_replica.cc:333] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e: stopping tablet replica
I20260709 13:01:38.141638   431 raft_consensus.cc:2243] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.142428   431 raft_consensus.cc:2272] T 7560d8affdd94282aec2facbf8db1894 P 509818555c354d57b1579f82dcc5d95e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.176488   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:01:38.201428   431 master.cc:562] Master@127.0.107.254:35247 shutting down...
I20260709 13:01:38.225039   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.225701   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.226058   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 55adef86ad9d4898a4fc2d80e8875fef: stopping tablet replica
I20260709 13:01:38.247037   431 master.cc:584] Master@127.0.107.254:35247 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13386 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:01:38.294826   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37889
I20260709 13:01:38.295953   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:38.302788  9434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:38.302832  9435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:38.303146  9437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:38.304409   431 server_base.cc:1061] running on GCE node
I20260709 13:01:38.305251   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:38.305435   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:38.305547   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602098305537 us; error 0 us; skew 500 ppm
I20260709 13:01:38.306358   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:38.308812   431 webserver.cc:533] Webserver started at http://127.0.107.254:46053/ using document root <none> and password file <none>
I20260709 13:01:38.309259   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:38.309417   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:38.309705   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:38.310829   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/master-0-root/instance:
uuid: "57d69c25b2a1443a87109380546cf810"
format_stamp: "Formatted at 2026-07-09 13:01:38 on dist-test-slave-qv7r"
I20260709 13:01:38.315456   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:38.319078  9442 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.319960   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:01:38.320220   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/master-0-root
uuid: "57d69c25b2a1443a87109380546cf810"
format_stamp: "Formatted at 2026-07-09 13:01:38 on dist-test-slave-qv7r"
I20260709 13:01:38.320468   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:38.346737   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:38.347962   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:38.387310   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37889
I20260709 13:01:38.387440  9493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37889 every 8 connection(s)
I20260709 13:01:38.391167  9494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.402137  9494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810: Bootstrap starting.
I20260709 13:01:38.407021  9494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.411461  9494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810: No bootstrap required, opened a new log
I20260709 13:01:38.413877  9494 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d69c25b2a1443a87109380546cf810" member_type: VOTER }
I20260709 13:01:38.414273  9494 raft_consensus.cc:385] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.414492  9494 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57d69c25b2a1443a87109380546cf810, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.415177  9494 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d69c25b2a1443a87109380546cf810" member_type: VOTER }
I20260709 13:01:38.415632  9494 raft_consensus.cc:399] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:38.415861  9494 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:38.416132  9494 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.420825  9494 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d69c25b2a1443a87109380546cf810" member_type: VOTER }
I20260709 13:01:38.421367  9494 leader_election.cc:304] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57d69c25b2a1443a87109380546cf810; no voters: 
I20260709 13:01:38.422761  9494 leader_election.cc:290] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:38.423295  9497 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.424695  9497 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 1 LEADER]: Becoming Leader. State: Replica: 57d69c25b2a1443a87109380546cf810, State: Running, Role: LEADER
I20260709 13:01:38.425411  9497 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d69c25b2a1443a87109380546cf810" member_type: VOTER }
I20260709 13:01:38.426010  9494 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:38.429879  9498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57d69c25b2a1443a87109380546cf810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d69c25b2a1443a87109380546cf810" member_type: VOTER } }
I20260709 13:01:38.430624  9498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:38.430421  9499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57d69c25b2a1443a87109380546cf810. Latest consensus state: current_term: 1 leader_uuid: "57d69c25b2a1443a87109380546cf810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d69c25b2a1443a87109380546cf810" member_type: VOTER } }
I20260709 13:01:38.431295  9499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:38.433174  9504 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:38.438119  9504 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:38.443213   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:38.447796  9504 catalog_manager.cc:1383] Generated new cluster ID: 9d417a429ff24a8eb844c47098d0925d
I20260709 13:01:38.448057  9504 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:38.467882  9504 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:38.469278  9504 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:38.483882  9504 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810: Generated new TSK 0
I20260709 13:01:38.484500  9504 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:38.512642   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:38.518803  9515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:38.520094  9516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:38.521906  9518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:38.522938   431 server_base.cc:1061] running on GCE node
I20260709 13:01:38.523959   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:38.524143   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:38.524334   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602098524319 us; error 0 us; skew 500 ppm
I20260709 13:01:38.524906   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:38.527515   431 webserver.cc:533] Webserver started at http://127.0.107.193:37781/ using document root <none> and password file <none>
I20260709 13:01:38.528041   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:38.528236   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:38.528537   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:38.530007   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-0-root/instance:
uuid: "5d2ec81d047545d38585451ffb67cf6b"
format_stamp: "Formatted at 2026-07-09 13:01:38 on dist-test-slave-qv7r"
I20260709 13:01:38.535022   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:38.538650  9523 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.539433   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:38.539755   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "5d2ec81d047545d38585451ffb67cf6b"
format_stamp: "Formatted at 2026-07-09 13:01:38 on dist-test-slave-qv7r"
I20260709 13:01:38.540032   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:38.552515   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:38.553766   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:38.555248   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:38.557868   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:38.558109   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.558379   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:38.558552   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.605376   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41063
I20260709 13:01:38.605543  9585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41063 every 8 connection(s)
I20260709 13:01:38.610412   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:38.619325  9590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:38.619738  9591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:38.621587  9593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:38.622697   431 server_base.cc:1061] running on GCE node
I20260709 13:01:38.624094   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:38.624322   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:38.624505   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602098624487 us; error 0 us; skew 500 ppm
I20260709 13:01:38.625090   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:38.625437  9586 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37889
I20260709 13:01:38.626067  9586 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:38.626981  9586 heartbeater.cc:507] Master 127.0.107.254:37889 requested a full tablet report, sending...
I20260709 13:01:38.628041   431 webserver.cc:533] Webserver started at http://127.0.107.194:34891/ using document root <none> and password file <none>
I20260709 13:01:38.628697   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:38.628929   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:38.629199   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:38.629710  9459 ts_manager.cc:194] Registered new tserver with Master: 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063)
I20260709 13:01:38.630483   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-1-root/instance:
uuid: "dcb395c666864aaca31ad4f608627f8a"
format_stamp: "Formatted at 2026-07-09 13:01:38 on dist-test-slave-qv7r"
I20260709 13:01:38.631610  9459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60376
I20260709 13:01:38.635448   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:01:38.639463  9598 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.640388   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:38.640708   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-1-root
uuid: "dcb395c666864aaca31ad4f608627f8a"
format_stamp: "Formatted at 2026-07-09 13:01:38 on dist-test-slave-qv7r"
I20260709 13:01:38.641148   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:38.659437   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:38.660760   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:38.662317   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:38.664546   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:38.664789   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.665038   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:38.665210   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.706862   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39861
I20260709 13:01:38.706977  9660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39861 every 8 connection(s)
I20260709 13:01:38.711709   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:38.720134  9664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:38.721153  9665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:38.723670   431 server_base.cc:1061] running on GCE node
I20260709 13:01:38.724098  9661 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37889
I20260709 13:01:38.724623  9661 heartbeater.cc:461] Registering TS with master...
W20260709 13:01:38.724902  9667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:38.725718  9661 heartbeater.cc:507] Master 127.0.107.254:37889 requested a full tablet report, sending...
I20260709 13:01:38.726375   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:38.726678   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:38.726884   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602098726871 us; error 0 us; skew 500 ppm
I20260709 13:01:38.727921   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:38.728763  9459 ts_manager.cc:194] Registered new tserver with Master: dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861)
I20260709 13:01:38.730466  9459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60382
I20260709 13:01:38.731216   431 webserver.cc:533] Webserver started at http://127.0.107.195:40293/ using document root <none> and password file <none>
I20260709 13:01:38.731967   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:38.732215   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:38.732542   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:38.734033   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-2-root/instance:
uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
format_stamp: "Formatted at 2026-07-09 13:01:38 on dist-test-slave-qv7r"
I20260709 13:01:38.738811   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:38.743069  9672 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.744335   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:01:38.744807   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-2-root
uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
format_stamp: "Formatted at 2026-07-09 13:01:38 on dist-test-slave-qv7r"
I20260709 13:01:38.745265   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601802742860-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:38.769861   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:38.771127   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:38.772646   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:38.775132   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:38.775384   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.775628   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:38.775799   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:38.822273   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41973
I20260709 13:01:38.822402  9734 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41973 every 8 connection(s)
I20260709 13:01:38.838505  9735 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37889
I20260709 13:01:38.838953  9735 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:38.839732  9735 heartbeater.cc:507] Master 127.0.107.254:37889 requested a full tablet report, sending...
I20260709 13:01:38.841928  9459 ts_manager.cc:194] Registered new tserver with Master: d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195:41973)
I20260709 13:01:38.842934   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016547069s
I20260709 13:01:38.843655  9459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60384
I20260709 13:01:38.870939  9459 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60386:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:38.873232  9459 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:38.928813  9700 tablet_service.cc:1511] Processing CreateTablet for tablet e66ca7ef205944808e8c4204bb0828eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c7948324b76d4d8bb9a173372306580e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:38.930347  9700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66ca7ef205944808e8c4204bb0828eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.932471  9699 tablet_service.cc:1511] Processing CreateTablet for tablet 1cec583f47914055bfb6915e829af47b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c7948324b76d4d8bb9a173372306580e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:38.934008  9699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cec583f47914055bfb6915e829af47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.951311  9626 tablet_service.cc:1511] Processing CreateTablet for tablet e66ca7ef205944808e8c4204bb0828eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c7948324b76d4d8bb9a173372306580e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:38.953102  9626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66ca7ef205944808e8c4204bb0828eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.954733  9750 tablet_bootstrap.cc:492] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd: Bootstrap starting.
I20260709 13:01:38.956591  9625 tablet_service.cc:1511] Processing CreateTablet for tablet 1cec583f47914055bfb6915e829af47b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c7948324b76d4d8bb9a173372306580e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:38.957981  9625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cec583f47914055bfb6915e829af47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.961441  9750 tablet_bootstrap.cc:654] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.967092  9550 tablet_service.cc:1511] Processing CreateTablet for tablet 1cec583f47914055bfb6915e829af47b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c7948324b76d4d8bb9a173372306580e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:38.968566  9550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cec583f47914055bfb6915e829af47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.968880  9750 tablet_bootstrap.cc:492] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd: No bootstrap required, opened a new log
I20260709 13:01:38.969453  9750 ts_tablet_manager.cc:1403] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:01:38.967092  9551 tablet_service.cc:1511] Processing CreateTablet for tablet e66ca7ef205944808e8c4204bb0828eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c7948324b76d4d8bb9a173372306580e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:38.971058  9551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66ca7ef205944808e8c4204bb0828eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.972905  9750 raft_consensus.cc:359] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:38.973853  9750 raft_consensus.cc:385] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.974216  9750 raft_consensus.cc:740] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.975139  9750 consensus_queue.cc:260] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:38.980468  9735 heartbeater.cc:499] Master 127.0.107.254:37889 was elected leader, sending a full tablet report...
I20260709 13:01:38.981012  9752 tablet_bootstrap.cc:492] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a: Bootstrap starting.
I20260709 13:01:38.987469  9752 tablet_bootstrap.cc:654] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.989298  9750 ts_tablet_manager.cc:1434] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:01:38.990500  9750 tablet_bootstrap.cc:492] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd: Bootstrap starting.
I20260709 13:01:38.997833  9750 tablet_bootstrap.cc:654] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.999392  9752 tablet_bootstrap.cc:492] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a: No bootstrap required, opened a new log
I20260709 13:01:39.000276  9752 ts_tablet_manager.cc:1403] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:01:39.004889  9752 raft_consensus.cc:359] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:39.006001  9752 raft_consensus.cc:385] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.006374  9752 raft_consensus.cc:740] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcb395c666864aaca31ad4f608627f8a, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.006769  9755 tablet_bootstrap.cc:492] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b: Bootstrap starting.
I20260709 13:01:39.007390  9752 consensus_queue.cc:260] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:39.010788  9661 heartbeater.cc:499] Master 127.0.107.254:37889 was elected leader, sending a full tablet report...
I20260709 13:01:39.011911  9752 ts_tablet_manager.cc:1434] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:01:39.012099  9750 tablet_bootstrap.cc:492] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd: No bootstrap required, opened a new log
I20260709 13:01:39.012768  9750 ts_tablet_manager.cc:1403] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.016s
I20260709 13:01:39.012992  9752 tablet_bootstrap.cc:492] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a: Bootstrap starting.
I20260709 13:01:39.015187  9755 tablet_bootstrap.cc:654] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.016359  9750 raft_consensus.cc:359] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.017256  9750 raft_consensus.cc:385] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.017762  9750 raft_consensus.cc:740] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.018922  9750 consensus_queue.cc:260] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.020628  9752 tablet_bootstrap.cc:654] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.022611  9750 ts_tablet_manager.cc:1434] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:01:39.027338  9752 tablet_bootstrap.cc:492] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a: No bootstrap required, opened a new log
I20260709 13:01:39.027343  9755 tablet_bootstrap.cc:492] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b: No bootstrap required, opened a new log
I20260709 13:01:39.028216  9752 ts_tablet_manager.cc:1403] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:01:39.028571  9755 ts_tablet_manager.cc:1403] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 13:01:39.031299  9752 raft_consensus.cc:359] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.032007  9752 raft_consensus.cc:385] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.032327  9752 raft_consensus.cc:740] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcb395c666864aaca31ad4f608627f8a, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.031838  9755 raft_consensus.cc:359] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.032744  9755 raft_consensus.cc:385] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.033274  9755 raft_consensus.cc:740] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d2ec81d047545d38585451ffb67cf6b, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.033116  9752 consensus_queue.cc:260] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.034163  9755 consensus_queue.cc:260] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.035274  9752 ts_tablet_manager.cc:1434] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:39.041990  9586 heartbeater.cc:499] Master 127.0.107.254:37889 was elected leader, sending a full tablet report...
I20260709 13:01:39.042477  9755 ts_tablet_manager.cc:1434] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:01:39.043627  9755 tablet_bootstrap.cc:492] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b: Bootstrap starting.
I20260709 13:01:39.050275  9755 tablet_bootstrap.cc:654] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.058142  9755 tablet_bootstrap.cc:492] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b: No bootstrap required, opened a new log
I20260709 13:01:39.058537  9755 ts_tablet_manager.cc:1403] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:01:39.060675  9755 raft_consensus.cc:359] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:39.061210  9755 raft_consensus.cc:385] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.061439  9755 raft_consensus.cc:740] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d2ec81d047545d38585451ffb67cf6b, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.062093  9755 consensus_queue.cc:260] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:39.063963  9755 ts_tablet_manager.cc:1434] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:39.115798  9753 raft_consensus.cc:493] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.116564  9753 raft_consensus.cc:515] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:39.118760  9753 leader_election.cc:290] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861), 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063)
I20260709 13:01:39.127903  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66ca7ef205944808e8c4204bb0828eb" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb395c666864aaca31ad4f608627f8a" is_pre_election: true
I20260709 13:01:39.128729  9636 raft_consensus.cc:2468] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 0.
I20260709 13:01:39.130074  9673 leader_election.cc:304] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3a0ac0bb651413bbb08fe9210a1f8cd, dcb395c666864aaca31ad4f608627f8a; no voters: 
I20260709 13:01:39.130805  9753 raft_consensus.cc:2804] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.130851  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66ca7ef205944808e8c4204bb0828eb" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d2ec81d047545d38585451ffb67cf6b" is_pre_election: true
I20260709 13:01:39.131146  9753 raft_consensus.cc:493] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.131595  9561 raft_consensus.cc:2468] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 0.
I20260709 13:01:39.131608  9753 raft_consensus.cc:3060] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.137645  9753 raft_consensus.cc:515] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:39.139417  9753 leader_election.cc:290] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 election: Requested vote from peers dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861), 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063)
I20260709 13:01:39.140276  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66ca7ef205944808e8c4204bb0828eb" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb395c666864aaca31ad4f608627f8a"
I20260709 13:01:39.140463  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66ca7ef205944808e8c4204bb0828eb" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d2ec81d047545d38585451ffb67cf6b"
I20260709 13:01:39.140952  9636 raft_consensus.cc:3060] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.140960  9561 raft_consensus.cc:3060] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.148814  9561 raft_consensus.cc:2468] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 1.
I20260709 13:01:39.148814  9636 raft_consensus.cc:2468] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 1.
I20260709 13:01:39.150161  9673 leader_election.cc:304] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, d3a0ac0bb651413bbb08fe9210a1f8cd; no voters: 
I20260709 13:01:39.150804  9753 raft_consensus.cc:2804] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.151840  9753 raft_consensus.cc:697] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Becoming Leader. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Running, Role: LEADER
I20260709 13:01:39.152532  9753 consensus_queue.cc:237] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:39.160656  9458 catalog_manager.cc:5697] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd reported cstate change: term changed from 0 to 1, leader changed from <none> to d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.183007  9757 raft_consensus.cc:493] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.183753  9757 raft_consensus.cc:515] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.187047  9757 leader_election.cc:290] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063), d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195:41973)
I20260709 13:01:39.190562  9753 raft_consensus.cc:493] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.191206  9753 raft_consensus.cc:515] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.194196  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cec583f47914055bfb6915e829af47b" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d2ec81d047545d38585451ffb67cf6b" is_pre_election: true
I20260709 13:01:39.194763  9753 leader_election.cc:290] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063), dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861)
I20260709 13:01:39.194900  9561 raft_consensus.cc:2468] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 0.
I20260709 13:01:39.195742  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cec583f47914055bfb6915e829af47b" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb395c666864aaca31ad4f608627f8a" is_pre_election: true
I20260709 13:01:39.196483  9636 raft_consensus.cc:2468] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 0.
I20260709 13:01:39.196641  9673 leader_election.cc:304] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, d3a0ac0bb651413bbb08fe9210a1f8cd; no voters: 
I20260709 13:01:39.197713  9753 raft_consensus.cc:2804] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.198138  9753 raft_consensus.cc:493] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.198530  9753 raft_consensus.cc:3060] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.199331  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cec583f47914055bfb6915e829af47b" candidate_uuid: "dcb395c666864aaca31ad4f608627f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d2ec81d047545d38585451ffb67cf6b" is_pre_election: true
I20260709 13:01:39.200805  9561 raft_consensus.cc:2468] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcb395c666864aaca31ad4f608627f8a in term 0.
I20260709 13:01:39.200908  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cec583f47914055bfb6915e829af47b" candidate_uuid: "dcb395c666864aaca31ad4f608627f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" is_pre_election: true
I20260709 13:01:39.201982  9599 leader_election.cc:304] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, dcb395c666864aaca31ad4f608627f8a; no voters: 
I20260709 13:01:39.202747  9757 raft_consensus.cc:2804] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.203194  9757 raft_consensus.cc:493] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.203522  9757 raft_consensus.cc:3060] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.205969  9753 raft_consensus.cc:515] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.207317  9710 raft_consensus.cc:2393] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcb395c666864aaca31ad4f608627f8a in current term 1: Already voted for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in this term.
I20260709 13:01:39.208331  9753 leader_election.cc:290] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 election: Requested vote from peers 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063), dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861)
I20260709 13:01:39.209774  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cec583f47914055bfb6915e829af47b" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb395c666864aaca31ad4f608627f8a"
I20260709 13:01:39.209996  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cec583f47914055bfb6915e829af47b" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d2ec81d047545d38585451ffb67cf6b"
I20260709 13:01:39.210826  9561 raft_consensus.cc:3060] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.211540  9757 raft_consensus.cc:515] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.212741  9636 raft_consensus.cc:2393] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3a0ac0bb651413bbb08fe9210a1f8cd in current term 1: Already voted for candidate dcb395c666864aaca31ad4f608627f8a in this term.
I20260709 13:01:39.213824  9757 leader_election.cc:290] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [CANDIDATE]: Term 1 election: Requested vote from peers 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063), d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195:41973)
I20260709 13:01:39.215065  9560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cec583f47914055bfb6915e829af47b" candidate_uuid: "dcb395c666864aaca31ad4f608627f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d2ec81d047545d38585451ffb67cf6b"
I20260709 13:01:39.216113  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cec583f47914055bfb6915e829af47b" candidate_uuid: "dcb395c666864aaca31ad4f608627f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
I20260709 13:01:39.217059  9710 raft_consensus.cc:2393] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dcb395c666864aaca31ad4f608627f8a in current term 1: Already voted for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in this term.
I20260709 13:01:39.218571  9561 raft_consensus.cc:2468] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 1.
I20260709 13:01:39.218586  9602 leader_election.cc:304] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcb395c666864aaca31ad4f608627f8a; no voters: 5d2ec81d047545d38585451ffb67cf6b, d3a0ac0bb651413bbb08fe9210a1f8cd
I20260709 13:01:39.219805  9757 raft_consensus.cc:2749] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.219973  9673 leader_election.cc:304] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, d3a0ac0bb651413bbb08fe9210a1f8cd; no voters: dcb395c666864aaca31ad4f608627f8a
I20260709 13:01:39.220854  9753 raft_consensus.cc:2804] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.221298  9753 raft_consensus.cc:697] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Becoming Leader. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Running, Role: LEADER
I20260709 13:01:39.222028  9753 consensus_queue.cc:237] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.229753  9458 catalog_manager.cc:5697] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd reported cstate change: term changed from 0 to 1, leader changed from <none> to d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.271662  9458 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60388:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:39.273761  9458 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:39.299489  9551 tablet_service.cc:1511] Processing CreateTablet for tablet 74f1ceef37c24125a858c571699156ff (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0e30219fe17f4a33ae991bf7eabb2d09]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:39.300868  9551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f1ceef37c24125a858c571699156ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:39.300602  9625 tablet_service.cc:1511] Processing CreateTablet for tablet 74f1ceef37c24125a858c571699156ff (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0e30219fe17f4a33ae991bf7eabb2d09]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:39.301901  9625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f1ceef37c24125a858c571699156ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:39.301949  9700 tablet_service.cc:1511] Processing CreateTablet for tablet 74f1ceef37c24125a858c571699156ff (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0e30219fe17f4a33ae991bf7eabb2d09]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:39.303233  9700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f1ceef37c24125a858c571699156ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:39.307385  9699 tablet_service.cc:1511] Processing CreateTablet for tablet 0d691686b63647e087e621ce8242ae4d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0e30219fe17f4a33ae991bf7eabb2d09]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:39.307765  9550 tablet_service.cc:1511] Processing CreateTablet for tablet 0d691686b63647e087e621ce8242ae4d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0e30219fe17f4a33ae991bf7eabb2d09]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:39.308871  9699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d691686b63647e087e621ce8242ae4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:39.309031  9550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d691686b63647e087e621ce8242ae4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:39.313414  9626 tablet_service.cc:1511] Processing CreateTablet for tablet 0d691686b63647e087e621ce8242ae4d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0e30219fe17f4a33ae991bf7eabb2d09]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:39.314814  9626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d691686b63647e087e621ce8242ae4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:39.318235  9755 tablet_bootstrap.cc:492] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b: Bootstrap starting.
I20260709 13:01:39.319095  9752 tablet_bootstrap.cc:492] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a: Bootstrap starting.
I20260709 13:01:39.325790  9752 tablet_bootstrap.cc:654] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.327548  9755 tablet_bootstrap.cc:654] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.329227  9750 tablet_bootstrap.cc:492] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd: Bootstrap starting.
I20260709 13:01:39.338491  9750 tablet_bootstrap.cc:654] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.339432  9752 tablet_bootstrap.cc:492] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a: No bootstrap required, opened a new log
I20260709 13:01:39.340039  9752 ts_tablet_manager.cc:1403] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.015s
I20260709 13:01:39.343746  9752 raft_consensus.cc:359] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.344636  9752 raft_consensus.cc:385] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.345005  9752 raft_consensus.cc:740] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcb395c666864aaca31ad4f608627f8a, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.346042  9752 consensus_queue.cc:260] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.348125  9755 tablet_bootstrap.cc:492] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b: No bootstrap required, opened a new log
I20260709 13:01:39.348982  9755 ts_tablet_manager.cc:1403] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.014s
I20260709 13:01:39.349119  9752 ts_tablet_manager.cc:1434] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:01:39.354182  9755 raft_consensus.cc:359] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.355717  9755 raft_consensus.cc:385] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.356149  9755 raft_consensus.cc:740] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d2ec81d047545d38585451ffb67cf6b, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.357158  9755 consensus_queue.cc:260] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.366840  9755 ts_tablet_manager.cc:1434] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 13:01:39.371871  9750 tablet_bootstrap.cc:492] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd: No bootstrap required, opened a new log
I20260709 13:01:39.372537  9750 ts_tablet_manager.cc:1403] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.014s
I20260709 13:01:39.376641  9750 raft_consensus.cc:359] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.377172  9752 tablet_bootstrap.cc:492] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a: Bootstrap starting.
I20260709 13:01:39.377398  9750 raft_consensus.cc:385] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.377871  9750 raft_consensus.cc:740] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.377482  9755 tablet_bootstrap.cc:492] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b: Bootstrap starting.
I20260709 13:01:39.378849  9750 consensus_queue.cc:260] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.381111  9750 ts_tablet_manager.cc:1434] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:39.382210  9750 tablet_bootstrap.cc:492] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd: Bootstrap starting.
I20260709 13:01:39.384876  9752 tablet_bootstrap.cc:654] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.385015  9755 tablet_bootstrap.cc:654] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.388849  9750 tablet_bootstrap.cc:654] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.397866  9752 tablet_bootstrap.cc:492] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a: No bootstrap required, opened a new log
I20260709 13:01:39.398319  9755 tablet_bootstrap.cc:492] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b: No bootstrap required, opened a new log
I20260709 13:01:39.398409  9752 ts_tablet_manager.cc:1403] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 13:01:39.398919  9755 ts_tablet_manager.cc:1403] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.012s
I20260709 13:01:39.399753  9750 tablet_bootstrap.cc:492] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd: No bootstrap required, opened a new log
I20260709 13:01:39.400346  9750 ts_tablet_manager.cc:1403] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:01:39.401966  9753 raft_consensus.cc:493] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.402072  9752 raft_consensus.cc:359] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.402595  9753 raft_consensus.cc:515] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.402961  9752 raft_consensus.cc:385] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.403096  9755 raft_consensus.cc:359] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.403491  9752 raft_consensus.cc:740] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcb395c666864aaca31ad4f608627f8a, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.403877  9755 raft_consensus.cc:385] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.404241  9755 raft_consensus.cc:740] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d2ec81d047545d38585451ffb67cf6b, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.404024  9750 raft_consensus.cc:359] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.408080  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d691686b63647e087e621ce8242ae4d" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb395c666864aaca31ad4f608627f8a" is_pre_election: true
I20260709 13:01:39.405119  9755 consensus_queue.cc:260] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.404668  9752 consensus_queue.cc:260] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.404868  9750 raft_consensus.cc:385] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.415089  9750 raft_consensus.cc:740] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.415863  9755 ts_tablet_manager.cc:1434] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.006s
I20260709 13:01:39.415920  9750 consensus_queue.cc:260] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.417378  9752 ts_tablet_manager.cc:1434] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a: Time spent starting tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:01:39.404793  9753 leader_election.cc:290] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063), dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861)
I20260709 13:01:39.407500  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d691686b63647e087e621ce8242ae4d" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d2ec81d047545d38585451ffb67cf6b" is_pre_election: true
I20260709 13:01:39.418403  9561 raft_consensus.cc:2468] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 0.
I20260709 13:01:39.418902  9750 ts_tablet_manager.cc:1434] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:01:39.419251  9636 raft_consensus.cc:2468] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 0.
I20260709 13:01:39.420095  9673 leader_election.cc:304] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, d3a0ac0bb651413bbb08fe9210a1f8cd; no voters: 
I20260709 13:01:39.421018  9763 raft_consensus.cc:2804] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.421388  9763 raft_consensus.cc:493] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.421763  9763 raft_consensus.cc:3060] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.430720  9763 raft_consensus.cc:515] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.434476  9763 leader_election.cc:290] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 election: Requested vote from peers 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063), dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861)
I20260709 13:01:39.435084  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d691686b63647e087e621ce8242ae4d" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d2ec81d047545d38585451ffb67cf6b"
I20260709 13:01:39.436296  9561 raft_consensus.cc:3060] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.436591  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d691686b63647e087e621ce8242ae4d" candidate_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb395c666864aaca31ad4f608627f8a"
I20260709 13:01:39.437248  9636 raft_consensus.cc:3060] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:39.437809  9507 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:39.444923  9561 raft_consensus.cc:2468] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 1.
I20260709 13:01:39.445816  9636 raft_consensus.cc:2468] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a0ac0bb651413bbb08fe9210a1f8cd in term 1.
I20260709 13:01:39.446755  9673 leader_election.cc:304] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, d3a0ac0bb651413bbb08fe9210a1f8cd; no voters: 
I20260709 13:01:39.447549  9763 raft_consensus.cc:2804] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.448062  9763 raft_consensus.cc:697] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Becoming Leader. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Running, Role: LEADER
I20260709 13:01:39.448808  9763 consensus_queue.cc:237] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.457801  9458 catalog_manager.cc:5697] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd reported cstate change: term changed from 0 to 1, leader changed from <none> to d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.571296  9763 consensus_queue.cc:1048] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.574755  9760 raft_consensus.cc:493] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.575438  9760 raft_consensus.cc:515] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.594244  9760 leader_election.cc:290] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861), d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195:41973)
I20260709 13:01:39.594725  9763 consensus_queue.cc:1048] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.601960  9635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f1ceef37c24125a858c571699156ff" candidate_uuid: "5d2ec81d047545d38585451ffb67cf6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb395c666864aaca31ad4f608627f8a" is_pre_election: true
I20260709 13:01:39.602808  9635 raft_consensus.cc:2468] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d2ec81d047545d38585451ffb67cf6b in term 0.
I20260709 13:01:39.604254  9524 leader_election.cc:304] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, dcb395c666864aaca31ad4f608627f8a; no voters: 
I20260709 13:01:39.606563  9760 raft_consensus.cc:2804] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.607161  9760 raft_consensus.cc:493] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.607656  9760 raft_consensus.cc:3060] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.620877  9760 raft_consensus.cc:515] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.621198  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f1ceef37c24125a858c571699156ff" candidate_uuid: "5d2ec81d047545d38585451ffb67cf6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" is_pre_election: true
I20260709 13:01:39.622001  9710 raft_consensus.cc:2468] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d2ec81d047545d38585451ffb67cf6b in term 0.
I20260709 13:01:39.623263  9760 leader_election.cc:290] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [CANDIDATE]: Term 1 election: Requested vote from peers dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861), d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195:41973)
I20260709 13:01:39.624125  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f1ceef37c24125a858c571699156ff" candidate_uuid: "5d2ec81d047545d38585451ffb67cf6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb395c666864aaca31ad4f608627f8a"
I20260709 13:01:39.624266  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f1ceef37c24125a858c571699156ff" candidate_uuid: "5d2ec81d047545d38585451ffb67cf6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
I20260709 13:01:39.624796  9636 raft_consensus.cc:3060] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.624908  9710 raft_consensus.cc:3060] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.628386  9783 consensus_queue.cc:1048] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.634533  9710 raft_consensus.cc:2468] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d2ec81d047545d38585451ffb67cf6b in term 1.
I20260709 13:01:39.636315  9527 leader_election.cc:304] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, d3a0ac0bb651413bbb08fe9210a1f8cd; no voters: 
I20260709 13:01:39.636565  9636 raft_consensus.cc:2468] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d2ec81d047545d38585451ffb67cf6b in term 1.
I20260709 13:01:39.637388  9760 raft_consensus.cc:2804] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.638247  9760 raft_consensus.cc:697] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 1 LEADER]: Becoming Leader. State: Replica: 5d2ec81d047545d38585451ffb67cf6b, State: Running, Role: LEADER
I20260709 13:01:39.639137  9760 consensus_queue.cc:237] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.646842  9763 consensus_queue.cc:1048] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.651574  9459 catalog_manager.cc:5697] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5d2ec81d047545d38585451ffb67cf6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.707028  9710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66ca7ef205944808e8c4204bb0828eb"
dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
mode: GRACEFUL
new_leader_uuid: "5d2ec81d047545d38585451ffb67cf6b"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:01:39.707835  9710 raft_consensus.cc:606] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Received request to transfer leadership to TS 5d2ec81d047545d38585451ffb67cf6b
I20260709 13:01:39.722761  9710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d691686b63647e087e621ce8242ae4d"
dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
mode: GRACEFUL
new_leader_uuid: "5d2ec81d047545d38585451ffb67cf6b"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:01:39.723409  9710 raft_consensus.cc:606] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Received request to transfer leadership to TS 5d2ec81d047545d38585451ffb67cf6b
I20260709 13:01:39.886615  9763 consensus_queue.cc:1048] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.894412  9753 raft_consensus.cc:993] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd: : Instructing follower 5d2ec81d047545d38585451ffb67cf6b to start an election
I20260709 13:01:39.894955  9783 raft_consensus.cc:1081] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Signalling peer 5d2ec81d047545d38585451ffb67cf6b to start an election
I20260709 13:01:39.896701  9560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d691686b63647e087e621ce8242ae4d"
dest_uuid: "5d2ec81d047545d38585451ffb67cf6b"
 from {username='slave'} at 127.0.0.1:52964
I20260709 13:01:39.900117  9783 consensus_queue.cc:1048] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.900673  9560 raft_consensus.cc:493] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.901113  9560 raft_consensus.cc:3060] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.908053  9560 raft_consensus.cc:515] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.914409  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d691686b63647e087e621ce8242ae4d" candidate_uuid: "5d2ec81d047545d38585451ffb67cf6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
I20260709 13:01:39.915114  9710 raft_consensus.cc:3055] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.915509  9710 raft_consensus.cc:740] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Running, Role: LEADER
I20260709 13:01:39.916417  9710 consensus_queue.cc:260] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.917778  9710 raft_consensus.cc:3060] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.918829  9560 leader_election.cc:290] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [CANDIDATE]: Term 2 election: Requested vote from peers dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861), d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195:41973)
I20260709 13:01:39.920377  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d691686b63647e087e621ce8242ae4d" candidate_uuid: "5d2ec81d047545d38585451ffb67cf6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcb395c666864aaca31ad4f608627f8a"
I20260709 13:01:39.921128  9636 raft_consensus.cc:3060] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.924633  9710 raft_consensus.cc:2468] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d2ec81d047545d38585451ffb67cf6b in term 2.
I20260709 13:01:39.925812  9527 leader_election.cc:304] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, d3a0ac0bb651413bbb08fe9210a1f8cd; no voters: 
I20260709 13:01:39.926577  9760 raft_consensus.cc:2804] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.926996  9760 raft_consensus.cc:697] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 2 LEADER]: Becoming Leader. State: Replica: 5d2ec81d047545d38585451ffb67cf6b, State: Running, Role: LEADER
I20260709 13:01:39.927397  9636 raft_consensus.cc:2468] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d2ec81d047545d38585451ffb67cf6b in term 2.
I20260709 13:01:39.927778  9760 consensus_queue.cc:237] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:39.934846  9457 catalog_manager.cc:5697] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b reported cstate change: term changed from 1 to 2, leader changed from d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195) to 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5d2ec81d047545d38585451ffb67cf6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.029488  9763 raft_consensus.cc:993] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd: : Instructing follower 5d2ec81d047545d38585451ffb67cf6b to start an election
I20260709 13:01:40.030014  9783 raft_consensus.cc:1081] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Signalling peer 5d2ec81d047545d38585451ffb67cf6b to start an election
I20260709 13:01:40.031540  9560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e66ca7ef205944808e8c4204bb0828eb"
dest_uuid: "5d2ec81d047545d38585451ffb67cf6b"
 from {username='slave'} at 127.0.0.1:52964
I20260709 13:01:40.032073  9560 raft_consensus.cc:493] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.032517  9560 raft_consensus.cc:3060] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.039186  9560 raft_consensus.cc:515] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:40.041244  9560 leader_election.cc:290] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [CANDIDATE]: Term 2 election: Requested vote from peers d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195:41973), dcb395c666864aaca31ad4f608627f8a (127.0.107.194:39861)
I20260709 13:01:40.042174  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66ca7ef205944808e8c4204bb0828eb" candidate_uuid: "5d2ec81d047545d38585451ffb67cf6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
I20260709 13:01:40.042447  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66ca7ef205944808e8c4204bb0828eb" candidate_uuid: "5d2ec81d047545d38585451ffb67cf6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcb395c666864aaca31ad4f608627f8a"
I20260709 13:01:40.042891  9710 raft_consensus.cc:3055] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.043111  9636 raft_consensus.cc:3060] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.043385  9710 raft_consensus.cc:740] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3a0ac0bb651413bbb08fe9210a1f8cd, State: Running, Role: LEADER
I20260709 13:01:40.044358  9710 consensus_queue.cc:260] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:40.045318  9710 raft_consensus.cc:3060] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.048755  9636 raft_consensus.cc:2468] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d2ec81d047545d38585451ffb67cf6b in term 2.
I20260709 13:01:40.049961  9524 leader_election.cc:304] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d2ec81d047545d38585451ffb67cf6b, dcb395c666864aaca31ad4f608627f8a; no voters: 
I20260709 13:01:40.050935  9760 raft_consensus.cc:2804] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.051021  9710 raft_consensus.cc:2468] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d2ec81d047545d38585451ffb67cf6b in term 2.
I20260709 13:01:40.051430  9760 raft_consensus.cc:697] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 2 LEADER]: Becoming Leader. State: Replica: 5d2ec81d047545d38585451ffb67cf6b, State: Running, Role: LEADER
I20260709 13:01:40.052364  9760 consensus_queue.cc:237] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } }
I20260709 13:01:40.059129  9457 catalog_manager.cc:5697] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b reported cstate change: term changed from 1 to 2, leader changed from d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195) to 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5d2ec81d047545d38585451ffb67cf6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.081875  9760 consensus_queue.cc:1048] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.095089  9760 consensus_queue.cc:1048] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.188689   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:01:40.190346   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:01:40.190753   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:01:40.203307  9560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74f1ceef37c24125a858c571699156ff"
dest_uuid: "5d2ec81d047545d38585451ffb67cf6b"
mode: GRACEFUL
new_leader_uuid: "dcb395c666864aaca31ad4f608627f8a"
 from {username='slave'} at 127.0.0.1:52978
I20260709 13:01:40.203806  9560 raft_consensus.cc:606] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 1 LEADER]: Received request to transfer leadership to TS dcb395c666864aaca31ad4f608627f8a
I20260709 13:01:40.205199   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:01:40.439258  9636 raft_consensus.cc:1275] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Refusing update from remote peer 5d2ec81d047545d38585451ffb67cf6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.440919  9760 consensus_queue.cc:1048] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.451635  9710 raft_consensus.cc:1275] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Refusing update from remote peer 5d2ec81d047545d38585451ffb67cf6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.453197  9709 raft_consensus.cc:1275] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Refusing update from remote peer 5d2ec81d047545d38585451ffb67cf6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.454295  9795 consensus_queue.cc:1048] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:40.455353  9787 consensus_queue.cc:1048] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:40.466670  9636 raft_consensus.cc:1275] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Refusing update from remote peer 5d2ec81d047545d38585451ffb67cf6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.468729  9787 consensus_queue.cc:1048] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.508688  9795 raft_consensus.cc:993] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b: : Instructing follower dcb395c666864aaca31ad4f608627f8a to start an election
I20260709 13:01:40.509209  9787 raft_consensus.cc:1081] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 1 LEADER]: Signalling peer dcb395c666864aaca31ad4f608627f8a to start an election
I20260709 13:01:40.511363  9636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74f1ceef37c24125a858c571699156ff"
dest_uuid: "dcb395c666864aaca31ad4f608627f8a"
 from {username='slave'} at 127.0.0.1:48138
I20260709 13:01:40.512141  9636 raft_consensus.cc:493] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.512530  9636 raft_consensus.cc:3060] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.518147  9636 raft_consensus.cc:515] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:40.520185  9636 leader_election.cc:290] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [CANDIDATE]: Term 2 election: Requested vote from peers 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063), d3a0ac0bb651413bbb08fe9210a1f8cd (127.0.107.195:41973)
I20260709 13:01:40.521202  9560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f1ceef37c24125a858c571699156ff" candidate_uuid: "dcb395c666864aaca31ad4f608627f8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d2ec81d047545d38585451ffb67cf6b"
I20260709 13:01:40.521509  9709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f1ceef37c24125a858c571699156ff" candidate_uuid: "dcb395c666864aaca31ad4f608627f8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd"
I20260709 13:01:40.521939  9560 raft_consensus.cc:3055] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.522432  9560 raft_consensus.cc:740] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d2ec81d047545d38585451ffb67cf6b, State: Running, Role: LEADER
I20260709 13:01:40.522454  9709 raft_consensus.cc:3060] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.523308  9560 consensus_queue.cc:260] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:40.524391  9560 raft_consensus.cc:3060] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.528261  9709 raft_consensus.cc:2468] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcb395c666864aaca31ad4f608627f8a in term 2.
I20260709 13:01:40.529548  9602 leader_election.cc:304] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3a0ac0bb651413bbb08fe9210a1f8cd, dcb395c666864aaca31ad4f608627f8a; no voters: 
I20260709 13:01:40.530819  9757 raft_consensus.cc:2804] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.530854  9560 raft_consensus.cc:2468] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcb395c666864aaca31ad4f608627f8a in term 2.
I20260709 13:01:40.532430  9757 raft_consensus.cc:697] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 2 LEADER]: Becoming Leader. State: Replica: dcb395c666864aaca31ad4f608627f8a, State: Running, Role: LEADER
I20260709 13:01:40.533555  9757 consensus_queue.cc:237] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } }
I20260709 13:01:40.540458  9457 catalog_manager.cc:5697] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a reported cstate change: term changed from 1 to 2, leader changed from 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193) to dcb395c666864aaca31ad4f608627f8a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcb395c666864aaca31ad4f608627f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d2ec81d047545d38585451ffb67cf6b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcb395c666864aaca31ad4f608627f8a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3a0ac0bb651413bbb08fe9210a1f8cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.565364   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:01:40.585251   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:40.585897   431 tablet_replica.cc:333] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b: stopping tablet replica
I20260709 13:01:40.586460   431 raft_consensus.cc:2243] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:40.587497   431 raft_consensus.cc:2272] T 0d691686b63647e087e621ce8242ae4d P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.590541   431 tablet_replica.cc:333] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b: stopping tablet replica
I20260709 13:01:40.591387   431 raft_consensus.cc:2243] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.591885   431 raft_consensus.cc:2272] T 74f1ceef37c24125a858c571699156ff P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:40.592787  9673 consensus_peers.cc:597] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd -> Peer 5d2ec81d047545d38585451ffb67cf6b (127.0.107.193:41063): Couldn't send request to peer 5d2ec81d047545d38585451ffb67cf6b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.594942   431 tablet_replica.cc:333] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b: stopping tablet replica
I20260709 13:01:40.595506   431 raft_consensus.cc:2243] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:40.596267   431 raft_consensus.cc:2272] T e66ca7ef205944808e8c4204bb0828eb P 5d2ec81d047545d38585451ffb67cf6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.598526   431 tablet_replica.cc:333] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b: stopping tablet replica
I20260709 13:01:40.598970   431 raft_consensus.cc:2243] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.599327   431 raft_consensus.cc:2272] T 1cec583f47914055bfb6915e829af47b P 5d2ec81d047545d38585451ffb67cf6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.623703   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:01:40.637077   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:01:40.662890   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:40.663710   431 tablet_replica.cc:333] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a: stopping tablet replica
I20260709 13:01:40.664377   431 raft_consensus.cc:2243] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.664875   431 raft_consensus.cc:2272] T 0d691686b63647e087e621ce8242ae4d P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.667232   431 tablet_replica.cc:333] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a: stopping tablet replica
I20260709 13:01:40.667794   431 raft_consensus.cc:2243] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:40.668424   431 pending_rounds.cc:70] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a: Trying to abort 1 pending ops.
I20260709 13:01:40.668594   431 pending_rounds.cc:77] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634203793657856 op_type: NO_OP noop_request { }
I20260709 13:01:40.668924   431 raft_consensus.cc:2889] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:40.669210   431 raft_consensus.cc:2272] T 74f1ceef37c24125a858c571699156ff P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.671705   431 tablet_replica.cc:333] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a: stopping tablet replica
I20260709 13:01:40.672247   431 raft_consensus.cc:2243] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.672679   431 raft_consensus.cc:2272] T 1cec583f47914055bfb6915e829af47b P dcb395c666864aaca31ad4f608627f8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.674525   431 tablet_replica.cc:333] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a: stopping tablet replica
I20260709 13:01:40.674993   431 raft_consensus.cc:2243] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.675446   431 raft_consensus.cc:2272] T e66ca7ef205944808e8c4204bb0828eb P dcb395c666864aaca31ad4f608627f8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.699219   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:01:40.713064   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:01:40.736517   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:40.737238   431 tablet_replica.cc:333] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd: stopping tablet replica
I20260709 13:01:40.737947   431 raft_consensus.cc:2243] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.738426   431 raft_consensus.cc:2272] T 74f1ceef37c24125a858c571699156ff P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.740852   431 tablet_replica.cc:333] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd: stopping tablet replica
I20260709 13:01:40.741425   431 raft_consensus.cc:2243] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.741984   431 raft_consensus.cc:2272] T 0d691686b63647e087e621ce8242ae4d P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.747334   431 tablet_replica.cc:333] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd: stopping tablet replica
I20260709 13:01:40.748277   431 raft_consensus.cc:2243] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:40.749352   431 raft_consensus.cc:2272] T 1cec583f47914055bfb6915e829af47b P d3a0ac0bb651413bbb08fe9210a1f8cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.752406   431 tablet_replica.cc:333] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd: stopping tablet replica
I20260709 13:01:40.753002   431 raft_consensus.cc:2243] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.753619   431 raft_consensus.cc:2272] T e66ca7ef205944808e8c4204bb0828eb P d3a0ac0bb651413bbb08fe9210a1f8cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.777177   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:01:40.789999   431 master.cc:562] Master@127.0.107.254:37889 shutting down...
I20260709 13:01:40.807821   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:40.808329   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.808598   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 57d69c25b2a1443a87109380546cf810: stopping tablet replica
I20260709 13:01:40.828353   431 master.cc:584] Master@127.0.107.254:37889 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2562 ms)
[----------] 6 tests from LeaderRebalancerTest (297940 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:01:40.857079   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41699
I20260709 13:01:40.858258   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:40.863741  9801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:40.863873  9802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:40.865424  9804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:40.866473   431 server_base.cc:1061] running on GCE node
I20260709 13:01:40.867345   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:40.867520   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:40.867659   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602100867642 us; error 0 us; skew 500 ppm
I20260709 13:01:40.868203   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:40.871120   431 webserver.cc:533] Webserver started at http://127.0.107.254:42129/ using document root <none> and password file <none>
I20260709 13:01:40.871869   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:40.872085   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:40.872373   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:40.873479   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/master-0-root/instance:
uuid: "6ce5f9c062bf4f49af70f0281b1574d8"
format_stamp: "Formatted at 2026-07-09 13:01:40 on dist-test-slave-qv7r"
I20260709 13:01:40.878377   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:40.882337  9809 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:40.883252   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:01:40.883523   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/master-0-root
uuid: "6ce5f9c062bf4f49af70f0281b1574d8"
format_stamp: "Formatted at 2026-07-09 13:01:40 on dist-test-slave-qv7r"
I20260709 13:01:40.883764   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:40.905210   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:40.906311   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:40.943882   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41699
I20260709 13:01:40.944003  9860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41699 every 8 connection(s)
I20260709 13:01:40.948045  9861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:40.958896  9861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8: Bootstrap starting.
I20260709 13:01:40.963284  9861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.967541  9861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8: No bootstrap required, opened a new log
I20260709 13:01:40.969659  9861 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5f9c062bf4f49af70f0281b1574d8" member_type: VOTER }
I20260709 13:01:40.970062  9861 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.970278  9861 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ce5f9c062bf4f49af70f0281b1574d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.970919  9861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5f9c062bf4f49af70f0281b1574d8" member_type: VOTER }
I20260709 13:01:40.971407  9861 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:40.971622  9861 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:40.971884  9861 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.976791  9861 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5f9c062bf4f49af70f0281b1574d8" member_type: VOTER }
I20260709 13:01:40.977303  9861 leader_election.cc:304] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ce5f9c062bf4f49af70f0281b1574d8; no voters: 
I20260709 13:01:40.978520  9861 leader_election.cc:290] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:40.978866  9864 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.980373  9864 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 1 LEADER]: Becoming Leader. State: Replica: 6ce5f9c062bf4f49af70f0281b1574d8, State: Running, Role: LEADER
I20260709 13:01:40.981083  9864 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5f9c062bf4f49af70f0281b1574d8" member_type: VOTER }
I20260709 13:01:40.981367  9861 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:40.983819  9866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ce5f9c062bf4f49af70f0281b1574d8. Latest consensus state: current_term: 1 leader_uuid: "6ce5f9c062bf4f49af70f0281b1574d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5f9c062bf4f49af70f0281b1574d8" member_type: VOTER } }
I20260709 13:01:40.983800  9865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ce5f9c062bf4f49af70f0281b1574d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5f9c062bf4f49af70f0281b1574d8" member_type: VOTER } }
I20260709 13:01:40.984637  9866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:40.984712  9865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:40.995002  9869 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:41.003013  9869 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:41.004364   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:41.012494  9869 catalog_manager.cc:1383] Generated new cluster ID: ce84e6e8bfa54655a2941d2673f22fbf
I20260709 13:01:41.012816  9869 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:41.031868  9869 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:41.033241  9869 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:41.051481  9869 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8: Generated new TSK 0
I20260709 13:01:41.052313  9869 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:41.071678   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:41.078037  9882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:41.079017  9883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:41.082835  9885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:41.083088   431 server_base.cc:1061] running on GCE node
I20260709 13:01:41.084271   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:41.084465   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:41.084662   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602101084642 us; error 0 us; skew 500 ppm
I20260709 13:01:41.085311   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:41.088112   431 webserver.cc:533] Webserver started at http://127.0.107.193:39709/ using document root <none> and password file <none>
I20260709 13:01:41.088641   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:41.088845   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:41.089113   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:41.090291   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-0-root/instance:
uuid: "c5ef410dc10045dab7938ad6b81a54de"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-qv7r"
I20260709 13:01:41.096158   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:01:41.100071  9890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.101094   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:01:41.101382   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "c5ef410dc10045dab7938ad6b81a54de"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-qv7r"
I20260709 13:01:41.101687   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:41.111517   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:41.112613   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:41.114182   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:41.116497   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:41.116729   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.116991   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:41.117161   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.161193   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40135
I20260709 13:01:41.161319  9952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40135 every 8 connection(s)
I20260709 13:01:41.166333   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:41.174180  9957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:41.174305  9958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:41.183025  9953 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41699
W20260709 13:01:41.183290  9960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:41.183601  9953 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:41.183967   431 server_base.cc:1061] running on GCE node
I20260709 13:01:41.184710  9953 heartbeater.cc:507] Master 127.0.107.254:41699 requested a full tablet report, sending...
I20260709 13:01:41.185111   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:41.185436   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:41.185695   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602101185673 us; error 0 us; skew 500 ppm
I20260709 13:01:41.186357   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:41.187839  9826 ts_manager.cc:194] Registered new tserver with Master: c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135)
I20260709 13:01:41.189360   431 webserver.cc:533] Webserver started at http://127.0.107.194:34517/ using document root <none> and password file <none>
I20260709 13:01:41.190073   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:41.190304   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:41.190409  9826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52474
I20260709 13:01:41.190637   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:41.192058   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-1-root/instance:
uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-qv7r"
I20260709 13:01:41.196859   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:41.200634  9965 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.201614   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:41.201974   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-1-root
uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-qv7r"
I20260709 13:01:41.202353   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:41.222532   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:41.223644   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:41.225128   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:41.227450   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:41.227634   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.227861   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:41.227995   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.268666   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46167
I20260709 13:01:41.268852 10027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46167 every 8 connection(s)
I20260709 13:01:41.273669   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:41.281076 10031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:41.282876 10032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:41.285173 10034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:41.285545   431 server_base.cc:1061] running on GCE node
I20260709 13:01:41.286842   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:41.287115   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:41.287269   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602101287257 us; error 0 us; skew 500 ppm
I20260709 13:01:41.287997   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:41.288084 10028 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41699
I20260709 13:01:41.288606 10028 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:41.289608 10028 heartbeater.cc:507] Master 127.0.107.254:41699 requested a full tablet report, sending...
I20260709 13:01:41.290866   431 webserver.cc:533] Webserver started at http://127.0.107.195:38529/ using document root <none> and password file <none>
I20260709 13:01:41.291572   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:41.291810   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:41.292132   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:41.292023  9826 ts_manager.cc:194] Registered new tserver with Master: 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:41.293720   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-2-root/instance:
uuid: "5ff5add82e9647bdbc8aa2945e012887"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-qv7r"
I20260709 13:01:41.294067  9826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52478
I20260709 13:01:41.298723   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:41.302325 10039 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.303066   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:01:41.303478   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-2-root
uuid: "5ff5add82e9647bdbc8aa2945e012887"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-qv7r"
I20260709 13:01:41.303900   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601802742860-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:41.317996   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:41.319041   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:41.320441   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:41.322793   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:41.322973   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.323244   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:41.323390   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.364265   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35073
I20260709 13:01:41.364377 10101 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35073 every 8 connection(s)
I20260709 13:01:41.378695 10102 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41699
I20260709 13:01:41.379184 10102 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:41.379999 10102 heartbeater.cc:507] Master 127.0.107.254:41699 requested a full tablet report, sending...
I20260709 13:01:41.382112  9826 ts_manager.cc:194] Registered new tserver with Master: 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:41.382274   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015087694s
I20260709 13:01:41.383812  9826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52494
I20260709 13:01:41.410241  9826 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55768:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:41.412941  9826 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:41.482190  9993 tablet_service.cc:1511] Processing CreateTablet for tablet 545f695bb62f4ab98cafcec11334ee77 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:41.484103  9993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545f695bb62f4ab98cafcec11334ee77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.487342  9992 tablet_service.cc:1511] Processing CreateTablet for tablet 6be5a49e6b544ccd895fc7e575e4fd7c (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:41.489389  9992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5a49e6b544ccd895fc7e575e4fd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.501595  9991 tablet_service.cc:1511] Processing CreateTablet for tablet 166c5e2a707140c1a25e4747ec118fe7 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:41.503139  9991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166c5e2a707140c1a25e4747ec118fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.509797  9990 tablet_service.cc:1511] Processing CreateTablet for tablet 93cf85a08c5c48fc80b81d3f032490f3 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:41.511049 10067 tablet_service.cc:1511] Processing CreateTablet for tablet 545f695bb62f4ab98cafcec11334ee77 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:41.511454  9990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cf85a08c5c48fc80b81d3f032490f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.511065 10066 tablet_service.cc:1511] Processing CreateTablet for tablet 6be5a49e6b544ccd895fc7e575e4fd7c (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:41.512481 10067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545f695bb62f4ab98cafcec11334ee77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.513867 10065 tablet_service.cc:1511] Processing CreateTablet for tablet 166c5e2a707140c1a25e4747ec118fe7 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:41.515273 10065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166c5e2a707140c1a25e4747ec118fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.517127 10066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5a49e6b544ccd895fc7e575e4fd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.521813  9918 tablet_service.cc:1511] Processing CreateTablet for tablet 545f695bb62f4ab98cafcec11334ee77 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:41.523236  9918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545f695bb62f4ab98cafcec11334ee77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.526762  9917 tablet_service.cc:1511] Processing CreateTablet for tablet 6be5a49e6b544ccd895fc7e575e4fd7c (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:41.528178  9917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5a49e6b544ccd895fc7e575e4fd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.530712  9916 tablet_service.cc:1511] Processing CreateTablet for tablet 166c5e2a707140c1a25e4747ec118fe7 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:41.532133  9916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166c5e2a707140c1a25e4747ec118fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.535161  9915 tablet_service.cc:1511] Processing CreateTablet for tablet 93cf85a08c5c48fc80b81d3f032490f3 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:41.537887  9915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cf85a08c5c48fc80b81d3f032490f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.543147 10064 tablet_service.cc:1511] Processing CreateTablet for tablet 93cf85a08c5c48fc80b81d3f032490f3 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:41.544251  9914 tablet_service.cc:1511] Processing CreateTablet for tablet 7196930dd4f54a05b91c73a41a585c2c (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:41.546823 10064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cf85a08c5c48fc80b81d3f032490f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.553140  9989 tablet_service.cc:1511] Processing CreateTablet for tablet 7196930dd4f54a05b91c73a41a585c2c (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:41.554822  9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7196930dd4f54a05b91c73a41a585c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.555712 10063 tablet_service.cc:1511] Processing CreateTablet for tablet 7196930dd4f54a05b91c73a41a585c2c (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:41.557147 10063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7196930dd4f54a05b91c73a41a585c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.558058  9914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7196930dd4f54a05b91c73a41a585c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.564240  9913 tablet_service.cc:1511] Processing CreateTablet for tablet 98f312cc7eb448049390e2a4d3271b4f (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:41.565753  9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f312cc7eb448049390e2a4d3271b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.570410  9988 tablet_service.cc:1511] Processing CreateTablet for tablet 98f312cc7eb448049390e2a4d3271b4f (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:41.572129  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f312cc7eb448049390e2a4d3271b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.575093  9987 tablet_service.cc:1511] Processing CreateTablet for tablet a463a937d59a4efe8934417a6390e40e (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:41.578276  9912 tablet_service.cc:1511] Processing CreateTablet for tablet a463a937d59a4efe8934417a6390e40e (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:41.579681  9912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a463a937d59a4efe8934417a6390e40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.576529  9987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a463a937d59a4efe8934417a6390e40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.581449 10065 tablet_service.cc:1511] Processing CreateTablet for tablet 98f312cc7eb448049390e2a4d3271b4f (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:41.582934 10065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f312cc7eb448049390e2a4d3271b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.598702 10066 tablet_service.cc:1511] Processing CreateTablet for tablet a463a937d59a4efe8934417a6390e40e (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:41.600392  9911 tablet_service.cc:1511] Processing CreateTablet for tablet cc0c056cb3a14ba68e775d5b6d3f5013 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:41.601028 10066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a463a937d59a4efe8934417a6390e40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.601776  9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0c056cb3a14ba68e775d5b6d3f5013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.615919  9986 tablet_service.cc:1511] Processing CreateTablet for tablet cc0c056cb3a14ba68e775d5b6d3f5013 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:41.617434  9986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0c056cb3a14ba68e775d5b6d3f5013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.624003 10117 tablet_bootstrap.cc:492] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:41.634459 10118 tablet_bootstrap.cc:492] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:41.668380 10063 tablet_service.cc:1511] Processing CreateTablet for tablet cc0c056cb3a14ba68e775d5b6d3f5013 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:41.743813 10118 tablet_bootstrap.cc:654] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.743983  9992 tablet_service.cc:1511] Processing CreateTablet for tablet 400a90a7d27c41418263df752a557d82 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:41.744905 10063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0c056cb3a14ba68e775d5b6d3f5013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.746114  9910 tablet_service.cc:1511] Processing CreateTablet for tablet 400a90a7d27c41418263df752a557d82 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:41.750972  9910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400a90a7d27c41418263df752a557d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.757225 10117 tablet_bootstrap.cc:700] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent opening tablet: real 0.128s	user 0.020s	sys 0.044s
I20260709 13:01:41.758057 10117 tablet_bootstrap.cc:654] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.766201  9992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400a90a7d27c41418263df752a557d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.778280 10117 tablet_bootstrap.cc:492] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:41.778923 10117 ts_tablet_manager.cc:1403] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.155s	user 0.027s	sys 0.054s
I20260709 13:01:41.746690 10119 tablet_bootstrap.cc:492] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:41.781908 10117 raft_consensus.cc:359] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.782703 10117 raft_consensus.cc:385] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.783011 10117 raft_consensus.cc:740] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.783792 10117 consensus_queue.cc:260] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.786727 10028 heartbeater.cc:499] Master 127.0.107.254:41699 was elected leader, sending a full tablet report...
I20260709 13:01:41.787410 10117 ts_tablet_manager.cc:1434] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:01:41.790630 10065 tablet_service.cc:1511] Processing CreateTablet for tablet 400a90a7d27c41418263df752a557d82 (DEFAULT_TABLE table=test-workload [id=29e18d5917de471b9baf42c5e136952b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:41.798228 10117 tablet_bootstrap.cc:492] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:41.798314 10065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400a90a7d27c41418263df752a557d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.804600 10117 tablet_bootstrap.cc:654] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.806253 10119 tablet_bootstrap.cc:654] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.812172 10118 tablet_bootstrap.cc:492] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:41.812707 10118 ts_tablet_manager.cc:1403] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.179s	user 0.014s	sys 0.000s
I20260709 13:01:41.813779 10117 tablet_bootstrap.cc:492] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:41.814422 10117 ts_tablet_manager.cc:1403] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 13:01:41.815672 10118 raft_consensus.cc:359] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:41.816475 10118 raft_consensus.cc:385] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.816772 10118 raft_consensus.cc:740] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.817420 10117 raft_consensus.cc:359] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:41.817539 10118 consensus_queue.cc:260] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:41.818403 10117 raft_consensus.cc:385] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.818822 10117 raft_consensus.cc:740] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.819727 10117 consensus_queue.cc:260] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:41.821959 10117 ts_tablet_manager.cc:1434] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:41.823233 10117 tablet_bootstrap.cc:492] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:41.828588 10119 tablet_bootstrap.cc:492] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:41.829291 10119 ts_tablet_manager.cc:1403] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:01:41.830003 10117 tablet_bootstrap.cc:654] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.843269 10102 heartbeater.cc:499] Master 127.0.107.254:41699 was elected leader, sending a full tablet report...
I20260709 13:01:41.843825 10118 ts_tablet_manager.cc:1434] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.031s	user 0.014s	sys 0.017s
I20260709 13:01:41.844859 10118 tablet_bootstrap.cc:492] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:41.844336 10119 raft_consensus.cc:359] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.845438 10119 raft_consensus.cc:385] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.845906 10119 raft_consensus.cc:740] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.851046 10118 tablet_bootstrap.cc:654] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.852090 10119 consensus_queue.cc:260] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.852859 10117 tablet_bootstrap.cc:492] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:41.853622 10117 ts_tablet_manager.cc:1403] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.010s
I20260709 13:01:41.856590 10117 raft_consensus.cc:359] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.857437 10117 raft_consensus.cc:385] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.857820 10117 raft_consensus.cc:740] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.858791 10117 consensus_queue.cc:260] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.863785 10117 ts_tablet_manager.cc:1434] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:01:41.865010 10117 tablet_bootstrap.cc:492] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:41.871071 10117 tablet_bootstrap.cc:654] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.882682 10117 tablet_bootstrap.cc:492] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:41.883333 10117 ts_tablet_manager.cc:1403] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:01:41.884750 10119 ts_tablet_manager.cc:1434] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.047s	user 0.018s	sys 0.020s
I20260709 13:01:41.885166 10118 tablet_bootstrap.cc:492] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:41.885618  9953 heartbeater.cc:499] Master 127.0.107.254:41699 was elected leader, sending a full tablet report...
I20260709 13:01:41.885831 10118 ts_tablet_manager.cc:1403] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.026s
I20260709 13:01:41.886021 10117 raft_consensus.cc:359] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.886785 10119 tablet_bootstrap.cc:492] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:41.886814 10117 raft_consensus.cc:385] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.887404 10117 raft_consensus.cc:740] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.888306 10117 consensus_queue.cc:260] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.888902 10118 raft_consensus.cc:359] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.889714 10118 raft_consensus.cc:385] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.890019 10118 raft_consensus.cc:740] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.890992 10118 consensus_queue.cc:260] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.893361 10118 ts_tablet_manager.cc:1434] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:01:41.893823 10119 tablet_bootstrap.cc:654] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.894363 10118 tablet_bootstrap.cc:492] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:41.899822 10117 ts_tablet_manager.cc:1434] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.005s
I20260709 13:01:41.900533 10118 tablet_bootstrap.cc:654] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.904285 10117 tablet_bootstrap.cc:492] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:41.906435 10119 tablet_bootstrap.cc:492] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:41.907199 10119 ts_tablet_manager.cc:1403] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 13:01:41.910485 10119 raft_consensus.cc:359] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.911165 10118 tablet_bootstrap.cc:492] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:41.911269 10119 raft_consensus.cc:385] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.911693 10119 raft_consensus.cc:740] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.911687 10117 tablet_bootstrap.cc:654] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.911880 10118 ts_tablet_manager.cc:1403] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:01:41.912799 10119 consensus_queue.cc:260] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.915421 10119 ts_tablet_manager.cc:1434] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:41.916414 10119 tablet_bootstrap.cc:492] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:41.917224 10118 raft_consensus.cc:359] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.918063 10118 raft_consensus.cc:385] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.918361 10118 raft_consensus.cc:740] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.919320 10118 consensus_queue.cc:260] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.921993 10118 ts_tablet_manager.cc:1434] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:41.923076 10118 tablet_bootstrap.cc:492] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:41.923219 10119 tablet_bootstrap.cc:654] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.924283 10127 raft_consensus.cc:493] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.924803 10127 raft_consensus.cc:515] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.929880 10118 tablet_bootstrap.cc:654] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.936753 10127 leader_election.cc:290] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:41.941735 10122 raft_consensus.cc:493] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.942569 10122 raft_consensus.cc:515] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:41.948485 10122 leader_election.cc:290] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:41.965292 10119 tablet_bootstrap.cc:492] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:41.966189 10119 ts_tablet_manager.cc:1403] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.000s
I20260709 13:01:41.994710 10117 tablet_bootstrap.cc:492] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:41.995314 10117 ts_tablet_manager.cc:1403] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.091s	user 0.046s	sys 0.037s
W20260709 13:01:41.995851  9874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:41.990758 10119 raft_consensus.cc:359] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:41.996631 10119 raft_consensus.cc:385] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.996901 10119 raft_consensus.cc:740] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.997521 10119 consensus_queue.cc:260] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:41.999007 10117 raft_consensus.cc:359] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.001240 10117 raft_consensus.cc:385] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.000399 10118 tablet_bootstrap.cc:492] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:42.000247 10119 ts_tablet_manager.cc:1434] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:01:42.001695 10117 raft_consensus.cc:740] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.002018 10118 ts_tablet_manager.cc:1403] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.079s	user 0.031s	sys 0.034s
I20260709 13:01:42.002907 10119 tablet_bootstrap.cc:492] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:42.002597 10117 consensus_queue.cc:260] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.005105 10118 raft_consensus.cc:359] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.005708 10117 ts_tablet_manager.cc:1434] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:42.006040 10118 raft_consensus.cc:385] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.006450 10118 raft_consensus.cc:740] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.006819 10117 tablet_bootstrap.cc:492] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:42.007228 10118 consensus_queue.cc:260] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.010047 10118 ts_tablet_manager.cc:1434] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:01:42.011098 10118 tablet_bootstrap.cc:492] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:42.013870 10117 tablet_bootstrap.cc:654] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.026120 10118 tablet_bootstrap.cc:654] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.034511  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.034641 10119 tablet_bootstrap.cc:654] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:42.036820  9967 leader_election.cc:343] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.037686 10117 tablet_bootstrap.cc:492] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:42.038335 10117 ts_tablet_manager.cc:1403] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.012s
I20260709 13:01:42.042320 10117 raft_consensus.cc:359] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.043433 10117 raft_consensus.cc:385] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.043929 10117 raft_consensus.cc:740] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.044034 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.045258 10117 consensus_queue.cc:260] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
W20260709 13:01:42.046382  9892 leader_election.cc:343] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.047580 10119 tablet_bootstrap.cc:492] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:42.048148 10119 ts_tablet_manager.cc:1403] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.008s
I20260709 13:01:42.050261 10117 ts_tablet_manager.cc:1434] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:01:42.053476 10117 tablet_bootstrap.cc:492] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:42.056279 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.057528 10003 raft_consensus.cc:2468] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 0.
I20260709 13:01:42.059465  9894 leader_election.cc:304] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:42.061088 10127 raft_consensus.cc:2804] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.061636 10127 raft_consensus.cc:493] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.062063 10127 raft_consensus.cc:3060] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.062104 10117 tablet_bootstrap.cc:654] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.068668 10119 raft_consensus.cc:359] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.069947 10119 raft_consensus.cc:385] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.070370 10119 raft_consensus.cc:740] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.072000 10119 consensus_queue.cc:260] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.074118 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.075094 10077 raft_consensus.cc:2468] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:42.075690 10117 tablet_bootstrap.cc:492] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:42.076582 10117 ts_tablet_manager.cc:1403] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 13:01:42.079882  9967 leader_election.cc:304] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.080880 10122 raft_consensus.cc:2804] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.081290 10122 raft_consensus.cc:493] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.081718 10122 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.084681 10119 ts_tablet_manager.cc:1434] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 13:01:42.073215 10127 raft_consensus.cc:515] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.085496 10118 tablet_bootstrap.cc:492] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:42.086198 10118 ts_tablet_manager.cc:1403] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.075s	user 0.037s	sys 0.025s
I20260709 13:01:42.087586 10119 tablet_bootstrap.cc:492] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:42.089694 10118 raft_consensus.cc:359] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.090188 10127 leader_election.cc:290] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.090627 10118 raft_consensus.cc:385] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.091353 10118 raft_consensus.cc:740] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.092343 10118 consensus_queue.cc:260] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.093645 10122 raft_consensus.cc:515] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.093647 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:42.095034 10003 raft_consensus.cc:3060] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.095148 10118 ts_tablet_manager.cc:1434] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:42.096016 10122 leader_election.cc:290] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.096480 10118 tablet_bootstrap.cc:492] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:42.096988 10117 raft_consensus.cc:359] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.097833 10117 raft_consensus.cc:385] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.098140 10117 raft_consensus.cc:740] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.098968 10117 consensus_queue.cc:260] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.101641 10117 ts_tablet_manager.cc:1434] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:01:42.103186  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:42.094012 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:42.106058 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
W20260709 13:01:42.106995  9892 leader_election.cc:343] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.107136 10076 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:42.107856  9967 leader_election.cc:343] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.110126 10125 raft_consensus.cc:493] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.110662 10125 raft_consensus.cc:515] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.121361 10117 tablet_bootstrap.cc:492] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:42.124625 10003 raft_consensus.cc:2468] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 1.
I20260709 13:01:42.125733 10118 tablet_bootstrap.cc:654] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.126070  9894 leader_election.cc:304] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:42.128062 10127 raft_consensus.cc:2804] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.128571 10127 raft_consensus.cc:697] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:42.129390 10127 consensus_queue.cc:237] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.137741 10118 tablet_bootstrap.cc:492] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:42.138439 10118 ts_tablet_manager.cc:1403] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.023s
I20260709 13:01:42.141865 10118 raft_consensus.cc:359] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.142740 10118 raft_consensus.cc:385] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.143098 10118 raft_consensus.cc:740] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.144006 10118 consensus_queue.cc:260] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.148627 10125 leader_election.cc:290] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:42.148924 10117 tablet_bootstrap.cc:654] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.148834  9823 catalog_manager.cc:5697] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.152700 10076 raft_consensus.cc:2468] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:42.154157 10118 ts_tablet_manager.cc:1434] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:01:42.155714 10118 tablet_bootstrap.cc:492] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:42.158619  9967 leader_election.cc:304] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.160178 10122 raft_consensus.cc:2804] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.164319 10118 tablet_bootstrap.cc:654] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.169070 10153 raft_consensus.cc:493] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.169870 10153 raft_consensus.cc:515] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.175048  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7196930dd4f54a05b91c73a41a585c2c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.175917  9928 raft_consensus.cc:2468] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:42.177760  9967 leader_election.cc:304] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:42.180655 10119 tablet_bootstrap.cc:654] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.181770 10153 leader_election.cc:290] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.183693 10153 raft_consensus.cc:493] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.185003 10153 raft_consensus.cc:515] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.187187 10122 raft_consensus.cc:697] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:42.189150 10152 raft_consensus.cc:2804] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.189673 10152 raft_consensus.cc:493] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.190007 10152 raft_consensus.cc:3060] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.190966 10118 tablet_bootstrap.cc:492] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:42.191602 10118 ts_tablet_manager.cc:1403] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.001s
I20260709 13:01:42.194954 10118 raft_consensus.cc:359] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.195917 10118 raft_consensus.cc:385] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.197661  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.198112 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.195791 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7196930dd4f54a05b91c73a41a585c2c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.198493 10122 consensus_queue.cc:237] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.198858 10077 raft_consensus.cc:2468] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:42.199282 10076 raft_consensus.cc:2468] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:42.195791 10153 leader_election.cc:290] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.200409 10118 raft_consensus.cc:740] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.201728  9967 leader_election.cc:304] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:42.202705 10153 raft_consensus.cc:2804] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.203279 10153 raft_consensus.cc:493] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:42.203488  9967 leader_election.cc:343] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.203750 10153 raft_consensus.cc:3060] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.201277 10118 consensus_queue.cc:260] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.206270 10118 ts_tablet_manager.cc:1434] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:01:42.207558 10118 tablet_bootstrap.cc:492] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:42.210964 10125 raft_consensus.cc:493] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.211735 10125 raft_consensus.cc:515] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:42.214066 10153 raft_consensus.cc:515] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.215013 10125 leader_election.cc:290] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135)
I20260709 13:01:42.216754 10153 leader_election.cc:290] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.218806  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:42.221535 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:42.222249 10076 raft_consensus.cc:3060] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.225646 10117 tablet_bootstrap.cc:492] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:42.226531 10117 ts_tablet_manager.cc:1403] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.009s
I20260709 13:01:42.227845 10125 raft_consensus.cc:493] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.228181 10152 raft_consensus.cc:515] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.228614 10125 raft_consensus.cc:515] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.230787 10152 leader_election.cc:290] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.232448 10118 tablet_bootstrap.cc:654] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.232331  9824 catalog_manager.cc:5697] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.235545 10152 raft_consensus.cc:493] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.236135 10152 raft_consensus.cc:515] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:42.238404 10152 leader_election.cc:290] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073), c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135)
I20260709 13:01:42.240095  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7196930dd4f54a05b91c73a41a585c2c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:42.240816  9928 raft_consensus.cc:3060] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.249109  9928 raft_consensus.cc:2468] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
W20260709 13:01:42.250975  9967 leader_election.cc:343] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.252421 10075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.252990  9967 leader_election.cc:304] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:42.255435 10122 raft_consensus.cc:2804] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.255784  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.256517  9927 raft_consensus.cc:2468] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:42.256728 10125 leader_election.cc:290] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:42.240876 10117 raft_consensus.cc:359] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.255980 10122 raft_consensus.cc:697] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:42.258656  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.259159 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.259367  9925 raft_consensus.cc:2468] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:42.259979 10117 raft_consensus.cc:385] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.260350 10117 raft_consensus.cc:740] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.260452 10002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.260779  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.258937 10122 consensus_queue.cc:237] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.251418 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7196930dd4f54a05b91c73a41a585c2c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:42.261194 10117 consensus_queue.cc:260] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.261227 10002 raft_consensus.cc:2468] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:42.262127 10077 raft_consensus.cc:3060] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.261795 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.263635 10001 raft_consensus.cc:2393] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ff5add82e9647bdbc8aa2945e012887 in current term 1: Already voted for candidate c5ef410dc10045dab7938ad6b81a54de in this term.
I20260709 13:01:42.263913 10117 ts_tablet_manager.cc:1434] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:01:42.265004 10117 tablet_bootstrap.cc:492] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:42.257755  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.253147 10075 raft_consensus.cc:2468] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:42.268224 10043 leader_election.cc:304] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:42.269980 10118 tablet_bootstrap.cc:492] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
W20260709 13:01:42.270223 10041 leader_election.cc:343] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.270586 10118 ts_tablet_manager.cc:1403] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.001s
I20260709 13:01:42.270658 10117 tablet_bootstrap.cc:654] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.272647 10119 tablet_bootstrap.cc:492] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:42.273233 10119 ts_tablet_manager.cc:1403] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.011s
I20260709 13:01:42.254545 10152 raft_consensus.cc:493] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.273887 10125 raft_consensus.cc:2804] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.274619 10125 raft_consensus.cc:493] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.273967 10152 raft_consensus.cc:515] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.275048 10125 raft_consensus.cc:3060] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.275686 10003 raft_consensus.cc:2468] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:42.252417 10076 raft_consensus.cc:2468] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:42.279357 10152 leader_election.cc:290] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.280499 10077 raft_consensus.cc:2468] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:42.284705 10117 tablet_bootstrap.cc:492] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:42.284183 10119 raft_consensus.cc:359] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.273895 10118 raft_consensus.cc:359] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.285252 10117 ts_tablet_manager.cc:1403] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:01:42.285741 10118 raft_consensus.cc:385] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.287159 10118 raft_consensus.cc:740] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.287817 10117 raft_consensus.cc:359] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.288354 10117 raft_consensus.cc:385] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.287954 10118 consensus_queue.cc:260] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.288530 10117 raft_consensus.cc:740] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.289340 10117 consensus_queue.cc:260] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.291280 10117 ts_tablet_manager.cc:1434] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:42.290983 10043 leader_election.cc:304] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887; no voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.291100  9967 leader_election.cc:304] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:42.292371 10149 raft_consensus.cc:3060] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.285308 10119 raft_consensus.cc:385] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.292712 10152 raft_consensus.cc:2804] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.293051 10119 raft_consensus.cc:740] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.293231 10152 raft_consensus.cc:493] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.293505  9967 leader_election.cc:304] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.293922 10152 raft_consensus.cc:3060] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.294502 10119 consensus_queue.cc:260] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.296537 10153 raft_consensus.cc:2804] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.297049 10153 raft_consensus.cc:697] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:42.298472 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.298353 10153 consensus_queue.cc:237] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.299213 10077 raft_consensus.cc:2468] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:42.300225 10127 raft_consensus.cc:493] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.300771 10127 raft_consensus.cc:515] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.301445 10152 raft_consensus.cc:515] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:42.301905 10043 leader_election.cc:304] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.303261 10118 ts_tablet_manager.cc:1434] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:01:42.303633 10152 leader_election.cc:290] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Requested vote from peers 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073), c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135)
I20260709 13:01:42.304405 10118 tablet_bootstrap.cc:492] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:42.304821 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.305505 10003 raft_consensus.cc:2468] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 0.
I20260709 13:01:42.305858 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.306479 10077 raft_consensus.cc:2468] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 0.
I20260709 13:01:42.306540 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:42.307878  9967 leader_election.cc:304] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:42.308456  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.308674 10152 raft_consensus.cc:2804] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.309067 10152 raft_consensus.cc:493] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.309109  9928 raft_consensus.cc:2468] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:42.309501 10152 raft_consensus.cc:3060] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.310228  9894 leader_election.cc:304] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:42.311259 10144 raft_consensus.cc:2804] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.311667 10144 raft_consensus.cc:493] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.311800 10127 leader_election.cc:290] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.312017 10144 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.313958  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:42.314752  9928 raft_consensus.cc:3060] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.317390 10152 raft_consensus.cc:515] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.321947  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:42.322621  9926 raft_consensus.cc:3060] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.323011 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:42.323779 10077 raft_consensus.cc:3060] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.302538 10125 raft_consensus.cc:515] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:42.325126 10076 raft_consensus.cc:2393] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a4416aa57914b21b9de80e6f47dc5a2 in current term 1: Already voted for candidate 5ff5add82e9647bdbc8aa2945e012887 in this term.
I20260709 13:01:42.329239 10119 ts_tablet_manager.cc:1434] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.001s
I20260709 13:01:42.329989 10125 leader_election.cc:290] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135)
I20260709 13:01:42.330096  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:42.325205 10149 raft_consensus.cc:2749] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.333907 10152 leader_election.cc:290] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.333003 10077 raft_consensus.cc:2468] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:42.335585  9967 leader_election.cc:304] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:42.335858 10125 raft_consensus.cc:2764] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:01:42.336622 10152 raft_consensus.cc:2804] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.337075  9926 raft_consensus.cc:2468] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:42.337188 10152 raft_consensus.cc:697] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:42.332075 10119 tablet_bootstrap.cc:492] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:42.339497 10152 consensus_queue.cc:237] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.322499 10144 raft_consensus.cc:515] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.348479 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:42.349093 10003 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.338178  9928 raft_consensus.cc:2468] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:42.311264 10118 tablet_bootstrap.cc:654] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.352054 10119 tablet_bootstrap.cc:654] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.357020 10144 leader_election.cc:290] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.358634 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:42.359345 10077 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:42.360576 10043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46167, user_credentials={real_user=slave}} blocked reactor thread for 58763.5us
I20260709 13:01:42.362362 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:42.363186 10001 raft_consensus.cc:2393] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ff5add82e9647bdbc8aa2945e012887 in current term 1: Already voted for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in this term.
I20260709 13:01:42.364531 10043 leader_election.cc:304] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887; no voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.365505 10163 raft_consensus.cc:2749] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.365909  9826 catalog_manager.cc:5697] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.367764  9826 catalog_manager.cc:5697] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.369477 10152 raft_consensus.cc:493] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.370025 10152 raft_consensus.cc:515] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.371976 10152 leader_election.cc:290] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.373172 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.374030 10003 raft_consensus.cc:2468] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 1.
I20260709 13:01:42.375438  9894 leader_election.cc:304] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:42.375510  9967 leader_election.cc:304] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:42.376477 10144 raft_consensus.cc:2804] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:42.376848  9967 leader_election.cc:343] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.376992 10144 raft_consensus.cc:697] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:42.377599 10152 raft_consensus.cc:2804] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.378561 10152 raft_consensus.cc:697] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:42.379245 10077 raft_consensus.cc:2468] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 1.
I20260709 13:01:42.378067 10144 consensus_queue.cc:237] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.379484 10152 consensus_queue.cc:237] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:42.377882 10118 tablet_bootstrap.cc:492] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:42.380810 10118 ts_tablet_manager.cc:1403] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.010s
I20260709 13:01:42.382375  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.384363 10118 raft_consensus.cc:359] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.385223 10118 raft_consensus.cc:385] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.385748 10118 raft_consensus.cc:740] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.386780 10118 consensus_queue.cc:260] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.389405 10118 ts_tablet_manager.cc:1434] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 13:01:42.389591  9967 leader_election.cc:343] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.390142  9967 leader_election.cc:304] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2; no voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.390985 10153 raft_consensus.cc:2749] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.398624  9823 catalog_manager.cc:5697] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.408425 10119 tablet_bootstrap.cc:492] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:42.409068 10119 ts_tablet_manager.cc:1403] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.003s
I20260709 13:01:42.409904  9824 catalog_manager.cc:5697] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.411983 10119 raft_consensus.cc:359] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.411862  9824 catalog_manager.cc:5697] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.412745 10119 raft_consensus.cc:385] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.413098 10119 raft_consensus.cc:740] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.413874 10119 consensus_queue.cc:260] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.416113 10119 ts_tablet_manager.cc:1434] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:42.417090 10119 tablet_bootstrap.cc:492] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:42.422996 10163 raft_consensus.cc:493] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.423143 10119 tablet_bootstrap.cc:654] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.423635 10163 raft_consensus.cc:515] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.426685  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400a90a7d27c41418263df752a557d82" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:42.426860 10163 leader_election.cc:290] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:42.427942 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400a90a7d27c41418263df752a557d82" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.428624 10003 raft_consensus.cc:2468] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
W20260709 13:01:42.428094 10041 leader_election.cc:343] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.429764 10043 leader_election.cc:304] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.430614 10163 raft_consensus.cc:2804] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.431017 10163 raft_consensus.cc:493] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.431365 10163 raft_consensus.cc:3060] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.432183 10119 tablet_bootstrap.cc:492] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:42.432801 10119 ts_tablet_manager.cc:1403] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:01:42.435827 10119 raft_consensus.cc:359] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.436568 10119 raft_consensus.cc:385] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.436872 10119 raft_consensus.cc:740] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.437757 10119 consensus_queue.cc:260] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.439499 10163 raft_consensus.cc:515] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.440428 10119 ts_tablet_manager.cc:1434] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:42.441745 10119 tablet_bootstrap.cc:492] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:42.441736 10163 leader_election.cc:290] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:42.442764  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400a90a7d27c41418263df752a557d82" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:42.442770 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400a90a7d27c41418263df752a557d82" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:42.443611 10003 raft_consensus.cc:3060] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:42.444458 10041 leader_election.cc:343] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.447208 10119 tablet_bootstrap.cc:654] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.449664 10003 raft_consensus.cc:2468] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
I20260709 13:01:42.451012 10043 leader_election.cc:304] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:42.451892 10163 raft_consensus.cc:2804] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.452378 10119 tablet_bootstrap.cc:492] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:42.452364 10163 raft_consensus.cc:697] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:42.452955 10119 ts_tablet_manager.cc:1403] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:01:42.453300 10163 consensus_queue.cc:237] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.455639 10119 raft_consensus.cc:359] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.492139 10119 raft_consensus.cc:385] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.492859 10119 raft_consensus.cc:740] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.494421 10119 consensus_queue.cc:260] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.499979 10119 ts_tablet_manager.cc:1434] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 13:01:42.500782  9824 catalog_manager.cc:5697] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.502631 10119 tablet_bootstrap.cc:492] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:42.514602 10119 tablet_bootstrap.cc:654] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.522558 10119 tablet_bootstrap.cc:492] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:42.523089 10119 ts_tablet_manager.cc:1403] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:01:42.525833 10119 raft_consensus.cc:359] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.526430 10119 raft_consensus.cc:385] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.526610 10119 raft_consensus.cc:740] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.527232 10119 consensus_queue.cc:260] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.529402 10119 ts_tablet_manager.cc:1434] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:42.532485 10144 raft_consensus.cc:493] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.533304 10144 raft_consensus.cc:515] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.536746 10144 leader_election.cc:290] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.538712 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.539080 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.540448 10077 raft_consensus.cc:2393] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ef410dc10045dab7938ad6b81a54de in current term 1: Already voted for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in this term.
I20260709 13:01:42.542423  9892 leader_election.cc:304] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ef410dc10045dab7938ad6b81a54de; no voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:42.543388 10144 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.549080 10127 consensus_queue.cc:1048] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:42.553696 10127 raft_consensus.cc:493] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.554442 10127 raft_consensus.cc:515] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.555359 10144 raft_consensus.cc:2749] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.557065 10127 leader_election.cc:290] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.558465 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400a90a7d27c41418263df752a557d82" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.559185 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400a90a7d27c41418263df752a557d82" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.559664 10003 raft_consensus.cc:2393] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ef410dc10045dab7938ad6b81a54de in current term 1: Already voted for candidate 5ff5add82e9647bdbc8aa2945e012887 in this term.
I20260709 13:01:42.561378  9892 leader_election.cc:304] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ef410dc10045dab7938ad6b81a54de; no voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:42.562331 10127 raft_consensus.cc:3060] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.572929 10127 raft_consensus.cc:2749] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.579649 10179 consensus_queue.cc:1048] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:42.597267 10152 consensus_queue.cc:1048] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:42.603981 10179 raft_consensus.cc:493] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.604576 10179 raft_consensus.cc:515] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.607069 10179 leader_election.cc:290] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.608335 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.608807 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.609493 10077 raft_consensus.cc:2393] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ef410dc10045dab7938ad6b81a54de in current term 1: Already voted for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in this term.
I20260709 13:01:42.610868  9892 leader_election.cc:304] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ef410dc10045dab7938ad6b81a54de; no voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:42.611645 10179 raft_consensus.cc:3060] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.614408 10152 consensus_queue.cc:1048] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.631017 10179 raft_consensus.cc:2749] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.674822 10179 raft_consensus.cc:493] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.675573 10179 raft_consensus.cc:515] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.677670 10179 leader_election.cc:290] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.678530 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:42.678725 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:42.679317 10003 raft_consensus.cc:2468] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 0.
I20260709 13:01:42.679472 10077 raft_consensus.cc:2468] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 0.
I20260709 13:01:42.680445  9894 leader_election.cc:304] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:42.681141 10179 raft_consensus.cc:2804] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.681500 10179 raft_consensus.cc:493] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.681866 10179 raft_consensus.cc:3060] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.688093 10179 raft_consensus.cc:515] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.690022 10152 consensus_queue.cc:1048] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:42.690259 10179 leader_election.cc:290] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:42.691325 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:42.691399 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:42.692219 10003 raft_consensus.cc:3060] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.692288 10077 raft_consensus.cc:3060] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.702526 10003 raft_consensus.cc:2468] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 1.
I20260709 13:01:42.704290  9894 leader_election.cc:304] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:42.705487 10179 raft_consensus.cc:2804] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.706097 10179 raft_consensus.cc:697] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:42.706440 10077 raft_consensus.cc:2468] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 1.
I20260709 13:01:42.707472 10179 consensus_queue.cc:237] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:42.708175 10122 consensus_queue.cc:1048] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:42.720819  9823 catalog_manager.cc:5697] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.775626 10153 consensus_queue.cc:1048] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.789743 10153 consensus_queue.cc:1048] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.855090 10153 consensus_queue.cc:1048] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:42.868587 10152 consensus_queue.cc:1048] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.872452 10152 consensus_queue.cc:1048] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.888206 10152 consensus_queue.cc:1048] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.900300 10179 consensus_queue.cc:1048] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.912971 10144 consensus_queue.cc:1048] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.920058 10163 consensus_queue.cc:1048] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:42.937919 10149 consensus_queue.cc:1048] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.019263 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:57356
I20260709 13:01:43.020164 10001 raft_consensus.cc:606] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Received request to transfer leadership to TS c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:43.026093 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:57356
I20260709 13:01:43.026609 10001 raft_consensus.cc:606] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Received request to transfer leadership to TS c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:43.032065 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:57356
I20260709 13:01:43.032565 10001 raft_consensus.cc:606] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Received request to transfer leadership to TS c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:43.037825 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:57356
I20260709 13:01:43.038292 10001 raft_consensus.cc:606] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Received request to transfer leadership to TS c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:43.055589  9928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
mode: GRACEFUL
new_leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:32768
I20260709 13:01:43.056080  9928 raft_consensus.cc:606] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Received request to transfer leadership to TS 0a4416aa57914b21b9de80e6f47dc5a2
I20260709 13:01:43.061455  9928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
mode: GRACEFUL
new_leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:32768
I20260709 13:01:43.062026  9928 raft_consensus.cc:606] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Received request to transfer leadership to TS 0a4416aa57914b21b9de80e6f47dc5a2
I20260709 13:01:43.067260  9928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
mode: GRACEFUL
new_leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:32768
I20260709 13:01:43.067878  9928 raft_consensus.cc:606] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Received request to transfer leadership to TS 0a4416aa57914b21b9de80e6f47dc5a2
I20260709 13:01:43.138494 10155 raft_consensus.cc:993] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:43.138912 10152 raft_consensus.cc:1081] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Signalling peer c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:43.140407  9928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:60974
I20260709 13:01:43.140965  9928 raft_consensus.cc:493] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.141273  9928 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.147547  9928 raft_consensus.cc:515] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.149204  9928 leader_election.cc:290] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:43.150197 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:43.150363 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:43.150848 10001 raft_consensus.cc:3055] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.150981 10077 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.151228 10001 raft_consensus.cc:740] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:43.152158 10001 consensus_queue.cc:260] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.153153 10001 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.157061 10077 raft_consensus.cc:2468] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:43.158515  9892 leader_election.cc:304] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:43.159085 10001 raft_consensus.cc:2468] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:43.159262 10178 raft_consensus.cc:2804] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.159873 10178 raft_consensus.cc:697] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:43.160632 10178 consensus_queue.cc:237] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.167114  9823 catalog_manager.cc:5697] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 1 to 2, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.279672 10178 consensus_queue.cc:1048] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:43.287472 10144 raft_consensus.cc:993] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de: : Instructing follower 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:43.288103 10179 raft_consensus.cc:1081] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Signalling peer 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:43.290035 10003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:57338
I20260709 13:01:43.291285 10003 raft_consensus.cc:493] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.291689 10003 raft_consensus.cc:3060] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.293823 10178 consensus_queue.cc:1048] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.299186 10003 raft_consensus.cc:515] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.303596 10003 leader_election.cc:290] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:43.304849  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:43.305581  9928 raft_consensus.cc:3055] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.305919  9928 raft_consensus.cc:740] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:43.306954 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0c056cb3a14ba68e775d5b6d3f5013" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:43.306759  9928 consensus_queue.cc:260] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.307607 10077 raft_consensus.cc:3060] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.308153  9928 raft_consensus.cc:3060] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.314705  9928 raft_consensus.cc:2468] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:43.315002 10077 raft_consensus.cc:2468] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:43.315907  9967 leader_election.cc:304] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:43.316614 10152 raft_consensus.cc:2804] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.317025 10152 raft_consensus.cc:697] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:43.318208 10152 consensus_queue.cc:237] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.324481  9824 catalog_manager.cc:5697] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 1 to 2, leader changed from c5ef410dc10045dab7938ad6b81a54de (127.0.107.193) to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.328294 10153 raft_consensus.cc:993] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:43.328816 10153 raft_consensus.cc:1081] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Signalling peer c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:43.330394  9928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:60974
I20260709 13:01:43.330849  9928 raft_consensus.cc:493] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.331142  9928 raft_consensus.cc:3060] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.336526  9928 raft_consensus.cc:515] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.338380  9928 leader_election.cc:290] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:43.339324 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:43.339501 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cf85a08c5c48fc80b81d3f032490f3" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:43.340070 10077 raft_consensus.cc:3060] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.340085 10003 raft_consensus.cc:3055] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.340780 10003 raft_consensus.cc:740] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:43.341620 10003 consensus_queue.cc:260] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.342571 10003 raft_consensus.cc:3060] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.345361 10077 raft_consensus.cc:2468] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:43.346524  9892 leader_election.cc:304] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:43.347273 10178 raft_consensus.cc:2804] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.347757 10178 raft_consensus.cc:697] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:43.348233 10003 raft_consensus.cc:2468] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:43.348738 10178 consensus_queue.cc:237] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.355252  9824 catalog_manager.cc:5697] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 1 to 2, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.426272 10144 raft_consensus.cc:993] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de: : Instructing follower 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:43.426776 10178 raft_consensus.cc:1081] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Signalling peer 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:43.428506 10003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:57338
I20260709 13:01:43.428995 10003 raft_consensus.cc:493] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.429378 10003 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.434667 10003 raft_consensus.cc:515] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.436546 10003 leader_election.cc:290] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:43.437371  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:43.437997 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:43.438099  9928 raft_consensus.cc:3055] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.438548 10077 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.438644  9928 raft_consensus.cc:740] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:43.439602  9928 consensus_queue.cc:260] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.440752  9928 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.443351 10144 raft_consensus.cc:993] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de: : Instructing follower 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:43.443900 10178 raft_consensus.cc:1081] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Signalling peer 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:43.445391 10077 raft_consensus.cc:2468] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:43.445616 10003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:57338
I20260709 13:01:43.446286 10003 raft_consensus.cc:493] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.446537  9967 leader_election.cc:304] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:43.446651 10003 raft_consensus.cc:3060] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.447448 10153 raft_consensus.cc:2804] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.447727  9928 raft_consensus.cc:2468] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:43.447947 10153 raft_consensus.cc:697] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:43.449280 10153 consensus_queue.cc:237] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.454164 10003 raft_consensus.cc:515] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.456146 10003 leader_election.cc:290] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:43.457105 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:43.456890  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f312cc7eb448049390e2a4d3271b4f" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:43.456773  9824 catalog_manager.cc:5697] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 1 to 2, leader changed from c5ef410dc10045dab7938ad6b81a54de (127.0.107.193) to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.457670 10077 raft_consensus.cc:3060] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.457749  9928 raft_consensus.cc:3055] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.458237  9928 raft_consensus.cc:740] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:43.459440  9928 consensus_queue.cc:260] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.460624  9928 raft_consensus.cc:3060] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.465435 10077 raft_consensus.cc:2468] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:43.466745  9967 leader_election.cc:304] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:43.467787 10153 raft_consensus.cc:2804] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.468314 10153 raft_consensus.cc:697] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:43.468180  9928 raft_consensus.cc:2468] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:43.469390 10153 consensus_queue.cc:237] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.478425  9824 catalog_manager.cc:5697] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 1 to 2, leader changed from c5ef410dc10045dab7938ad6b81a54de (127.0.107.193) to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.480747 10153 raft_consensus.cc:993] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:43.481354 10153 raft_consensus.cc:1081] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Signalling peer c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:43.483392  9928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:60974
I20260709 13:01:43.484107  9928 raft_consensus.cc:493] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.484475  9928 raft_consensus.cc:3060] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.485882 10152 raft_consensus.cc:993] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:43.486419 10152 raft_consensus.cc:1081] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Signalling peer c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:43.488015  9926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:60974
I20260709 13:01:43.488510  9926 raft_consensus.cc:493] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.488869  9926 raft_consensus.cc:3060] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.491729  9928 raft_consensus.cc:515] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.494076  9928 leader_election.cc:290] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:43.494911 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:43.495654 10003 raft_consensus.cc:3055] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.495944 10003 raft_consensus.cc:740] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:43.496798 10003 consensus_queue.cc:260] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.498027 10003 raft_consensus.cc:3060] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.498939  9926 raft_consensus.cc:515] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:43.500995  9926 leader_election.cc:290] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:43.501716 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:43.502360 10001 raft_consensus.cc:3055] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.502480 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545f695bb62f4ab98cafcec11334ee77" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:43.502858 10001 raft_consensus.cc:740] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:43.503365 10076 raft_consensus.cc:3060] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.503939 10001 consensus_queue.cc:260] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:43.504423 10003 raft_consensus.cc:2468] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:43.505358 10001 raft_consensus.cc:3060] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.505625 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5a49e6b544ccd895fc7e575e4fd7c" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:43.506240 10077 raft_consensus.cc:3060] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.510495 10076 raft_consensus.cc:2468] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:43.510622  9894 leader_election.cc:304] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:43.511847 10144 raft_consensus.cc:2804] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.512368 10144 raft_consensus.cc:697] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:43.513020 10001 raft_consensus.cc:2468] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:43.513473 10144 consensus_queue.cc:237] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:43.514777 10077 raft_consensus.cc:2468] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:43.515321  9892 leader_election.cc:304] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:43.516160 10178 raft_consensus.cc:2804] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.516637 10178 raft_consensus.cc:697] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:43.517544 10178 consensus_queue.cc:237] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } }
I20260709 13:01:43.522073  9824 catalog_manager.cc:5697] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 1 to 2, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.534646  9824 catalog_manager.cc:5697] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 1 to 2, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.638770 10077 raft_consensus.cc:1275] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.640235 10178 consensus_queue.cc:1048] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.649094 10001 raft_consensus.cc:1275] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.651306 10179 consensus_queue.cc:1048] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.737900 10077 raft_consensus.cc:1275] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.739500 10179 consensus_queue.cc:1048] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.750396 10001 raft_consensus.cc:1275] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.751824 10179 consensus_queue.cc:1048] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.839241 10077 raft_consensus.cc:1275] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.840828 10153 consensus_queue.cc:1048] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.843546  9926 raft_consensus.cc:1275] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.844945 10153 consensus_queue.cc:1048] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.849702  9928 raft_consensus.cc:1275] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.851783 10152 consensus_queue.cc:1048] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:43.863389 10077 raft_consensus.cc:1275] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.865653 10152 consensus_queue.cc:1048] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.899036 10001 raft_consensus.cc:1275] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.900442 10179 consensus_queue.cc:1048] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.900624 10077 raft_consensus.cc:1275] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.902411 10179 consensus_queue.cc:1048] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.917250 10003 raft_consensus.cc:1275] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.919765 10178 consensus_queue.cc:1048] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:43.928007 10077 raft_consensus.cc:1275] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.929780 10144 consensus_queue.cc:1048] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.988956 10077 raft_consensus.cc:1275] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.990474 10152 consensus_queue.cc:1048] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:44.000419  9926 raft_consensus.cc:1275] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:44.002517 10152 consensus_queue.cc:1048] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:46.102049  9824 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55774:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:46.105517  9824 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:46.161512  9910 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5165b868fb4b15b54f22f1d971de60 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:46.162503  9986 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5165b868fb4b15b54f22f1d971de60 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:46.163189  9910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5165b868fb4b15b54f22f1d971de60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.164055  9986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5165b868fb4b15b54f22f1d971de60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.166720  9992 tablet_service.cc:1511] Processing CreateTablet for tablet 47a81067b5c74642b912118637af29b7 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:46.167014  9915 tablet_service.cc:1511] Processing CreateTablet for tablet 47a81067b5c74642b912118637af29b7 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:46.167526 10063 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5165b868fb4b15b54f22f1d971de60 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:46.168306  9992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a81067b5c74642b912118637af29b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.168579  9915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a81067b5c74642b912118637af29b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.169008 10063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5165b868fb4b15b54f22f1d971de60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.172503  9990 tablet_service.cc:1511] Processing CreateTablet for tablet 278d17900d094e649bcac70a49ec4b8c (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:46.174080  9990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278d17900d094e649bcac70a49ec4b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.174854 10065 tablet_service.cc:1511] Processing CreateTablet for tablet 47a81067b5c74642b912118637af29b7 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:46.176303 10065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a81067b5c74642b912118637af29b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.179114  9911 tablet_service.cc:1511] Processing CreateTablet for tablet dc62a30f6d3e494d9c28cc6a39129226 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:46.179781 10066 tablet_service.cc:1511] Processing CreateTablet for tablet 278d17900d094e649bcac70a49ec4b8c (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:46.181288 10066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278d17900d094e649bcac70a49ec4b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.183539  9989 tablet_service.cc:1511] Processing CreateTablet for tablet dc62a30f6d3e494d9c28cc6a39129226 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:46.185899  9916 tablet_service.cc:1511] Processing CreateTablet for tablet 278d17900d094e649bcac70a49ec4b8c (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:46.188990  9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc62a30f6d3e494d9c28cc6a39129226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.181411  9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc62a30f6d3e494d9c28cc6a39129226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.193971  9916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278d17900d094e649bcac70a49ec4b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.198308 10064 tablet_service.cc:1511] Processing CreateTablet for tablet dc62a30f6d3e494d9c28cc6a39129226 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:46.199923 10064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc62a30f6d3e494d9c28cc6a39129226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.202000  9912 tablet_service.cc:1511] Processing CreateTablet for tablet aeefcd5d290444af8fd2800ede0a0ba6 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:46.203598  9912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeefcd5d290444af8fd2800ede0a0ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.204560 10067 tablet_service.cc:1511] Processing CreateTablet for tablet aeefcd5d290444af8fd2800ede0a0ba6 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:46.206074 10067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeefcd5d290444af8fd2800ede0a0ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.207015  9988 tablet_service.cc:1511] Processing CreateTablet for tablet aeefcd5d290444af8fd2800ede0a0ba6 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:46.208644  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeefcd5d290444af8fd2800ede0a0ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.210848  9913 tablet_service.cc:1511] Processing CreateTablet for tablet 18b93c3871f9494f9a3263df6f9de19f (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:46.212335  9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b93c3871f9494f9a3263df6f9de19f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.213402  9917 tablet_service.cc:1511] Processing CreateTablet for tablet 2d947b5537e849b08325a8887b7f2348 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:46.215360  9917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d947b5537e849b08325a8887b7f2348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.209162  9987 tablet_service.cc:1511] Processing CreateTablet for tablet 18b93c3871f9494f9a3263df6f9de19f (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:46.218986  9987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b93c3871f9494f9a3263df6f9de19f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.217000 10062 tablet_service.cc:1511] Processing CreateTablet for tablet 18b93c3871f9494f9a3263df6f9de19f (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:46.226919 10062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b93c3871f9494f9a3263df6f9de19f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.228075  9991 tablet_service.cc:1511] Processing CreateTablet for tablet 2d947b5537e849b08325a8887b7f2348 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:46.230005 10061 tablet_service.cc:1511] Processing CreateTablet for tablet 2d947b5537e849b08325a8887b7f2348 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:46.231587 10061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d947b5537e849b08325a8887b7f2348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.231931  9991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d947b5537e849b08325a8887b7f2348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.234839  9993 tablet_service.cc:1511] Processing CreateTablet for tablet 83ec1d7eb4994b899b51e7a070a44fe1 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:46.236424  9993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ec1d7eb4994b899b51e7a070a44fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.233206  9918 tablet_service.cc:1511] Processing CreateTablet for tablet 83ec1d7eb4994b899b51e7a070a44fe1 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:46.237911  9918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ec1d7eb4994b899b51e7a070a44fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.242400 10060 tablet_service.cc:1511] Processing CreateTablet for tablet 83ec1d7eb4994b899b51e7a070a44fe1 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:46.243911 10060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ec1d7eb4994b899b51e7a070a44fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.244697  9914 tablet_service.cc:1511] Processing CreateTablet for tablet d265c668d96f474096e1fcf1b3881fe0 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:46.246104  9914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d265c668d96f474096e1fcf1b3881fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.247819  9985 tablet_service.cc:1511] Processing CreateTablet for tablet d265c668d96f474096e1fcf1b3881fe0 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:46.249279  9985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d265c668d96f474096e1fcf1b3881fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.298230 10059 tablet_service.cc:1511] Processing CreateTablet for tablet d265c668d96f474096e1fcf1b3881fe0 (DEFAULT_TABLE table=soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:46.299767 10059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d265c668d96f474096e1fcf1b3881fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.391842 10227 tablet_bootstrap.cc:492] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.400172 10228 tablet_bootstrap.cc:492] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.408066 10227 tablet_bootstrap.cc:654] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.413247 10226 tablet_bootstrap.cc:492] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:46.414331 10228 tablet_bootstrap.cc:654] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.425141 10228 tablet_bootstrap.cc:492] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:46.425688 10228 ts_tablet_manager.cc:1403] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.007s
I20260709 13:01:46.428776 10228 raft_consensus.cc:359] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.429634 10228 raft_consensus.cc:385] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.429970 10228 raft_consensus.cc:740] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.430820 10228 consensus_queue.cc:260] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.433547 10228 ts_tablet_manager.cc:1434] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:01:46.434785 10228 tablet_bootstrap.cc:492] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.435986 10226 tablet_bootstrap.cc:654] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.437662 10227 tablet_bootstrap.cc:492] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:46.438251 10227 ts_tablet_manager.cc:1403] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.005s
I20260709 13:01:46.441604 10227 raft_consensus.cc:359] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.442375 10227 raft_consensus.cc:385] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.442674 10227 raft_consensus.cc:740] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.443341 10228 tablet_bootstrap.cc:654] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.443427 10227 consensus_queue.cc:260] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.446125 10227 ts_tablet_manager.cc:1434] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:46.447182 10227 tablet_bootstrap.cc:492] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.454931 10227 tablet_bootstrap.cc:654] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.462213 10226 tablet_bootstrap.cc:492] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:46.463236 10226 ts_tablet_manager.cc:1403] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.021s
I20260709 13:01:46.465776 10228 tablet_bootstrap.cc:492] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:46.466192 10227 tablet_bootstrap.cc:492] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:46.466524 10228 ts_tablet_manager.cc:1403] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 13:01:46.466753 10227 ts_tablet_manager.cc:1403] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:01:46.466617 10226 raft_consensus.cc:359] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.467661 10226 raft_consensus.cc:385] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.467995 10226 raft_consensus.cc:740] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.468927 10226 consensus_queue.cc:260] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.470284 10227 raft_consensus.cc:359] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.471078 10227 raft_consensus.cc:385] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.470722 10228 raft_consensus.cc:359] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.471431 10227 raft_consensus.cc:740] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.471650 10228 raft_consensus.cc:385] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.472208 10227 consensus_queue.cc:260] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.472138 10228 raft_consensus.cc:740] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.473959 10226 ts_tablet_manager.cc:1434] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:01:46.474023 10228 consensus_queue.cc:260] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.474875 10227 ts_tablet_manager.cc:1434] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:46.475390 10226 tablet_bootstrap.cc:492] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:46.475884 10227 tablet_bootstrap.cc:492] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.477314 10228 ts_tablet_manager.cc:1434] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:46.478436 10228 tablet_bootstrap.cc:492] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.483372 10227 tablet_bootstrap.cc:654] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.483428 10226 tablet_bootstrap.cc:654] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.486706 10228 tablet_bootstrap.cc:654] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.516969 10227 tablet_bootstrap.cc:492] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:46.517755 10227 ts_tablet_manager.cc:1403] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.004s
I20260709 13:01:46.522667 10227 raft_consensus.cc:359] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.524163 10227 raft_consensus.cc:385] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.524573 10227 raft_consensus.cc:740] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.525790 10227 consensus_queue.cc:260] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.529435 10227 ts_tablet_manager.cc:1434] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:01:46.532327 10227 tablet_bootstrap.cc:492] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.533336 10228 tablet_bootstrap.cc:492] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:46.533371 10226 tablet_bootstrap.cc:492] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:46.534192 10228 ts_tablet_manager.cc:1403] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.056s	user 0.034s	sys 0.014s
I20260709 13:01:46.534216 10226 ts_tablet_manager.cc:1403] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.019s
I20260709 13:01:46.537649 10228 raft_consensus.cc:359] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.538635 10228 raft_consensus.cc:385] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.538990 10228 raft_consensus.cc:740] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.539355 10227 tablet_bootstrap.cc:654] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.540007 10228 consensus_queue.cc:260] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.540867 10226 raft_consensus.cc:359] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.541635 10226 raft_consensus.cc:385] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.541934 10226 raft_consensus.cc:740] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.542846 10228 ts_tablet_manager.cc:1434] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:01:46.542686 10226 consensus_queue.cc:260] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.543994 10228 tablet_bootstrap.cc:492] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.549124 10226 ts_tablet_manager.cc:1434] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:01:46.550689 10226 tablet_bootstrap.cc:492] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:46.551645 10228 tablet_bootstrap.cc:654] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.560839 10227 tablet_bootstrap.cc:492] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:46.561393 10227 ts_tablet_manager.cc:1403] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:01:46.561956 10226 tablet_bootstrap.cc:654] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.563907 10228 tablet_bootstrap.cc:492] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:46.564498 10228 ts_tablet_manager.cc:1403] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:01:46.564728 10227 raft_consensus.cc:359] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.566169 10227 raft_consensus.cc:385] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.566627 10227 raft_consensus.cc:740] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.567572 10227 consensus_queue.cc:260] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.568182 10228 raft_consensus.cc:359] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.569140 10228 raft_consensus.cc:385] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.569535 10228 raft_consensus.cc:740] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.570411 10227 ts_tablet_manager.cc:1434] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:46.570323 10228 consensus_queue.cc:260] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.571514 10227 tablet_bootstrap.cc:492] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.573077 10228 ts_tablet_manager.cc:1434] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:01:46.574250 10228 tablet_bootstrap.cc:492] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.575801 10226 tablet_bootstrap.cc:492] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:46.576469 10226 ts_tablet_manager.cc:1403] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.008s
I20260709 13:01:46.578527 10227 tablet_bootstrap.cc:654] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.580768 10226 raft_consensus.cc:359] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.581419 10228 tablet_bootstrap.cc:654] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.581687 10226 raft_consensus.cc:385] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.582062 10226 raft_consensus.cc:740] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.582981 10226 consensus_queue.cc:260] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.591513 10214 raft_consensus.cc:493] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.592010 10214 raft_consensus.cc:515] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.594313 10214 leader_election.cc:290] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:46.597374 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeefcd5d290444af8fd2800ede0a0ba6" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
W20260709 13:01:46.601987  9892 leader_election.cc:343] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.603137 10226 ts_tablet_manager.cc:1434] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:01:46.608448 10226 tablet_bootstrap.cc:492] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:46.609512 10228 tablet_bootstrap.cc:492] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:46.610137 10228 ts_tablet_manager.cc:1403] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.004s
I20260709 13:01:46.615703 10228 raft_consensus.cc:359] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.616282 10228 raft_consensus.cc:385] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.616145 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeefcd5d290444af8fd2800ede0a0ba6" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:46.616706 10228 raft_consensus.cc:740] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.616947 10003 raft_consensus.cc:2468] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 0.
I20260709 13:01:46.617725 10226 tablet_bootstrap.cc:654] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.617437 10228 consensus_queue.cc:260] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.618719 10227 tablet_bootstrap.cc:492] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:46.619293 10227 ts_tablet_manager.cc:1403] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.013s
I20260709 13:01:46.620055 10228 ts_tablet_manager.cc:1434] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:01:46.620316  9894 leader_election.cc:304] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:46.621126 10228 tablet_bootstrap.cc:492] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.621407 10242 raft_consensus.cc:2804] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.621927 10242 raft_consensus.cc:493] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.622284 10242 raft_consensus.cc:3060] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.628459 10228 tablet_bootstrap.cc:654] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.632769 10242 raft_consensus.cc:515] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.636065 10242 leader_election.cc:290] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:46.639907 10227 raft_consensus.cc:359] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.641239 10227 raft_consensus.cc:385] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.641731 10227 raft_consensus.cc:740] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.642884 10227 consensus_queue.cc:260] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.646332 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeefcd5d290444af8fd2800ede0a0ba6" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:46.646467 10227 ts_tablet_manager.cc:1434] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.005s
I20260709 13:01:46.647011 10001 raft_consensus.cc:3060] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.653752 10227 tablet_bootstrap.cc:492] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.663276 10205 raft_consensus.cc:493] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.664108 10205 raft_consensus.cc:515] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.669708 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5165b868fb4b15b54f22f1d971de60" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:46.670686 10227 tablet_bootstrap.cc:654] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.670672 10077 raft_consensus.cc:2468] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:46.672792  9967 leader_election.cc:304] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:46.673660 10205 leader_election.cc:290] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:46.677608 10246 raft_consensus.cc:2804] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.678045 10246 raft_consensus.cc:493] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.678473 10246 raft_consensus.cc:3060] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.681313 10202 raft_consensus.cc:493] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.682066 10202 raft_consensus.cc:515] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.686450 10202 leader_election.cc:290] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:46.688089 10248 raft_consensus.cc:493] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.688653 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:46.688720 10248 raft_consensus.cc:515] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.689586 10003 raft_consensus.cc:2468] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:46.692598 10043 leader_election.cc:304] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
W20260709 13:01:46.694900  9892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35073, user_credentials={real_user=slave}} blocked reactor thread for 61546.1us
I20260709 13:01:46.696676  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:46.697201 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeefcd5d290444af8fd2800ede0a0ba6" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:46.698041 10202 raft_consensus.cc:2804] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.698519 10202 raft_consensus.cc:493] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.698879 10202 raft_consensus.cc:3060] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.700701  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5165b868fb4b15b54f22f1d971de60" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
W20260709 13:01:46.702260 10041 leader_election.cc:343] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:46.706248  9967 leader_election.cc:343] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.707453 10202 raft_consensus.cc:515] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
W20260709 13:01:46.707954  9892 leader_election.cc:343] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.661335 10001 raft_consensus.cc:2468] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 1.
I20260709 13:01:46.711037 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:46.711876 10003 raft_consensus.cc:3060] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.712025 10248 leader_election.cc:290] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:46.715612 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
W20260709 13:01:46.717922  9967 leader_election.cc:343] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.718405  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:46.715857 10202 leader_election.cc:290] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
W20260709 13:01:46.720613 10041 leader_election.cc:343] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.722733  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:46.725140  9894 leader_election.cc:304] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:46.727049 10242 raft_consensus.cc:2804] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.727813 10242 raft_consensus.cc:697] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:46.729051 10242 consensus_queue.cc:237] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.743999 10245 raft_consensus.cc:493] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.754132  9967 leader_election.cc:343] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.758881  9967 leader_election.cc:304] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2; no voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:46.760931 10202 raft_consensus.cc:493] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.761637 10248 raft_consensus.cc:2749] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.761672 10202 raft_consensus.cc:515] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.759811 10245 raft_consensus.cc:515] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.764377 10246 raft_consensus.cc:515] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.765506 10245 leader_election.cc:290] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:46.766408 10002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:46.768563 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:46.767009 10202 leader_election.cc:290] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
W20260709 13:01:46.769404  9894 leader_election.cc:343] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.769443  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
W20260709 13:01:46.770498  9892 leader_election.cc:343] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.771098  9892 leader_election.cc:304] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ef410dc10045dab7938ad6b81a54de; no voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:46.771747 10245 raft_consensus.cc:2749] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.770448  9926 raft_consensus.cc:2468] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:46.772485 10227 tablet_bootstrap.cc:492] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:46.767107 10228 tablet_bootstrap.cc:492] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:46.768671 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:46.772681 10003 raft_consensus.cc:2468] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
I20260709 13:01:46.775328  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5165b868fb4b15b54f22f1d971de60" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:46.773031 10227 ts_tablet_manager.cc:1403] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.125s	user 0.036s	sys 0.033s
I20260709 13:01:46.776242 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5165b868fb4b15b54f22f1d971de60" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:46.776878 10077 raft_consensus.cc:3060] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:46.777181  9967 leader_election.cc:343] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.773293 10041 leader_election.cc:304] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:46.779755 10227 raft_consensus.cc:359] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
W20260709 13:01:46.780438 10043 leader_election.cc:343] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.780529 10227 raft_consensus.cc:385] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.781004 10227 raft_consensus.cc:740] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.781972 10227 consensus_queue.cc:260] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.783702 10043 leader_election.cc:304] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:46.784511 10227 ts_tablet_manager.cc:1434] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:46.785356 10202 raft_consensus.cc:2804] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.785794 10227 tablet_bootstrap.cc:492] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.789974  9824 catalog_manager.cc:5697] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.793282 10227 tablet_bootstrap.cc:654] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.795764 10250 raft_consensus.cc:2804] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.765522 10226 tablet_bootstrap.cc:492] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:46.773548 10228 ts_tablet_manager.cc:1403] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.153s	user 0.048s	sys 0.084s
I20260709 13:01:46.797771 10226 ts_tablet_manager.cc:1403] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.190s	user 0.041s	sys 0.050s
I20260709 13:01:46.801245 10228 raft_consensus.cc:359] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.785846 10202 raft_consensus.cc:493] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.802067 10228 raft_consensus.cc:385] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.802155 10202 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.802382 10226 raft_consensus.cc:359] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.803290 10226 raft_consensus.cc:385] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.803643 10226 raft_consensus.cc:740] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.804041 10077 raft_consensus.cc:2468] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:46.774391 10246 leader_election.cc:290] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:46.804699 10226 consensus_queue.cc:260] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.805914  9967 leader_election.cc:304] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:46.806779 10246 raft_consensus.cc:2804] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.807466 10246 raft_consensus.cc:697] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:46.808071 10226 ts_tablet_manager.cc:1434] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:46.808424 10246 consensus_queue.cc:237] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.809146 10226 tablet_bootstrap.cc:492] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:46.802399 10228 raft_consensus.cc:740] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.810735 10228 consensus_queue.cc:260] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.812836 10202 raft_consensus.cc:515] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.819872 10246 raft_consensus.cc:493] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.820533 10246 raft_consensus.cc:515] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.822472 10226 tablet_bootstrap.cc:654] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.823961  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a81067b5c74642b912118637af29b7" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:46.813961 10250 raft_consensus.cc:697] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:46.825879 10250 consensus_queue.cc:237] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
W20260709 13:01:46.826285  9967 leader_election.cc:343] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.827764 10228 ts_tablet_manager.cc:1434] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:01:46.828599  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:46.829188 10228 tablet_bootstrap.cc:492] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.829306  9928 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.831012  9823 catalog_manager.cc:5697] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.833096 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:46.833817 10003 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.836817 10228 tablet_bootstrap.cc:654] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.841269 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a81067b5c74642b912118637af29b7" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:46.841831 10003 raft_consensus.cc:2468] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
W20260709 13:01:46.843389  9967 leader_election.cc:343] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.843858  9967 leader_election.cc:304] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2; no voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:46.844269  9928 raft_consensus.cc:2468] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
I20260709 13:01:46.844924 10248 raft_consensus.cc:2749] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.847327 10041 leader_election.cc:304] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:46.842692 10202 leader_election.cc:290] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:46.848420 10202 raft_consensus.cc:2804] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.849460 10227 tablet_bootstrap.cc:492] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:46.850857 10227 ts_tablet_manager.cc:1403] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.009s
I20260709 13:01:46.842334 10246 leader_election.cc:290] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:46.852288 10202 raft_consensus.cc:697] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:46.856886 10226 tablet_bootstrap.cc:492] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:46.857496 10226 ts_tablet_manager.cc:1403] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.008s
I20260709 13:01:46.857146 10202 consensus_queue.cc:237] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.857831 10227 raft_consensus.cc:359] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.861299 10226 raft_consensus.cc:359] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.868472 10227 raft_consensus.cc:385] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.870043 10227 raft_consensus.cc:740] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.871109 10227 consensus_queue.cc:260] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.872164  9824 catalog_manager.cc:5697] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.875031 10227 ts_tablet_manager.cc:1434] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 13:01:46.876713 10226 raft_consensus.cc:385] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.880209 10226 raft_consensus.cc:740] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.882160 10227 tablet_bootstrap.cc:492] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.885434 10228 tablet_bootstrap.cc:492] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:46.886214 10228 ts_tablet_manager.cc:1403] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.020s
I20260709 13:01:46.881115 10226 consensus_queue.cc:260] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.889312 10228 raft_consensus.cc:359] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.890058 10228 raft_consensus.cc:385] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.890285 10226 ts_tablet_manager.cc:1434] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:01:46.890340 10228 raft_consensus.cc:740] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.891557 10226 tablet_bootstrap.cc:492] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:46.898818 10226 tablet_bootstrap.cc:654] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.901811 10227 tablet_bootstrap.cc:654] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.891463 10228 consensus_queue.cc:260] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.902900  9826 catalog_manager.cc:5697] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.908313 10227 tablet_bootstrap.cc:492] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:46.908674 10228 ts_tablet_manager.cc:1434] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:01:46.908975 10227 ts_tablet_manager.cc:1403] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.007s
I20260709 13:01:46.909932 10228 tablet_bootstrap.cc:492] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.910909 10226 tablet_bootstrap.cc:492] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:46.911480 10226 ts_tablet_manager.cc:1403] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.006s
I20260709 13:01:46.912297 10227 raft_consensus.cc:359] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.913128 10227 raft_consensus.cc:385] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.913443 10227 raft_consensus.cc:740] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.914304 10227 consensus_queue.cc:260] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.915480 10226 raft_consensus.cc:359] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.916262 10226 raft_consensus.cc:385] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.916540 10226 raft_consensus.cc:740] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.917316 10226 consensus_queue.cc:260] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.918092 10228 tablet_bootstrap.cc:654] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.919587 10202 raft_consensus.cc:493] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.920089 10202 raft_consensus.cc:515] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.922417 10202 leader_election.cc:290] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:46.924328  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:46.925810 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:46.926693 10003 raft_consensus.cc:2468] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
W20260709 13:01:46.928275 10041 leader_election.cc:343] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.930341 10043 leader_election.cc:304] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:46.933050 10227 ts_tablet_manager.cc:1434] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.007s
I20260709 13:01:46.933481 10226 ts_tablet_manager.cc:1434] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.005s
I20260709 13:01:46.934643 10226 tablet_bootstrap.cc:492] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:46.936995 10202 raft_consensus.cc:2804] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.938053 10202 raft_consensus.cc:493] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.939145 10202 raft_consensus.cc:3060] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.952648 10202 raft_consensus.cc:515] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.953544 10227 tablet_bootstrap.cc:492] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2: Bootstrap starting.
I20260709 13:01:46.955039 10226 tablet_bootstrap.cc:654] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.961089 10246 raft_consensus.cc:493] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.961621 10246 raft_consensus.cc:515] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.963768 10246 leader_election.cc:290] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:46.955837 10228 tablet_bootstrap.cc:492] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:46.965507 10228 ts_tablet_manager.cc:1403] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.025s
I20260709 13:01:46.959810 10202 leader_election.cc:290] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:46.959964  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:46.960404 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:46.967839 10003 raft_consensus.cc:3060] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.969628 10228 raft_consensus.cc:359] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.966365 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d265c668d96f474096e1fcf1b3881fe0" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:46.966346  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d265c668d96f474096e1fcf1b3881fe0" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:46.977074 10077 raft_consensus.cc:2468] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:46.977664 10227 tablet_bootstrap.cc:654] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.977473  9926 raft_consensus.cc:2468] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:46.978785  9967 leader_election.cc:304] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:46.979813 10246 raft_consensus.cc:2804] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:01:46.977061 10041 leader_election.cc:343] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.980388 10246 raft_consensus.cc:493] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.976812 10228 raft_consensus.cc:385] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.981220 10246 raft_consensus.cc:3060] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.981902 10228 raft_consensus.cc:740] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.983261 10228 consensus_queue.cc:260] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:46.986590 10228 ts_tablet_manager.cc:1434] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:01:46.988027 10228 tablet_bootstrap.cc:492] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887: Bootstrap starting.
I20260709 13:01:46.991621 10003 raft_consensus.cc:2468] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
I20260709 13:01:46.996104 10228 tablet_bootstrap.cc:654] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.999339 10043 leader_election.cc:304] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:47.001027 10202 raft_consensus.cc:2804] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.002345 10202 raft_consensus.cc:697] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.003746 10202 consensus_queue.cc:237] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.008874 10227 tablet_bootstrap.cc:492] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2: No bootstrap required, opened a new log
I20260709 13:01:47.009475 10227 ts_tablet_manager.cc:1403] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.000s
I20260709 13:01:47.010059 10228 tablet_bootstrap.cc:492] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887: No bootstrap required, opened a new log
I20260709 13:01:47.010625 10228 ts_tablet_manager.cc:1403] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 13:01:47.012809 10227 raft_consensus.cc:359] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.013739 10227 raft_consensus.cc:385] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.013629 10228 raft_consensus.cc:359] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.014137 10227 raft_consensus.cc:740] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.012738 10246 raft_consensus.cc:515] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.014580 10228 raft_consensus.cc:385] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.015067 10227 consensus_queue.cc:260] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.015899 10228 raft_consensus.cc:740] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.016870 10228 consensus_queue.cc:260] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.019137 10228 ts_tablet_manager.cc:1434] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:47.020133 10226 tablet_bootstrap.cc:492] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:47.019913  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d265c668d96f474096e1fcf1b3881fe0" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.020618  9926 raft_consensus.cc:3060] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.020689 10226 ts_tablet_manager.cc:1403] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.086s	user 0.047s	sys 0.006s
I20260709 13:01:47.024075 10226 raft_consensus.cc:359] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.024799 10226 raft_consensus.cc:385] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.025069 10226 raft_consensus.cc:740] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.026649 10227 ts_tablet_manager.cc:1434] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:01:47.025949 10226 consensus_queue.cc:260] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.030275  9926 raft_consensus.cc:2468] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:47.031561 10226 ts_tablet_manager.cc:1434] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:47.031678  9967 leader_election.cc:304] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.032724 10248 raft_consensus.cc:2804] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.032889 10226 tablet_bootstrap.cc:492] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:47.033252 10248 raft_consensus.cc:697] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.034237 10248 consensus_queue.cc:237] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.039232 10246 leader_election.cc:290] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.040289 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d265c668d96f474096e1fcf1b3881fe0" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.040546 10226 tablet_bootstrap.cc:654] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.040934 10077 raft_consensus.cc:3060] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.051898 10226 tablet_bootstrap.cc:492] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:47.052486 10226 ts_tablet_manager.cc:1403] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 13:01:47.052726 10245 raft_consensus.cc:493] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.053601 10245 raft_consensus.cc:515] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
W20260709 13:01:47.055001  9874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:47.055778 10245 leader_election.cc:290] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.052412 10077 raft_consensus.cc:2468] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:47.055785  9824 catalog_manager.cc:5697] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.057026 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:47.058701 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:47.059348 10003 raft_consensus.cc:2393] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ef410dc10045dab7938ad6b81a54de in current term 1: Already voted for candidate 5ff5add82e9647bdbc8aa2945e012887 in this term.
I20260709 13:01:47.060489  9894 leader_election.cc:304] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ef410dc10045dab7938ad6b81a54de; no voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:47.061374 10245 raft_consensus.cc:3060] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.062366 10226 raft_consensus.cc:359] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.063203 10226 raft_consensus.cc:385] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.063452 10226 raft_consensus.cc:740] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.064204 10226 consensus_queue.cc:260] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.066423 10226 ts_tablet_manager.cc:1434] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:01:47.067305 10226 tablet_bootstrap.cc:492] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de: Bootstrap starting.
I20260709 13:01:47.068351  9826 catalog_manager.cc:5697] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.073073 10245 raft_consensus.cc:2749] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.075861 10226 tablet_bootstrap.cc:654] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.082185 10202 raft_consensus.cc:493] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.082432 10226 tablet_bootstrap.cc:492] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de: No bootstrap required, opened a new log
I20260709 13:01:47.082968 10226 ts_tablet_manager.cc:1403] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:01:47.082772 10202 raft_consensus.cc:515] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.085774 10202 leader_election.cc:290] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:47.085997  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:47.085920 10226 raft_consensus.cc:359] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.086771 10226 raft_consensus.cc:385] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.086776  9926 raft_consensus.cc:2468] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:47.087088 10226 raft_consensus.cc:740] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.087116 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:47.087771 10003 raft_consensus.cc:2468] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:47.087873 10226 consensus_queue.cc:260] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.088316 10041 leader_election.cc:304] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.089146 10202 raft_consensus.cc:2804] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.089473 10202 raft_consensus.cc:493] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.089776 10202 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.090180 10226 ts_tablet_manager.cc:1434] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:47.095865 10202 raft_consensus.cc:515] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.096477 10250 raft_consensus.cc:493] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.096988 10250 raft_consensus.cc:515] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.098438 10202 leader_election.cc:290] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:47.099056 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:47.099494  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.099622 10003 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.099718  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a81067b5c74642b912118637af29b7" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:47.100047  9926 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.100415  9928 raft_consensus.cc:2468] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:47.099071 10250 leader_election.cc:290] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:47.101625 10041 leader_election.cc:304] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.101890 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a81067b5c74642b912118637af29b7" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:47.102622 10001 raft_consensus.cc:2468] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 0.
I20260709 13:01:47.106137  9926 raft_consensus.cc:2468] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
I20260709 13:01:47.107336 10250 raft_consensus.cc:2804] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.108215 10250 raft_consensus.cc:493] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.107767 10041 leader_election.cc:304] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.108879 10250 raft_consensus.cc:3060] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.109383 10202 raft_consensus.cc:2804] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.110018 10202 raft_consensus.cc:697] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.111199 10202 consensus_queue.cc:237] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.107640 10003 raft_consensus.cc:2468] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
I20260709 13:01:47.118021 10250 raft_consensus.cc:515] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.120182 10250 leader_election.cc:290] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:47.121122  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a81067b5c74642b912118637af29b7" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.121408 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a81067b5c74642b912118637af29b7" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:47.121031  9823 catalog_manager.cc:5697] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.122090  9926 raft_consensus.cc:3060] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.122167 10003 raft_consensus.cc:3060] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.127895 10003 raft_consensus.cc:2468] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
I20260709 13:01:47.128969 10043 leader_election.cc:304] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:47.129474  9926 raft_consensus.cc:2468] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 1.
I20260709 13:01:47.130045 10250 raft_consensus.cc:2804] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.130640 10250 raft_consensus.cc:697] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.131613 10250 consensus_queue.cc:237] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.139636  9823 catalog_manager.cc:5697] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.182991 10077 raft_consensus.cc:3060] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.189417 10242 consensus_queue.cc:1048] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.205731 10242 consensus_queue.cc:1048] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:47.239841 10248 consensus_queue.cc:1048] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.251960  9926 raft_consensus.cc:3060] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.264936 10205 consensus_queue.cc:1048] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:47.266628 10205 raft_consensus.cc:493] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.267100 10205 raft_consensus.cc:515] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.269074 10205 leader_election.cc:290] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.269721  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de" is_pre_election: true
I20260709 13:01:47.270447  9928 raft_consensus.cc:2468] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:47.270898 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:47.271517 10077 raft_consensus.cc:2468] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 0.
I20260709 13:01:47.272498  9967 leader_election.cc:304] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:47.273794 10205 raft_consensus.cc:2804] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.274192 10205 raft_consensus.cc:493] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.274580 10205 raft_consensus.cc:3060] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.282074 10205 raft_consensus.cc:515] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.284142 10205 leader_election.cc:290] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.285373  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.285672 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.286335  9926 raft_consensus.cc:3060] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.286430 10077 raft_consensus.cc:3060] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.291744 10077 raft_consensus.cc:2468] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:47.292764  9926 raft_consensus.cc:2468] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 1.
I20260709 13:01:47.293210  9967 leader_election.cc:304] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:47.294062 10205 raft_consensus.cc:2804] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.294555 10205 raft_consensus.cc:697] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.295277 10205 consensus_queue.cc:237] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.298354 10250 consensus_queue.cc:1048] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.303787  9826 catalog_manager.cc:5697] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.315232 10252 consensus_queue.cc:1048] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:47.316607 10250 consensus_queue.cc:1048] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:47.327188 10242 raft_consensus.cc:493] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.327719 10242 raft_consensus.cc:515] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.331657 10242 leader_election.cc:290] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.332872 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff5add82e9647bdbc8aa2945e012887" is_pre_election: true
I20260709 13:01:47.335232 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" is_pre_election: true
I20260709 13:01:47.336076 10001 raft_consensus.cc:2393] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ef410dc10045dab7938ad6b81a54de in current term 1: Already voted for candidate 5ff5add82e9647bdbc8aa2945e012887 in this term.
I20260709 13:01:47.338514  9892 leader_election.cc:304] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ef410dc10045dab7938ad6b81a54de; no voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:47.339241 10242 raft_consensus.cc:3060] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.342012 10202 consensus_queue.cc:1048] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.348251 10242 raft_consensus.cc:2749] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.401963 10202 consensus_queue.cc:1048] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.413173 10202 consensus_queue.cc:1048] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.441922 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d5165b868fb4b15b54f22f1d971de60"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:57356
I20260709 13:01:47.442513 10001 raft_consensus.cc:606] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Received request to transfer leadership to TS c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:47.457670 10076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47a81067b5c74642b912118637af29b7"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
mode: GRACEFUL
new_leader_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:37354
I20260709 13:01:47.458276 10076 raft_consensus.cc:606] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Received request to transfer leadership to TS c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:47.464087 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:57356
I20260709 13:01:47.464586 10001 raft_consensus.cc:606] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Received request to transfer leadership to TS c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:47.470417 10248 consensus_queue.cc:1048] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.470538 10076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
mode: GRACEFUL
new_leader_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:37354
I20260709 13:01:47.471261 10076 raft_consensus.cc:606] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Received request to transfer leadership to TS c5ef410dc10045dab7938ad6b81a54de
I20260709 13:01:47.477626  9928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeefcd5d290444af8fd2800ede0a0ba6"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
mode: GRACEFUL
new_leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:32768
I20260709 13:01:47.478277  9928 raft_consensus.cc:606] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Received request to transfer leadership to TS 0a4416aa57914b21b9de80e6f47dc5a2
I20260709 13:01:47.484961 10077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
mode: GRACEFUL
new_leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:37354
I20260709 13:01:47.485536 10077 raft_consensus.cc:606] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Received request to transfer leadership to TS 0a4416aa57914b21b9de80e6f47dc5a2
I20260709 13:01:47.486537 10246 consensus_queue.cc:1048] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.492244 10076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
mode: GRACEFUL
new_leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:37354
I20260709 13:01:47.492799 10076 raft_consensus.cc:606] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Received request to transfer leadership to TS 0a4416aa57914b21b9de80e6f47dc5a2
I20260709 13:01:47.499668 10076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
mode: GRACEFUL
new_leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:37354
I20260709 13:01:47.500293 10076 raft_consensus.cc:606] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Received request to transfer leadership to TS 0a4416aa57914b21b9de80e6f47dc5a2
I20260709 13:01:47.506955 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d265c668d96f474096e1fcf1b3881fe0"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:57356
I20260709 13:01:47.507504 10001 raft_consensus.cc:606] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Received request to transfer leadership to TS 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:47.602638 10245 raft_consensus.cc:993] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de: : Instructing follower 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:47.603106 10242 raft_consensus.cc:1081] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Signalling peer 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:47.604687 10001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeefcd5d290444af8fd2800ede0a0ba6"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:57338
I20260709 13:01:47.605199 10001 raft_consensus.cc:493] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.605590 10001 raft_consensus.cc:3060] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.610975 10001 raft_consensus.cc:515] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.612669 10001 leader_election.cc:290] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.613739  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeefcd5d290444af8fd2800ede0a0ba6" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.613951 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeefcd5d290444af8fd2800ede0a0ba6" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.614341  9928 raft_consensus.cc:3055] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.614533 10076 raft_consensus.cc:3060] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.614722  9928 raft_consensus.cc:740] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:47.615754  9928 consensus_queue.cc:260] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.617057  9928 raft_consensus.cc:3060] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.620795 10076 raft_consensus.cc:2468] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:47.622205  9967 leader_election.cc:304] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:47.622357  9928 raft_consensus.cc:2468] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:47.623116 10205 raft_consensus.cc:2804] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.623627 10205 raft_consensus.cc:697] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.624456 10205 consensus_queue.cc:237] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.631788  9826 catalog_manager.cc:5697] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 1 to 2, leader changed from c5ef410dc10045dab7938ad6b81a54de (127.0.107.193) to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.634217 10202 consensus_queue.cc:1048] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:47.645825 10252 consensus_queue.cc:1048] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.653990 10202 raft_consensus.cc:993] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887: : Instructing follower 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:47.654546 10202 raft_consensus.cc:1081] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Signalling peer 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:47.656204 10001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:57352
I20260709 13:01:47.656805 10001 raft_consensus.cc:493] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.657115 10001 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.663197 10001 raft_consensus.cc:515] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.665658 10001 leader_election.cc:290] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.665912  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.667137  9928 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.667550 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.668187 10077 raft_consensus.cc:3055] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.668485 10077 raft_consensus.cc:740] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.669229 10077 consensus_queue.cc:260] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.670415 10077 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.674623  9928 raft_consensus.cc:2468] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:47.675892  9967 leader_election.cc:304] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.676781 10205 raft_consensus.cc:2804] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.676987 10246 consensus_queue.cc:1048] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.677340 10205 raft_consensus.cc:697] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.677553 10077 raft_consensus.cc:2468] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:47.678277 10205 consensus_queue.cc:237] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.688293 10246 consensus_queue.cc:1048] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.688864  9826 catalog_manager.cc:5697] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 1 to 2, leader changed from 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195) to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.698752 10292 raft_consensus.cc:993] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:47.699257 10246 raft_consensus.cc:1081] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Signalling peer c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:47.701733  9928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:60974
I20260709 13:01:47.702425  9928 raft_consensus.cc:493] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.702803  9928 raft_consensus.cc:3060] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.709695 10252 raft_consensus.cc:993] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887: : Instructing follower 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:47.710289 10202 raft_consensus.cc:1081] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Signalling peer 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:47.709784  9928 raft_consensus.cc:515] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.712044  9928 leader_election.cc:290] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.712781 10001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:57352
I20260709 13:01:47.712841 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:47.713027 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278d17900d094e649bcac70a49ec4b8c" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.713682 10003 raft_consensus.cc:3055] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.714058 10077 raft_consensus.cc:3060] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.714107 10003 raft_consensus.cc:740] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.715137 10003 consensus_queue.cc:260] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.716078 10003 raft_consensus.cc:3060] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.717801 10001 raft_consensus.cc:493] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.718206 10001 raft_consensus.cc:3060] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.719337 10077 raft_consensus.cc:2468] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:47.720460  9892 leader_election.cc:304] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.721324 10242 raft_consensus.cc:2804] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.721685 10003 raft_consensus.cc:2468] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:47.722002 10242 raft_consensus.cc:697] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:47.722922 10242 consensus_queue.cc:237] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.725013 10001 raft_consensus.cc:515] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.727157 10001 leader_election.cc:290] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.728473  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.729111  9926 raft_consensus.cc:3060] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.731591 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d947b5537e849b08325a8887b7f2348" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.732224 10076 raft_consensus.cc:3055] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.732555 10076 raft_consensus.cc:740] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.733460 10076 consensus_queue.cc:260] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.735261 10076 raft_consensus.cc:3060] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.734565  9824 catalog_manager.cc:5697] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 1 to 2, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.735540  9926 raft_consensus.cc:2468] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:47.736757  9967 leader_election.cc:304] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.737404 10246 raft_consensus.cc:2804] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.737924 10246 raft_consensus.cc:697] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.738735 10246 consensus_queue.cc:237] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.745530 10076 raft_consensus.cc:2468] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:47.748370  9823 catalog_manager.cc:5697] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 1 to 2, leader changed from 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195) to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.756489 10252 consensus_queue.cc:1048] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:47.758746 10252 consensus_queue.cc:1048] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.772509 10202 raft_consensus.cc:993] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887: : Instructing follower c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:47.773068 10250 raft_consensus.cc:1081] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Signalling peer c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:47.775326  9928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47a81067b5c74642b912118637af29b7"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:60986
I20260709 13:01:47.777446  9928 raft_consensus.cc:493] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.777890 10205 raft_consensus.cc:993] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:47.777887  9928 raft_consensus.cc:3060] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.778581 10246 raft_consensus.cc:1081] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Signalling peer c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:47.780570  9926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d5165b868fb4b15b54f22f1d971de60"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:60974
I20260709 13:01:47.781253  9926 raft_consensus.cc:493] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.781726  9926 raft_consensus.cc:3060] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.786445  9928 raft_consensus.cc:515] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.790230  9926 raft_consensus.cc:515] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.792420  9928 leader_election.cc:290] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.794221 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a81067b5c74642b912118637af29b7" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.795282 10076 raft_consensus.cc:3055] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.795640 10076 raft_consensus.cc:740] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.796517 10076 consensus_queue.cc:260] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.797827 10076 raft_consensus.cc:3060] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.798602 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a81067b5c74642b912118637af29b7" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:47.800429  9926 leader_election.cc:290] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.800782 10001 raft_consensus.cc:3060] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.802423 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5165b868fb4b15b54f22f1d971de60" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:47.803064 10003 raft_consensus.cc:3055] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.803391 10003 raft_consensus.cc:740] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.803830 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5165b868fb4b15b54f22f1d971de60" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.804394 10077 raft_consensus.cc:3060] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.804241 10003 consensus_queue.cc:260] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.806030 10003 raft_consensus.cc:3060] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.806499 10076 raft_consensus.cc:2468] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:47.807750 10001 raft_consensus.cc:2468] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:47.809084  9892 leader_election.cc:304] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.809878 10242 raft_consensus.cc:2804] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.810359 10242 raft_consensus.cc:697] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:47.811218 10242 consensus_queue.cc:237] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.812373 10077 raft_consensus.cc:2468] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:47.813454 10003 raft_consensus.cc:2468] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:47.813757  9892 leader_election.cc:304] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.815117 10242 raft_consensus.cc:2804] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.815685 10242 raft_consensus.cc:697] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:47.816582 10242 consensus_queue.cc:237] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.820190  9826 catalog_manager.cc:5697] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 1 to 2, leader changed from 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195) to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.827549 10202 raft_consensus.cc:993] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887: : Instructing follower c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:47.828171 10250 raft_consensus.cc:1081] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Signalling peer c5ef410dc10045dab7938ad6b81a54de to start an election
I20260709 13:01:47.830077  9926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
 from {username='slave'} at 127.0.0.1:60986
I20260709 13:01:47.830706  9926 raft_consensus.cc:493] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.831065  9926 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.837308  9926 raft_consensus.cc:515] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.839411  9926 leader_election.cc:290] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Requested vote from peers 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.840796 10076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.841113 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226" candidate_uuid: "c5ef410dc10045dab7938ad6b81a54de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:47.841473 10076 raft_consensus.cc:3055] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.841773 10003 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.841965 10076 raft_consensus.cc:740] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.842983 10076 consensus_queue.cc:260] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.843194  9823 catalog_manager.cc:5697] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 1 to 2, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.844182 10076 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.848240 10003 raft_consensus.cc:2468] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:47.849082 10001 raft_consensus.cc:1240] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Rejecting Update request from peer 5ff5add82e9647bdbc8aa2945e012887 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:47.849578  9894 leader_election.cc:304] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.850414 10242 raft_consensus.cc:2804] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.851220 10242 raft_consensus.cc:697] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Leader. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:47.852294 10076 raft_consensus.cc:2468] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ef410dc10045dab7938ad6b81a54de in term 2.
I20260709 13:01:47.852064 10242 consensus_queue.cc:237] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.859349  9823 catalog_manager.cc:5697] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de reported cstate change: term changed from 1 to 2, leader changed from 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195) to c5ef410dc10045dab7938ad6b81a54de (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5ef410dc10045dab7938ad6b81a54de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.941161 10202 raft_consensus.cc:993] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887: : Instructing follower 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:47.941748 10202 raft_consensus.cc:1081] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Signalling peer 0a4416aa57914b21b9de80e6f47dc5a2 to start an election
I20260709 13:01:47.943500 10001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
 from {username='slave'} at 127.0.0.1:57352
I20260709 13:01:47.944070 10001 raft_consensus.cc:493] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.944402 10001 raft_consensus.cc:3060] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.949502 10001 raft_consensus.cc:515] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.951557 10001 leader_election.cc:290] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195:35073)
I20260709 13:01:47.952085  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.952684  9926 raft_consensus.cc:3060] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.953517 10077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b93c3871f9494f9a3263df6f9de19f" candidate_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
I20260709 13:01:47.953938 10292 raft_consensus.cc:993] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:47.954138 10077 raft_consensus.cc:3055] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.954489 10292 raft_consensus.cc:1081] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Signalling peer 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:47.954538 10077 raft_consensus.cc:740] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.955461 10077 consensus_queue.cc:260] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.956543 10077 raft_consensus.cc:3060] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.957546 10076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d265c668d96f474096e1fcf1b3881fe0"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:37352
I20260709 13:01:47.958352 10076 raft_consensus.cc:493] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.958726 10076 raft_consensus.cc:3060] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.962201 10077 raft_consensus.cc:2468] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:47.963207  9967 leader_election.cc:304] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:47.963754  9926 raft_consensus.cc:2468] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4416aa57914b21b9de80e6f47dc5a2 in term 2.
I20260709 13:01:47.963964 10205 raft_consensus.cc:2804] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.964484  9928 raft_consensus.cc:1240] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Rejecting Update request from peer 5ff5add82e9647bdbc8aa2945e012887 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:47.964552 10205 raft_consensus.cc:697] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.965487 10205 consensus_queue.cc:237] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.965366 10076 raft_consensus.cc:515] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.967880 10076 leader_election.cc:290] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 2 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:47.968478  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d265c668d96f474096e1fcf1b3881fe0" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:47.968917 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d265c668d96f474096e1fcf1b3881fe0" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:47.969053  9926 raft_consensus.cc:3060] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.969502 10001 raft_consensus.cc:3055] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.969910 10001 raft_consensus.cc:740] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:47.970654 10001 consensus_queue.cc:260] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.971767 10001 raft_consensus.cc:3060] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.975518  9926 raft_consensus.cc:2468] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 2.
I20260709 13:01:47.976594 10041 leader_election.cc:304] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:47.977404 10202 raft_consensus.cc:2804] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.975411  9823 catalog_manager.cc:5697] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 reported cstate change: term changed from 1 to 2, leader changed from 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195) to 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.977919 10202 raft_consensus.cc:697] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:47.977939 10001 raft_consensus.cc:2468] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 2.
I20260709 13:01:47.978896 10202 consensus_queue.cc:237] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:47.986853  9826 catalog_manager.cc:5697] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 1 to 2, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.067281 10076 raft_consensus.cc:1275] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.068579 10205 consensus_queue.cc:1048] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.076634  9926 raft_consensus.cc:1275] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.078243 10246 consensus_queue.cc:1048] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:48.120158 10001 raft_consensus.cc:1275] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.121520 10242 consensus_queue.cc:1048] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.129809 10076 raft_consensus.cc:1275] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.131407 10242 consensus_queue.cc:1048] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.141136 10076 raft_consensus.cc:1275] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.142516 10246 consensus_queue.cc:1048] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.150372  9926 raft_consensus.cc:1275] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.153005 10246 consensus_queue.cc:1048] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.235882 10001 raft_consensus.cc:1275] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.237533 10242 consensus_queue.cc:1048] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.246769 10076 raft_consensus.cc:1275] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.248330 10300 consensus_queue.cc:1048] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.250567 10076 raft_consensus.cc:1275] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.253634 10246 consensus_queue.cc:1048] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.263293  9926 raft_consensus.cc:1275] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.264744 10248 consensus_queue.cc:1048] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.297792 10076 raft_consensus.cc:1275] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.299376 10245 consensus_queue.cc:1048] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.307190 10001 raft_consensus.cc:1275] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.308759 10242 consensus_queue.cc:1048] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.325403 10076 raft_consensus.cc:1275] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.326830 10242 consensus_queue.cc:1048] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.335336 10001 raft_consensus.cc:1275] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer c5ef410dc10045dab7938ad6b81a54de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.337360 10300 consensus_queue.cc:1048] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:48.387192 10001 raft_consensus.cc:1275] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.388342 10202 consensus_queue.cc:1048] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.391676  9926 raft_consensus.cc:1275] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.393508 10202 consensus_queue.cc:1048] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.486891  9926 raft_consensus.cc:1275] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.488247 10248 consensus_queue.cc:1048] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.497160 10076 raft_consensus.cc:1275] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Refusing update from remote peer 0a4416aa57914b21b9de80e6f47dc5a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.499145 10205 consensus_queue.cc:1048] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:50.511339  9826 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55774:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:01:50.532444  9826 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55774:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:01:50.555598   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:01:50.728404 10341 tablet.cc:1724] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:01:50.719244 10326 log.cc:927] Time spent T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:01:50.769292 10339 tablet.cc:1724] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:50.785528  9999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:57368
I20260709 13:01:50.786295  9999 raft_consensus.cc:606] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Received request to transfer leadership to TS 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:50.814128 10357 tablet.cc:1724] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:50.853749 10356 tablet.cc:1724] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:50.781212 10346 tablet.cc:1724] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:50.844482 10348 tablet.cc:1724] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:50.857141 10341 tablet.cc:1724] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:01:50.870886 10347 log.cc:927] Time spent T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 13:01:50.970135 10363 tablet.cc:1724] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:50.973268 10366 tablet.cc:1724] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:01:50.976468 10355 log.cc:927] Time spent T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
I20260709 13:01:50.923213 10364 tablet.cc:1724] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:50.993531 10374 tablet.cc:1724] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:01:51.003383 10345 log.cc:927] Time spent T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: Append to log took a long time: real 0.216s	user 0.003s	sys 0.000s
I20260709 13:01:51.016980 10346 tablet.cc:1724] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.020502 10357 tablet.cc:1724] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.033851 10356 tablet.cc:1724] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.036128 10373 tablet.cc:1724] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.051362 10364 tablet.cc:1724] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.058965  9925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
mode: GRACEFUL
new_leader_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:32772
I20260709 13:01:51.059263 10372 tablet.cc:1724] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.060604  9925 raft_consensus.cc:606] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Received request to transfer leadership to TS 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:51.067602 10339 tablet.cc:1724] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.067653 10341 tablet.cc:1724] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.071524 10246 raft_consensus.cc:993] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:51.072022 10246 raft_consensus.cc:1081] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Signalling peer 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:51.073908 10070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:37352
I20260709 13:01:51.074579 10070 raft_consensus.cc:493] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:51.075030 10070 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.075870   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:01:51.076599   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:51.081610 10366 tablet.cc:1724] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.090826  9925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7"
dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
mode: GRACEFUL
new_leader_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:32772
I20260709 13:01:51.094587 10348 tablet.cc:1724] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.085520 10070 raft_consensus.cc:515] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.109509  9925 raft_consensus.cc:606] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Received request to transfer leadership to TS 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:51.094496 10364 tablet.cc:1724] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.119711 10070 leader_election.cc:290] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 3 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:51.110770 10356 tablet.cc:1724] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.114552 10372 tablet.cc:1724] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.115658 10002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e"
dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
mode: GRACEFUL
new_leader_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:57368
I20260709 13:01:51.123027 10002 raft_consensus.cc:606] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Received request to transfer leadership to TS 5ff5add82e9647bdbc8aa2945e012887
I20260709 13:01:51.126401   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:51.127046   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:51.104996 10363 tablet.cc:1724] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.122066 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:51.127602  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec1d7eb4994b899b51e7a070a44fe1" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:51.127843 10003 raft_consensus.cc:3055] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.128192 10003 raft_consensus.cc:740] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:51.128242  9925 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.129024 10003 consensus_queue.cc:260] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.130326 10003 raft_consensus.cc:3060] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.138775  9925 raft_consensus.cc:2468] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 3.
I20260709 13:01:51.141815 10370 raft_consensus.cc:993] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de: : Instructing follower 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:51.145083 10370 raft_consensus.cc:1081] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Signalling peer 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:51.141297 10346 tablet.cc:1724] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.142526 10374 tablet.cc:1724] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:51.146381 10041 leader_election.cc:304] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:51.148231 10328 raft_consensus.cc:2804] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:51.148572 10003 raft_consensus.cc:2468] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 3.
I20260709 13:01:51.148847 10328 raft_consensus.cc:697] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:51.152396 10328 consensus_queue.cc:237] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.154192 10070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:37348
I20260709 13:01:51.154956 10070 raft_consensus.cc:493] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:51.155471 10070 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.163642 10070 raft_consensus.cc:515] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.166090 10070 leader_election.cc:290] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 3 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:51.166828  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:51.167515  9925 raft_consensus.cc:3055] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.168051  9925 raft_consensus.cc:740] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:51.168874  9925 consensus_queue.cc:260] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.170004  9925 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.174347  9824 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8: soft_deleted_table [id=e0be62d0e79d4a3780961c39fd46e0e2] alter complete (version 1)
I20260709 13:01:51.167506 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166c5e2a707140c1a25e4747ec118fe7" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:51.179843 10003 raft_consensus.cc:3060] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.187636 10003 raft_consensus.cc:2468] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 3.
I20260709 13:01:51.189244 10043 leader_election.cc:304] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:51.190721 10328 raft_consensus.cc:2804] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:51.191344 10328 raft_consensus.cc:697] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:51.192272  9925 raft_consensus.cc:2468] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 3.
I20260709 13:01:51.192221 10328 consensus_queue.cc:237] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.201406  9825 catalog_manager.cc:5697] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 2 to 3, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.216944  9825 catalog_manager.cc:5697] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 2 to 3, leader changed from c5ef410dc10045dab7938ad6b81a54de (127.0.107.193) to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.436550 10370 raft_consensus.cc:993] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de: : Instructing follower 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:51.437279 10358 raft_consensus.cc:1081] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Signalling peer 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:51.439019 10070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:37348
I20260709 13:01:51.439656 10070 raft_consensus.cc:493] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:51.439936 10070 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.445115 10070 raft_consensus.cc:515] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.446950 10070 leader_election.cc:290] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 3 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:51.447870  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:51.448052 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc62a30f6d3e494d9c28cc6a39129226" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:51.448493  9926 raft_consensus.cc:3055] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.448589 10003 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.449142  9926 raft_consensus.cc:740] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5ef410dc10045dab7938ad6b81a54de, State: Running, Role: LEADER
I20260709 13:01:51.449954  9926 consensus_queue.cc:260] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.451117  9926 raft_consensus.cc:3060] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.456269 10003 raft_consensus.cc:2468] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 3.
I20260709 13:01:51.457620 10043 leader_election.cc:304] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4416aa57914b21b9de80e6f47dc5a2, 5ff5add82e9647bdbc8aa2945e012887; no voters: 
I20260709 13:01:51.457885  9926 raft_consensus.cc:2468] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 3.
I20260709 13:01:51.458468 10328 raft_consensus.cc:2804] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:51.459036 10328 raft_consensus.cc:697] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:51.459825 10328 consensus_queue.cc:237] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.470897  9825 catalog_manager.cc:5697] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 2 to 3, leader changed from c5ef410dc10045dab7938ad6b81a54de (127.0.107.193) to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.527577 10246 raft_consensus.cc:993] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2: : Instructing follower 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:51.528126 10330 raft_consensus.cc:1081] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Signalling peer 5ff5add82e9647bdbc8aa2945e012887 to start an election
I20260709 13:01:51.529651 10070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e"
dest_uuid: "5ff5add82e9647bdbc8aa2945e012887"
 from {username='slave'} at 127.0.0.1:37352
I20260709 13:01:51.530153 10070 raft_consensus.cc:493] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:51.530557 10070 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.536266 10070 raft_consensus.cc:515] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.538257 10070 leader_election.cc:290] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 3 election: Requested vote from peers c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135), 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167)
I20260709 13:01:51.539117  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5ef410dc10045dab7938ad6b81a54de"
I20260709 13:01:51.539552 10003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a463a937d59a4efe8934417a6390e40e" candidate_uuid: "5ff5add82e9647bdbc8aa2945e012887" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a4416aa57914b21b9de80e6f47dc5a2"
I20260709 13:01:51.539757  9926 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.540108 10003 raft_consensus.cc:3055] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.540421 10003 raft_consensus.cc:740] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a4416aa57914b21b9de80e6f47dc5a2, State: Running, Role: LEADER
I20260709 13:01:51.541154 10003 consensus_queue.cc:260] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.542333 10003 raft_consensus.cc:3060] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.546494  9926 raft_consensus.cc:2468] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 3.
I20260709 13:01:51.547730 10041 leader_election.cc:304] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ff5add82e9647bdbc8aa2945e012887, c5ef410dc10045dab7938ad6b81a54de; no voters: 
I20260709 13:01:51.548671 10328 raft_consensus.cc:2804] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:51.549072 10003 raft_consensus.cc:2468] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ff5add82e9647bdbc8aa2945e012887 in term 3.
I20260709 13:01:51.549118 10328 raft_consensus.cc:697] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 3 LEADER]: Becoming Leader. State: Replica: 5ff5add82e9647bdbc8aa2945e012887, State: Running, Role: LEADER
I20260709 13:01:51.550319 10328 consensus_queue.cc:237] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } }
I20260709 13:01:51.558638  9825 catalog_manager.cc:5697] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 reported cstate change: term changed from 2 to 3, leader changed from 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194) to 5ff5add82e9647bdbc8aa2945e012887 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ff5add82e9647bdbc8aa2945e012887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff5add82e9647bdbc8aa2945e012887" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35073 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.577047  9926 raft_consensus.cc:1275] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:51.578361 10328 consensus_queue.cc:1048] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.586848 10003 raft_consensus.cc:1275] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:51.589583 10003 raft_consensus.cc:1275] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:51.591451 10383 consensus_queue.cc:1048] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:51.593071 10328 consensus_queue.cc:1048] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.603749  9925 raft_consensus.cc:1275] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:51.605460 10202 consensus_queue.cc:1048] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:51.956516  9926 raft_consensus.cc:1275] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:51.957871 10383 consensus_queue.cc:1048] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:51.966411 10002 raft_consensus.cc:1275] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:51.968473 10202 consensus_queue.cc:1048] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:52.075989 10002 raft_consensus.cc:1275] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:52.077544 10202 consensus_queue.cc:1048] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4416aa57914b21b9de80e6f47dc5a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.087833  9926 raft_consensus.cc:1275] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Refusing update from remote peer 5ff5add82e9647bdbc8aa2945e012887: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:52.090129 10202 consensus_queue.cc:1048] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ef410dc10045dab7938ad6b81a54de" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.193832   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:01:52.199556   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:01:52.200073   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:52.208499   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:01:52.209280   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:53.250837   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:53.270401 10041 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:01:53.276844 10041 consensus_peers.cc:597] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.298058   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:53.300796   431 tablet_replica.cc:333] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.302023   431 raft_consensus.cc:2243] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.302896   431 raft_consensus.cc:2272] T 83ec1d7eb4994b899b51e7a070a44fe1 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.306577   431 tablet_replica.cc:333] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.307504   431 raft_consensus.cc:2243] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.308319   431 raft_consensus.cc:2272] T 2d947b5537e849b08325a8887b7f2348 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.312284   431 tablet_replica.cc:333] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
W20260709 13:01:53.312155  9967 consensus_peers.cc:597] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.313293   431 raft_consensus.cc:2243] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.313928   431 raft_consensus.cc:2272] T dc62a30f6d3e494d9c28cc6a39129226 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.316519   431 tablet_replica.cc:333] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.317108   431 raft_consensus.cc:2243] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.318094   431 raft_consensus.cc:2272] T 47a81067b5c74642b912118637af29b7 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.320539   431 tablet_replica.cc:333] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.321156   431 raft_consensus.cc:2243] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.322119   431 raft_consensus.cc:2272] T 278d17900d094e649bcac70a49ec4b8c P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.324751   431 tablet_replica.cc:333] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.325368   431 raft_consensus.cc:2243] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.326347   431 raft_consensus.cc:2272] T 6be5a49e6b544ccd895fc7e575e4fd7c P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.328956   431 tablet_replica.cc:333] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.329591   431 raft_consensus.cc:2243] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.330132   431 raft_consensus.cc:2272] T cc0c056cb3a14ba68e775d5b6d3f5013 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.332494   431 tablet_replica.cc:333] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.332957   431 raft_consensus.cc:2243] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.333407   431 raft_consensus.cc:2272] T 166c5e2a707140c1a25e4747ec118fe7 P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.335734   431 tablet_replica.cc:333] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.336285   431 raft_consensus.cc:2243] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.337160   431 raft_consensus.cc:2272] T 9d5165b868fb4b15b54f22f1d971de60 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.339553   431 tablet_replica.cc:333] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.340050   431 raft_consensus.cc:2243] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.340566   431 raft_consensus.cc:2272] T a463a937d59a4efe8934417a6390e40e P c5ef410dc10045dab7938ad6b81a54de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.342886   431 tablet_replica.cc:333] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.343389   431 raft_consensus.cc:2243] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.344452   431 raft_consensus.cc:2272] T 93cf85a08c5c48fc80b81d3f032490f3 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.346884   431 tablet_replica.cc:333] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.347374   431 raft_consensus.cc:2243] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.347853   431 raft_consensus.cc:2272] T aeefcd5d290444af8fd2800ede0a0ba6 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.350116   431 tablet_replica.cc:333] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.350647   431 raft_consensus.cc:2243] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.351153   431 raft_consensus.cc:2272] T d265c668d96f474096e1fcf1b3881fe0 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.353394   431 tablet_replica.cc:333] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.354032   431 raft_consensus.cc:2243] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.354621   431 raft_consensus.cc:2272] T 400a90a7d27c41418263df752a557d82 P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.356791   431 tablet_replica.cc:333] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.357301   431 raft_consensus.cc:2243] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.357787   431 raft_consensus.cc:2272] T 7196930dd4f54a05b91c73a41a585c2c P c5ef410dc10045dab7938ad6b81a54de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.360198   431 tablet_replica.cc:333] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.360760   431 raft_consensus.cc:2243] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.361313   431 raft_consensus.cc:2272] T 18b93c3871f9494f9a3263df6f9de19f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.363782   431 tablet_replica.cc:333] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.364305   431 raft_consensus.cc:2243] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.365302   431 raft_consensus.cc:2272] T 545f695bb62f4ab98cafcec11334ee77 P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.367610   431 tablet_replica.cc:333] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de: stopping tablet replica
I20260709 13:01:53.368144   431 raft_consensus.cc:2243] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.368705   431 raft_consensus.cc:2272] T 98f312cc7eb448049390e2a4d3271b4f P c5ef410dc10045dab7938ad6b81a54de [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:53.389483  9967 consensus_peers.cc:597] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:53.403633 10041 connection.cc:573] client connection to 127.0.107.193:40135 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:01:53.409233 10041 consensus_peers.cc:597] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.410972   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:53.429441  9967 consensus_peers.cc:597] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:53.459136  9967 consensus_peers.cc:597] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.463235   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:53.504170  9967 consensus_peers.cc:597] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.504278   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:53.505505   431 tablet_replica.cc:333] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.506934   431 raft_consensus.cc:2243] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.508015   431 raft_consensus.cc:2272] T dc62a30f6d3e494d9c28cc6a39129226 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.510756   431 tablet_replica.cc:333] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.511438   431 raft_consensus.cc:2243] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.512398   431 raft_consensus.cc:2272] T 2d947b5537e849b08325a8887b7f2348 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.514974   431 tablet_replica.cc:333] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.515707   431 raft_consensus.cc:2243] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.516630   431 raft_consensus.cc:2272] T aeefcd5d290444af8fd2800ede0a0ba6 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.519162   431 tablet_replica.cc:333] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.519783   431 raft_consensus.cc:2243] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.520326   431 raft_consensus.cc:2272] T 278d17900d094e649bcac70a49ec4b8c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.522636   431 tablet_replica.cc:333] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.523406   431 raft_consensus.cc:2243] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.524226   431 raft_consensus.cc:2272] T 47a81067b5c74642b912118637af29b7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:53.527881 10043 consensus_peers.cc:597] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 -> Peer 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167): Couldn't send request to peer 0a4416aa57914b21b9de80e6f47dc5a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.528199   431 tablet_replica.cc:333] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.529016   431 raft_consensus.cc:2243] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.529610   431 raft_consensus.cc:2272] T a463a937d59a4efe8934417a6390e40e P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.532613   431 tablet_replica.cc:333] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.533291   431 raft_consensus.cc:2243] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.534241   431 raft_consensus.cc:2272] T 93cf85a08c5c48fc80b81d3f032490f3 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:53.536602 10041 consensus_peers.cc:597] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.537734   431 tablet_replica.cc:333] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.538483   431 raft_consensus.cc:2243] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.539155   431 raft_consensus.cc:2272] T 9d5165b868fb4b15b54f22f1d971de60 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.541944   431 tablet_replica.cc:333] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.542611   431 raft_consensus.cc:2243] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.543156   431 raft_consensus.cc:2272] T 6be5a49e6b544ccd895fc7e575e4fd7c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.546111   431 tablet_replica.cc:333] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.546756   431 raft_consensus.cc:2243] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.547313   431 raft_consensus.cc:2272] T 166c5e2a707140c1a25e4747ec118fe7 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.549767   431 tablet_replica.cc:333] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.550431   431 raft_consensus.cc:2243] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.551367   431 raft_consensus.cc:2272] T cc0c056cb3a14ba68e775d5b6d3f5013 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.553809   431 tablet_replica.cc:333] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.554446   431 raft_consensus.cc:2243] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.555401   431 raft_consensus.cc:2272] T 7196930dd4f54a05b91c73a41a585c2c P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.558084   431 tablet_replica.cc:333] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.558629   431 raft_consensus.cc:2243] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.559628   431 raft_consensus.cc:2272] T 98f312cc7eb448049390e2a4d3271b4f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.562180   431 tablet_replica.cc:333] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.563004   431 raft_consensus.cc:2243] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.564030   431 raft_consensus.cc:2272] T 18b93c3871f9494f9a3263df6f9de19f P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.566555   431 tablet_replica.cc:333] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.567170   431 raft_consensus.cc:2243] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.567718   431 raft_consensus.cc:2272] T 545f695bb62f4ab98cafcec11334ee77 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.570176   431 tablet_replica.cc:333] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.570798   431 raft_consensus.cc:2243] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.571467   431 raft_consensus.cc:2272] T 83ec1d7eb4994b899b51e7a070a44fe1 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.573967   431 tablet_replica.cc:333] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.574630   431 raft_consensus.cc:2243] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.575278   431 raft_consensus.cc:2272] T d265c668d96f474096e1fcf1b3881fe0 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.577616   431 tablet_replica.cc:333] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2: stopping tablet replica
I20260709 13:01:53.578115   431 raft_consensus.cc:2243] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.578595   431 raft_consensus.cc:2272] T 400a90a7d27c41418263df752a557d82 P 0a4416aa57914b21b9de80e6f47dc5a2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:53.602748 10041 consensus_peers.cc:597] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.625339   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:01:53.631892 10041 consensus_peers.cc:597] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:53.652031 10041 consensus_peers.cc:597] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 -> Peer c5ef410dc10045dab7938ad6b81a54de (127.0.107.193:40135): Couldn't send request to peer c5ef410dc10045dab7938ad6b81a54de. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.670130   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:53.698611 10043 consensus_peers.cc:597] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 -> Peer 0a4416aa57914b21b9de80e6f47dc5a2 (127.0.107.194:46167): Couldn't send request to peer 0a4416aa57914b21b9de80e6f47dc5a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.701354   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:53.702287   431 tablet_replica.cc:333] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.703018   431 raft_consensus.cc:2243] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.703909   431 raft_consensus.cc:2272] T 83ec1d7eb4994b899b51e7a070a44fe1 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.706312   431 tablet_replica.cc:333] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.706873   431 raft_consensus.cc:2243] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.707341   431 raft_consensus.cc:2272] T 278d17900d094e649bcac70a49ec4b8c P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.710142   431 tablet_replica.cc:333] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.710790   431 raft_consensus.cc:2243] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.711325   431 raft_consensus.cc:2272] T 47a81067b5c74642b912118637af29b7 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.714013   431 tablet_replica.cc:333] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.714619   431 raft_consensus.cc:2243] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.715111   431 raft_consensus.cc:2272] T aeefcd5d290444af8fd2800ede0a0ba6 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.718206   431 tablet_replica.cc:333] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.718752   431 raft_consensus.cc:2243] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.719244   431 raft_consensus.cc:2272] T 2d947b5537e849b08325a8887b7f2348 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.723250   431 tablet_replica.cc:333] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.724004   431 raft_consensus.cc:2243] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.725060   431 raft_consensus.cc:2272] T 166c5e2a707140c1a25e4747ec118fe7 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.728987   431 tablet_replica.cc:333] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.730054   431 raft_consensus.cc:2243] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.730923   431 raft_consensus.cc:2272] T 6be5a49e6b544ccd895fc7e575e4fd7c P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.734206   431 tablet_replica.cc:333] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.734961   431 raft_consensus.cc:2243] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.735576   431 raft_consensus.cc:2272] T cc0c056cb3a14ba68e775d5b6d3f5013 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.737896   431 tablet_replica.cc:333] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.738482   431 raft_consensus.cc:2243] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.738996   431 raft_consensus.cc:2272] T 98f312cc7eb448049390e2a4d3271b4f P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.741284   431 tablet_replica.cc:333] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.741932   431 raft_consensus.cc:2243] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.742966   431 raft_consensus.cc:2272] T dc62a30f6d3e494d9c28cc6a39129226 P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.745316   431 tablet_replica.cc:333] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.746004   431 raft_consensus.cc:2243] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.746595   431 raft_consensus.cc:2272] T 9d5165b868fb4b15b54f22f1d971de60 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.749011   431 tablet_replica.cc:333] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.749678   431 raft_consensus.cc:2243] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.750590   431 raft_consensus.cc:2272] T a463a937d59a4efe8934417a6390e40e P 5ff5add82e9647bdbc8aa2945e012887 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.753018   431 tablet_replica.cc:333] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.753664   431 raft_consensus.cc:2243] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.754215   431 raft_consensus.cc:2272] T 93cf85a08c5c48fc80b81d3f032490f3 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.756515   431 tablet_replica.cc:333] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.757063   431 raft_consensus.cc:2243] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.758064   431 raft_consensus.cc:2272] T d265c668d96f474096e1fcf1b3881fe0 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.760457   431 tablet_replica.cc:333] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.761031   431 raft_consensus.cc:2243] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.761981   431 raft_consensus.cc:2272] T 400a90a7d27c41418263df752a557d82 P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.764146   431 tablet_replica.cc:333] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.764698   431 raft_consensus.cc:2243] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.765169   431 raft_consensus.cc:2272] T 545f695bb62f4ab98cafcec11334ee77 P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.767481   431 tablet_replica.cc:333] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.768051   431 raft_consensus.cc:2243] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.768577   431 raft_consensus.cc:2272] T 18b93c3871f9494f9a3263df6f9de19f P 5ff5add82e9647bdbc8aa2945e012887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.770819   431 tablet_replica.cc:333] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887: stopping tablet replica
I20260709 13:01:53.771382   431 raft_consensus.cc:2243] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:53.771885   431 raft_consensus.cc:2272] T 7196930dd4f54a05b91c73a41a585c2c P 5ff5add82e9647bdbc8aa2945e012887 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.816893   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:01:53.852442   431 master.cc:562] Master@127.0.107.254:41699 shutting down...
I20260709 13:01:53.877645   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:53.878285   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:53.878628   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6ce5f9c062bf4f49af70f0281b1574d8: stopping tablet replica
I20260709 13:01:53.900090   431 master.cc:584] Master@127.0.107.254:41699 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13101 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:01:53.958837   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33353
I20260709 13:01:53.960013   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:53.966863 10404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:53.967124 10403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:53.967334 10406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:53.968143   431 server_base.cc:1061] running on GCE node
I20260709 13:01:53.969192   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:53.969385   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:53.969641   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602113969621 us; error 0 us; skew 500 ppm
I20260709 13:01:53.970238   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:53.973021   431 webserver.cc:533] Webserver started at http://127.0.107.254:42397/ using document root <none> and password file <none>
I20260709 13:01:53.973788   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:53.974033   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:53.974327   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:53.975517   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/master-0-root/instance:
uuid: "ad4a4f663e834a519c3a65f3c6c69428"
format_stamp: "Formatted at 2026-07-09 13:01:53 on dist-test-slave-qv7r"
I20260709 13:01:53.980026   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:53.983803 10411 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:53.984809   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:01:53.985146   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/master-0-root
uuid: "ad4a4f663e834a519c3a65f3c6c69428"
format_stamp: "Formatted at 2026-07-09 13:01:53 on dist-test-slave-qv7r"
I20260709 13:01:53.985450   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:54.009688   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:54.010926   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:54.050473   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33353
I20260709 13:01:54.050602 10462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33353 every 8 connection(s)
I20260709 13:01:54.054520 10463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.067544 10463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428: Bootstrap starting.
I20260709 13:01:54.072844 10463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.077780 10463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428: No bootstrap required, opened a new log
I20260709 13:01:54.080200 10463 raft_consensus.cc:359] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a4f663e834a519c3a65f3c6c69428" member_type: VOTER }
I20260709 13:01:54.080653 10463 raft_consensus.cc:385] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:54.080937 10463 raft_consensus.cc:740] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad4a4f663e834a519c3a65f3c6c69428, State: Initialized, Role: FOLLOWER
I20260709 13:01:54.081550 10463 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a4f663e834a519c3a65f3c6c69428" member_type: VOTER }
I20260709 13:01:54.082101 10463 raft_consensus.cc:399] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:54.082324 10463 raft_consensus.cc:493] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:54.082616 10463 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:54.087815 10463 raft_consensus.cc:515] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a4f663e834a519c3a65f3c6c69428" member_type: VOTER }
I20260709 13:01:54.088364 10463 leader_election.cc:304] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad4a4f663e834a519c3a65f3c6c69428; no voters: 
I20260709 13:01:54.089529 10463 leader_election.cc:290] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:54.089954 10466 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:54.091426 10466 raft_consensus.cc:697] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 1 LEADER]: Becoming Leader. State: Replica: ad4a4f663e834a519c3a65f3c6c69428, State: Running, Role: LEADER
I20260709 13:01:54.092164 10466 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a4f663e834a519c3a65f3c6c69428" member_type: VOTER }
I20260709 13:01:54.092527 10463 sys_catalog.cc:565] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:54.097237 10467 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad4a4f663e834a519c3a65f3c6c69428" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a4f663e834a519c3a65f3c6c69428" member_type: VOTER } }
I20260709 13:01:54.097388 10468 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad4a4f663e834a519c3a65f3c6c69428. Latest consensus state: current_term: 1 leader_uuid: "ad4a4f663e834a519c3a65f3c6c69428" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a4f663e834a519c3a65f3c6c69428" member_type: VOTER } }
I20260709 13:01:54.098376 10467 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:54.098479 10468 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:54.105091 10473 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:54.110334 10473 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:54.112668   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:54.120872 10473 catalog_manager.cc:1383] Generated new cluster ID: 32ba7a6973de4a83bec60b4089d05b70
I20260709 13:01:54.121282 10473 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:54.136413 10473 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:54.137841 10473 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:54.159108 10473 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428: Generated new TSK 0
I20260709 13:01:54.159791 10473 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:54.179674   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:54.186723 10484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:54.187609 10485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:54.190173   431 server_base.cc:1061] running on GCE node
W20260709 13:01:54.190672 10487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:54.191632   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:54.191856   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:54.192005   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602114191994 us; error 0 us; skew 500 ppm
I20260709 13:01:54.192566   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:54.195225   431 webserver.cc:533] Webserver started at http://127.0.107.193:45985/ using document root <none> and password file <none>
I20260709 13:01:54.195642   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:54.195791   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:54.195990   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:54.197106   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-0-root/instance:
uuid: "f4190e0173b0466692d09b59af430573"
format_stamp: "Formatted at 2026-07-09 13:01:54 on dist-test-slave-qv7r"
I20260709 13:01:54.201749   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:01:54.205260 10492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.206202   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:54.206600   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-0-root
uuid: "f4190e0173b0466692d09b59af430573"
format_stamp: "Formatted at 2026-07-09 13:01:54 on dist-test-slave-qv7r"
I20260709 13:01:54.206933   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:54.231334   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:54.232640   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:54.234186   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:54.236549   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:54.236780   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.237023   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:54.237219   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.279776   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:36167
I20260709 13:01:54.279870 10554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:36167 every 8 connection(s)
I20260709 13:01:54.284986   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:54.292464 10559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:54.295456 10560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:54.298226 10555 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33353
I20260709 13:01:54.298473   431 server_base.cc:1061] running on GCE node
I20260709 13:01:54.298839 10555 heartbeater.cc:461] Registering TS with master...
W20260709 13:01:54.299446 10562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:54.299914 10555 heartbeater.cc:507] Master 127.0.107.254:33353 requested a full tablet report, sending...
I20260709 13:01:54.300570   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:54.300887   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:54.301113   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602114301094 us; error 0 us; skew 500 ppm
I20260709 13:01:54.301808   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:54.302413 10428 ts_manager.cc:194] Registered new tserver with Master: f4190e0173b0466692d09b59af430573 (127.0.107.193:36167)
I20260709 13:01:54.304462 10428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45146
I20260709 13:01:54.304633   431 webserver.cc:533] Webserver started at http://127.0.107.194:42805/ using document root <none> and password file <none>
I20260709 13:01:54.305250   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:54.305464   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:54.305771   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:54.307379   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-1-root/instance:
uuid: "67171027597c4e919b278b6f103d2b79"
format_stamp: "Formatted at 2026-07-09 13:01:54 on dist-test-slave-qv7r"
I20260709 13:01:54.311977   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:01:54.315932 10567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.316891   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:01:54.317227   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-1-root
uuid: "67171027597c4e919b278b6f103d2b79"
format_stamp: "Formatted at 2026-07-09 13:01:54 on dist-test-slave-qv7r"
I20260709 13:01:54.317521   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:54.339443   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:54.340689   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:54.342137   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:54.344457   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:54.344694   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.344938   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:54.345115   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.391394   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43769
I20260709 13:01:54.391510 10629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43769 every 8 connection(s)
I20260709 13:01:54.396540   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:54.403414 10633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:54.405660 10634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:54.407196 10636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:54.408185 10630 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33353
I20260709 13:01:54.408380   431 server_base.cc:1061] running on GCE node
I20260709 13:01:54.408794 10630 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:54.409502   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:54.409857   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:54.409786 10630 heartbeater.cc:507] Master 127.0.107.254:33353 requested a full tablet report, sending...
I20260709 13:01:54.410279   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602114410252 us; error 0 us; skew 500 ppm
I20260709 13:01:54.410977   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:54.412369 10428 ts_manager.cc:194] Registered new tserver with Master: 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:01:54.413864 10428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45148
I20260709 13:01:54.414266   431 webserver.cc:533] Webserver started at http://127.0.107.195:36083/ using document root <none> and password file <none>
I20260709 13:01:54.414920   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:54.415174   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:54.415477   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:54.416706   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-2-root/instance:
uuid: "11140cca63e141da877ecc4a11a12038"
format_stamp: "Formatted at 2026-07-09 13:01:54 on dist-test-slave-qv7r"
I20260709 13:01:54.421244   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:01:54.425033 10641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.426002   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:01:54.426347   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-2-root
uuid: "11140cca63e141da877ecc4a11a12038"
format_stamp: "Formatted at 2026-07-09 13:01:54 on dist-test-slave-qv7r"
I20260709 13:01:54.426710   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIoN6Aa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601802742860-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:54.446249   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:54.447436   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:54.448810   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:54.451202   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:54.451383   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.451778   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:54.451925   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:54.494661   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46715
I20260709 13:01:54.494807 10703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46715 every 8 connection(s)
I20260709 13:01:54.508894 10704 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33353
I20260709 13:01:54.509487 10704 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:54.510247 10704 heartbeater.cc:507] Master 127.0.107.254:33353 requested a full tablet report, sending...
I20260709 13:01:54.512316 10428 ts_manager.cc:194] Registered new tserver with Master: 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:54.512804   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014666853s
I20260709 13:01:54.513835 10428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45164
I20260709 13:01:54.538794 10428 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45176:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:54.541677 10428 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:54.625774 10595 tablet_service.cc:1511] Processing CreateTablet for tablet c55f052034674a66930c284c698f08b4 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:54.627277 10595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55f052034674a66930c284c698f08b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.631938 10593 tablet_service.cc:1511] Processing CreateTablet for tablet a62d89abdc24409182a279c238d12367 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:54.633435 10593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62d89abdc24409182a279c238d12367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.629467 10594 tablet_service.cc:1511] Processing CreateTablet for tablet d537ce7a7c704c82ad0931398f54f5b0 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:54.638950 10594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d537ce7a7c704c82ad0931398f54f5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.639335 10592 tablet_service.cc:1511] Processing CreateTablet for tablet f589853ab39847069098b4c73622f928 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:54.640741 10592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f589853ab39847069098b4c73622f928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.642046 10669 tablet_service.cc:1511] Processing CreateTablet for tablet c55f052034674a66930c284c698f08b4 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:54.643445 10669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55f052034674a66930c284c698f08b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.643251 10666 tablet_service.cc:1511] Processing CreateTablet for tablet f589853ab39847069098b4c73622f928 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:54.644657 10666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f589853ab39847069098b4c73622f928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.645617 10668 tablet_service.cc:1511] Processing CreateTablet for tablet d537ce7a7c704c82ad0931398f54f5b0 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:54.646595 10667 tablet_service.cc:1511] Processing CreateTablet for tablet a62d89abdc24409182a279c238d12367 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:54.646981 10668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d537ce7a7c704c82ad0931398f54f5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.649482 10520 tablet_service.cc:1511] Processing CreateTablet for tablet c55f052034674a66930c284c698f08b4 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:54.650909 10520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55f052034674a66930c284c698f08b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.650735 10519 tablet_service.cc:1511] Processing CreateTablet for tablet d537ce7a7c704c82ad0931398f54f5b0 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:54.652048 10519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d537ce7a7c704c82ad0931398f54f5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.654896 10518 tablet_service.cc:1511] Processing CreateTablet for tablet a62d89abdc24409182a279c238d12367 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:54.656399 10518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62d89abdc24409182a279c238d12367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.658795 10517 tablet_service.cc:1511] Processing CreateTablet for tablet f589853ab39847069098b4c73622f928 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:54.660192 10517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f589853ab39847069098b4c73622f928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.663228 10516 tablet_service.cc:1511] Processing CreateTablet for tablet 841df69af28445048305f460e47f68b1 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:54.664602 10516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841df69af28445048305f460e47f68b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.666010 10667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62d89abdc24409182a279c238d12367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.675807 10591 tablet_service.cc:1511] Processing CreateTablet for tablet 841df69af28445048305f460e47f68b1 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:54.677402 10591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841df69af28445048305f460e47f68b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.687687 10665 tablet_service.cc:1511] Processing CreateTablet for tablet 841df69af28445048305f460e47f68b1 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:54.691357 10590 tablet_service.cc:1511] Processing CreateTablet for tablet 6c74073742bf4c30bbd1b63946306842 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:54.693715 10590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c74073742bf4c30bbd1b63946306842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.695742 10515 tablet_service.cc:1511] Processing CreateTablet for tablet 6c74073742bf4c30bbd1b63946306842 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:54.697551 10515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c74073742bf4c30bbd1b63946306842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.701817 10665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841df69af28445048305f460e47f68b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.712862 10720 tablet_bootstrap.cc:492] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:01:54.723237 10514 tablet_service.cc:1511] Processing CreateTablet for tablet 2650143aa3d2445890518fcc7cc1753c (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:54.725472 10514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2650143aa3d2445890518fcc7cc1753c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.736109 10592 tablet_service.cc:1511] Processing CreateTablet for tablet 2650143aa3d2445890518fcc7cc1753c (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:54.737732 10592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2650143aa3d2445890518fcc7cc1753c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.741051 10513 tablet_service.cc:1511] Processing CreateTablet for tablet c5a223eb469244b6ba05201f21382bf9 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:54.753280 10513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a223eb469244b6ba05201f21382bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.767903 10664 tablet_service.cc:1511] Processing CreateTablet for tablet 6c74073742bf4c30bbd1b63946306842 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:54.770356 10663 tablet_service.cc:1511] Processing CreateTablet for tablet 2650143aa3d2445890518fcc7cc1753c (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:54.774070 10664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c74073742bf4c30bbd1b63946306842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.779173 10592 tablet_service.cc:1511] Processing CreateTablet for tablet c5a223eb469244b6ba05201f21382bf9 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:54.779734 10512 tablet_service.cc:1511] Processing CreateTablet for tablet cf0b9cd3d4ed46bdb4c13dd19702fbbd (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:54.782728 10512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0b9cd3d4ed46bdb4c13dd19702fbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.783332 10720 tablet_bootstrap.cc:654] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.790273 10592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a223eb469244b6ba05201f21382bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.794126 10593 tablet_service.cc:1511] Processing CreateTablet for tablet cf0b9cd3d4ed46bdb4c13dd19702fbbd (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:54.796775 10668 tablet_service.cc:1511] Processing CreateTablet for tablet c5a223eb469244b6ba05201f21382bf9 (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:54.798789 10668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a223eb469244b6ba05201f21382bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.814347 10669 tablet_service.cc:1511] Processing CreateTablet for tablet cf0b9cd3d4ed46bdb4c13dd19702fbbd (DEFAULT_TABLE table=test-workload [id=cd035545c84b44abb032bf31b4174402]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:54.818073 10669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0b9cd3d4ed46bdb4c13dd19702fbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.839211 10663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2650143aa3d2445890518fcc7cc1753c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.839866 10719 tablet_bootstrap.cc:492] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:54.838188 10593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0b9cd3d4ed46bdb4c13dd19702fbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:54.850989 10721 tablet_bootstrap.cc:492] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:54.857390 10721 tablet_bootstrap.cc:654] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.862490 10719 tablet_bootstrap.cc:654] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.889480 10720 tablet_bootstrap.cc:492] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:54.890036 10720 ts_tablet_manager.cc:1403] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.004s
I20260709 13:01:54.891975 10719 tablet_bootstrap.cc:492] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:54.892573 10719 ts_tablet_manager.cc:1403] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.053s	user 0.004s	sys 0.021s
I20260709 13:01:54.892607 10721 tablet_bootstrap.cc:492] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:54.892899 10720 raft_consensus.cc:359] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.893306 10721 ts_tablet_manager.cc:1403] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.010s
I20260709 13:01:54.893710 10720 raft_consensus.cc:385] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:54.894174 10720 raft_consensus.cc:740] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:01:54.894948 10720 consensus_queue.cc:260] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.895771 10719 raft_consensus.cc:359] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.896605 10719 raft_consensus.cc:385] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:54.896471 10721 raft_consensus.cc:359] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.897040 10719 raft_consensus.cc:740] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:54.897197 10630 heartbeater.cc:499] Master 127.0.107.254:33353 was elected leader, sending a full tablet report...
I20260709 13:01:54.897373 10721 raft_consensus.cc:385] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:54.897719 10720 ts_tablet_manager.cc:1434] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:54.897863 10721 raft_consensus.cc:740] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:54.898123 10719 consensus_queue.cc:260] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.898874 10720 tablet_bootstrap.cc:492] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:01:54.898911 10721 consensus_queue.cc:260] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.907050 10704 heartbeater.cc:499] Master 127.0.107.254:33353 was elected leader, sending a full tablet report...
I20260709 13:01:54.907487 10720 tablet_bootstrap.cc:654] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.910596 10555 heartbeater.cc:499] Master 127.0.107.254:33353 was elected leader, sending a full tablet report...
I20260709 13:01:54.912053 10721 ts_tablet_manager.cc:1434] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:01:54.913379 10721 tablet_bootstrap.cc:492] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:54.916105 10719 ts_tablet_manager.cc:1434] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.007s
I20260709 13:01:54.917300 10719 tablet_bootstrap.cc:492] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:54.921577 10721 tablet_bootstrap.cc:654] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.924077 10719 tablet_bootstrap.cc:654] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.928139 10721 tablet_bootstrap.cc:492] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:54.928751 10721 ts_tablet_manager.cc:1403] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:01:54.931857 10721 raft_consensus.cc:359] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.932476 10720 tablet_bootstrap.cc:492] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:54.932693 10721 raft_consensus.cc:385] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:54.933084 10720 ts_tablet_manager.cc:1403] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.004s
I20260709 13:01:54.933095 10721 raft_consensus.cc:740] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:54.934069 10721 consensus_queue.cc:260] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.935667 10720 raft_consensus.cc:359] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.930446 10719 tablet_bootstrap.cc:492] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:54.936215 10721 ts_tablet_manager.cc:1434] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:54.936882 10719 ts_tablet_manager.cc:1403] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 13:01:54.937425 10721 tablet_bootstrap.cc:492] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:54.939982 10719 raft_consensus.cc:359] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.940582 10719 raft_consensus.cc:385] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:54.940824 10719 raft_consensus.cc:740] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:54.936232 10720 raft_consensus.cc:385] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:54.941886 10720 raft_consensus.cc:740] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:01:54.942638 10720 consensus_queue.cc:260] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.943966 10719 consensus_queue.cc:260] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.944509 10725 raft_consensus.cc:493] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.944696 10721 tablet_bootstrap.cc:654] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.945128 10725 raft_consensus.cc:515] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:54.946588 10719 ts_tablet_manager.cc:1434] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:01:54.947635 10719 tablet_bootstrap.cc:492] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:54.955199 10719 tablet_bootstrap.cc:654] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.955653 10725 leader_election.cc:290] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:54.959193 10720 ts_tablet_manager.cc:1434] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 13:01:54.960505 10720 tablet_bootstrap.cc:492] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:01:54.969254 10720 tablet_bootstrap.cc:654] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:54.996783 10719 tablet_bootstrap.cc:492] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:54.997437 10719 ts_tablet_manager.cc:1403] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.009s
I20260709 13:01:54.998020 10721 tablet_bootstrap.cc:492] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:54.998627 10721 ts_tablet_manager.cc:1403] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.033s
I20260709 13:01:55.000291 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d89abdc24409182a279c238d12367" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.000591 10719 raft_consensus.cc:359] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.001358 10719 raft_consensus.cc:385] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.001727 10719 raft_consensus.cc:740] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.002076 10720 tablet_bootstrap.cc:492] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:55.001720 10721 raft_consensus.cc:359] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.003211 10721 raft_consensus.cc:385] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:55.002640 10569 leader_election.cc:343] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.002686 10720 ts_tablet_manager.cc:1403] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.005s
I20260709 13:01:55.003616 10721 raft_consensus.cc:740] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.003484 10719 consensus_queue.cc:260] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.004454 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d89abdc24409182a279c238d12367" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
W20260709 13:01:55.006158 10571 leader_election.cc:343] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.006309 10719 ts_tablet_manager.cc:1434] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:55.006671 10571 leader_election.cc:304] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67171027597c4e919b278b6f103d2b79; no voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573
I20260709 13:01:55.007663 10725 raft_consensus.cc:2749] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.008034 10719 tablet_bootstrap.cc:492] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:55.016521 10721 consensus_queue.cc:260] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.018092 10720 raft_consensus.cc:359] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.019006 10721 ts_tablet_manager.cc:1434] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:01:55.019114 10720 raft_consensus.cc:385] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.019640 10720 raft_consensus.cc:740] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.020167 10721 tablet_bootstrap.cc:492] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:55.020478 10720 consensus_queue.cc:260] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.022661 10719 tablet_bootstrap.cc:654] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.023013 10720 ts_tablet_manager.cc:1434] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.012s
I20260709 13:01:55.024166 10720 tablet_bootstrap.cc:492] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:01:55.034037 10720 tablet_bootstrap.cc:654] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.036091 10721 tablet_bootstrap.cc:654] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.039201 10719 tablet_bootstrap.cc:492] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:55.039386 10720 tablet_bootstrap.cc:492] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:55.039943 10719 ts_tablet_manager.cc:1403] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.011s
I20260709 13:01:55.040113 10720 ts_tablet_manager.cc:1403] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:01:55.043586 10720 raft_consensus.cc:359] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.044462 10720 raft_consensus.cc:385] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.044072 10719 raft_consensus.cc:359] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.044799 10720 raft_consensus.cc:740] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.044891 10719 raft_consensus.cc:385] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.045329 10719 raft_consensus.cc:740] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.046059 10721 tablet_bootstrap.cc:492] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:55.045732 10720 consensus_queue.cc:260] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.046564 10721 ts_tablet_manager.cc:1403] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 13:01:55.046195 10719 consensus_queue.cc:260] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.049244 10719 ts_tablet_manager.cc:1434] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:55.050639 10719 tablet_bootstrap.cc:492] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:55.050390 10721 raft_consensus.cc:359] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.051347 10721 raft_consensus.cc:385] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.051789 10721 raft_consensus.cc:740] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.053123 10721 consensus_queue.cc:260] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.054919 10720 ts_tablet_manager.cc:1434] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:01:55.056150 10720 tablet_bootstrap.cc:492] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:01:55.057971 10721 ts_tablet_manager.cc:1434] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:01:55.058735 10719 tablet_bootstrap.cc:654] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.059168 10721 tablet_bootstrap.cc:492] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:55.063114 10720 tablet_bootstrap.cc:654] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.066705 10721 tablet_bootstrap.cc:654] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.075316 10719 tablet_bootstrap.cc:492] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:55.076167 10719 ts_tablet_manager.cc:1403] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:01:55.079255 10721 tablet_bootstrap.cc:492] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:55.079982 10721 ts_tablet_manager.cc:1403] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:01:55.081231 10719 raft_consensus.cc:359] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.082602 10719 raft_consensus.cc:385] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.083089 10719 raft_consensus.cc:740] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.083329 10721 raft_consensus.cc:359] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.084153 10721 raft_consensus.cc:385] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.084445 10721 raft_consensus.cc:740] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.084581 10719 consensus_queue.cc:260] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.085449 10721 consensus_queue.cc:260] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.089069 10719 ts_tablet_manager.cc:1434] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.012s	user 0.013s	sys 0.000s
I20260709 13:01:55.090668 10721 ts_tablet_manager.cc:1434] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:01:55.090708 10719 tablet_bootstrap.cc:492] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:55.091840 10721 tablet_bootstrap.cc:492] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:55.099352 10721 tablet_bootstrap.cc:654] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.101491 10719 tablet_bootstrap.cc:654] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.108170 10727 raft_consensus.cc:493] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.108965 10727 raft_consensus.cc:515] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.111542 10721 tablet_bootstrap.cc:492] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:55.112141 10721 ts_tablet_manager.cc:1403] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:01:55.116176 10721 raft_consensus.cc:359] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.117017 10721 raft_consensus.cc:385] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.117348 10721 raft_consensus.cc:740] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.117851 10719 tablet_bootstrap.cc:492] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:55.118165 10721 consensus_queue.cc:260] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.118971 10727 leader_election.cc:290] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.118746 10719 ts_tablet_manager.cc:1403] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.002s
I20260709 13:01:55.126098 10719 raft_consensus.cc:359] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.127326 10719 raft_consensus.cc:385] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.128369 10721 ts_tablet_manager.cc:1434] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.004s
W20260709 13:01:55.129065 10476 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:55.130038 10721 tablet_bootstrap.cc:492] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:55.127764 10719 raft_consensus.cc:740] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.136935 10746 raft_consensus.cc:493] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.137625 10746 raft_consensus.cc:515] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.138425 10719 consensus_queue.cc:260] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.140057 10746 leader_election.cc:290] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.144464 10746 raft_consensus.cc:493] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.144942 10746 raft_consensus.cc:515] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.148977 10746 leader_election.cc:290] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.150795 10721 tablet_bootstrap.cc:654] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.151886 10719 ts_tablet_manager.cc:1434] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:01:55.159991 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d537ce7a7c704c82ad0931398f54f5b0" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.161221 10605 raft_consensus.cc:2468] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:01:55.162638 10721 tablet_bootstrap.cc:492] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:55.163275 10721 ts_tablet_manager.cc:1403] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.004s
I20260709 13:01:55.163903 10493 leader_election.cc:304] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.165231 10746 raft_consensus.cc:2804] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.165663 10746 raft_consensus.cc:493] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.166010 10746 raft_consensus.cc:3060] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.166874 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0b9cd3d4ed46bdb4c13dd19702fbbd" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.170080 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2650143aa3d2445890518fcc7cc1753c" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.170866 10604 raft_consensus.cc:2468] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:01:55.172744 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d537ce7a7c704c82ad0931398f54f5b0" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.173382 10679 raft_consensus.cc:2468] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:01:55.174021 10720 tablet_bootstrap.cc:492] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:55.174352 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0b9cd3d4ed46bdb4c13dd19702fbbd" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.174816 10720 ts_tablet_manager.cc:1403] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.119s	user 0.064s	sys 0.050s
I20260709 13:01:55.174101 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2650143aa3d2445890518fcc7cc1753c" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.176318 10677 raft_consensus.cc:2468] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:01:55.176359 10746 raft_consensus.cc:515] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
W20260709 13:01:55.169051 10493 leader_election.cc:343] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:55.178243 10494 leader_election.cc:343] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.178589 10746 leader_election.cc:290] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.178785 10720 raft_consensus.cc:359] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.179277 10721 raft_consensus.cc:359] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.179764 10720 raft_consensus.cc:385] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.180006 10721 raft_consensus.cc:385] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.180207 10720 raft_consensus.cc:740] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.180434 10721 raft_consensus.cc:740] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.181149 10721 consensus_queue.cc:260] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.181164 10720 consensus_queue.cc:260] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.181666 10494 leader_election.cc:304] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79
I20260709 13:01:55.182631 10727 raft_consensus.cc:2749] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.184712 10721 ts_tablet_manager.cc:1434] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:01:55.185024 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d537ce7a7c704c82ad0931398f54f5b0" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.185724 10677 raft_consensus.cc:3060] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.185937 10721 tablet_bootstrap.cc:492] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:55.185959 10719 tablet_bootstrap.cc:492] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:55.193962 10494 leader_election.cc:304] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.194247 10721 tablet_bootstrap.cc:654] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.195683 10720 ts_tablet_manager.cc:1434] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:01:55.196666 10746 raft_consensus.cc:2804] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.197086 10746 raft_consensus.cc:493] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.197552 10746 raft_consensus.cc:3060] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.199646 10677 raft_consensus.cc:2468] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 1.
I20260709 13:01:55.200989 10494 leader_election.cc:304] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.201833 10727 raft_consensus.cc:2804] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.202158 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d537ce7a7c704c82ad0931398f54f5b0" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:01:55.203086 10604 raft_consensus.cc:3060] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.204133 10720 tablet_bootstrap.cc:492] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:01:55.213869 10720 tablet_bootstrap.cc:654] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.213683 10727 raft_consensus.cc:697] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:01:55.215130 10727 consensus_queue.cc:237] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.226719 10604 raft_consensus.cc:2468] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 1.
I20260709 13:01:55.228302 10725 raft_consensus.cc:493] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.233515 10726 raft_consensus.cc:493] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.241420 10725 raft_consensus.cc:515] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.235229 10426 catalog_manager.cc:5697] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.244056 10725 leader_election.cc:290] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.235725 10752 raft_consensus.cc:493] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.245332 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.245221 10752 raft_consensus.cc:515] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.245712 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.235862 10727 raft_consensus.cc:493] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.239823 10719 tablet_bootstrap.cc:654] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.231881 10746 raft_consensus.cc:515] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.248553 10752 leader_election.cc:290] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.238600 10720 tablet_bootstrap.cc:492] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:55.248431 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.249042 10746 leader_election.cc:290] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.241497 10726 raft_consensus.cc:515] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.249843 10720 ts_tablet_manager.cc:1403] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.016s
I20260709 13:01:55.252267 10726 leader_election.cc:290] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), f4190e0173b0466692d09b59af430573 (127.0.107.193:36167)
I20260709 13:01:55.253051 10726 raft_consensus.cc:493] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.258956 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2650143aa3d2445890518fcc7cc1753c" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:01:55.253540 10726 raft_consensus.cc:515] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.261165 10604 raft_consensus.cc:3060] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.246557 10727 raft_consensus.cc:515] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.253647 10720 raft_consensus.cc:359] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.263710 10720 raft_consensus.cc:385] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.263954 10530 raft_consensus.cc:2468] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 0.
I20260709 13:01:55.254205 10721 tablet_bootstrap.cc:492] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:55.270143 10721 ts_tablet_manager.cc:1403] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.084s	user 0.027s	sys 0.031s
I20260709 13:01:55.263100 10726 leader_election.cc:290] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:01:55.264127 10720 raft_consensus.cc:740] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.270656 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.271092 10727 leader_election.cc:290] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
W20260709 13:01:55.260239 10571 leader_election.cc:343] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.272188 10571 leader_election.cc:304] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.271431 10605 raft_consensus.cc:2468] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:01:55.273041 10752 raft_consensus.cc:2804] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.272914 10721 raft_consensus.cc:359] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.273463 10752 raft_consensus.cc:493] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.273974 10752 raft_consensus.cc:3060] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.269395 10604 raft_consensus.cc:2468] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 1.
I20260709 13:01:55.271517 10720 consensus_queue.cc:260] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.273708 10721 raft_consensus.cc:385] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.275710 10721 raft_consensus.cc:740] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.276655 10720 ts_tablet_manager.cc:1434] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:01:55.276437 10721 consensus_queue.cc:260] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.277691 10720 tablet_bootstrap.cc:492] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
W20260709 13:01:55.279102 10569 leader_election.cc:343] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.273715 10493 leader_election.cc:304] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.282166 10721 ts_tablet_manager.cc:1434] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:55.282435 10493 leader_election.cc:304] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.283179 10721 tablet_bootstrap.cc:492] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:01:55.283634 10749 raft_consensus.cc:2804] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.284024 10749 raft_consensus.cc:493] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.284350 10749 raft_consensus.cc:3060] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.284832 10720 tablet_bootstrap.cc:654] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.291924 10746 raft_consensus.cc:2804] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.297995 10746 raft_consensus.cc:697] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:01:55.302772 10746 consensus_queue.cc:237] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.304672 10721 tablet_bootstrap.cc:654] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.307871 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2650143aa3d2445890518fcc7cc1753c" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.308586 10677 raft_consensus.cc:3060] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.300854 10727 raft_consensus.cc:493] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.299507 10752 raft_consensus.cc:515] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.310504 10727 raft_consensus.cc:515] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.317657 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.318344 10678 raft_consensus.cc:2468] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 0.
I20260709 13:01:55.318661 10752 leader_election.cc:290] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.321808 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.322315 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
W20260709 13:01:55.323246 10494 leader_election.cc:343] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.323839 10569 leader_election.cc:304] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:01:55.323906 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55f052034674a66930c284c698f08b4" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.325279 10752 raft_consensus.cc:2804] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.325850 10752 raft_consensus.cc:493] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.326248 10752 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:55.326422 10493 leader_election.cc:343] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.326730 10727 leader_election.cc:290] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.327872 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55f052034674a66930c284c698f08b4" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.328570 10678 raft_consensus.cc:2468] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:01:55.329877 10494 leader_election.cc:304] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 67171027597c4e919b278b6f103d2b79
I20260709 13:01:55.320731 10749 raft_consensus.cc:515] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.331776 10530 raft_consensus.cc:2393] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67171027597c4e919b278b6f103d2b79 in current term 1: Already voted for candidate f4190e0173b0466692d09b59af430573 in this term.
I20260709 13:01:55.332324 10720 tablet_bootstrap.cc:492] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:55.332931 10720 ts_tablet_manager.cc:1403] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.011s
I20260709 13:01:55.335490 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:01:55.335810 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.336376 10604 raft_consensus.cc:2393] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4190e0173b0466692d09b59af430573 in current term 1: Already voted for candidate 67171027597c4e919b278b6f103d2b79 in this term.
I20260709 13:01:55.336140 10720 raft_consensus.cc:359] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.336903 10720 raft_consensus.cc:385] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.337208 10720 raft_consensus.cc:740] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
W20260709 13:01:55.337280 10494 leader_election.cc:343] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.338786 10727 raft_consensus.cc:2804] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.340236 10727 raft_consensus.cc:493] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.340206 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.340361 10493 leader_election.cc:304] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79
I20260709 13:01:55.338678 10677 raft_consensus.cc:2468] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 1.
I20260709 13:01:55.342588 10727 raft_consensus.cc:3060] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.338397 10749 leader_election.cc:290] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.344277 10749 raft_consensus.cc:2749] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.344507 10719 tablet_bootstrap.cc:492] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:55.345891 10752 raft_consensus.cc:515] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.347338 10749 raft_consensus.cc:493] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.349431 10569 leader_election.cc:343] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.351902 10569 leader_election.cc:304] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67171027597c4e919b278b6f103d2b79; no voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573
I20260709 13:01:55.349823 10754 raft_consensus.cc:493] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.350373 10721 tablet_bootstrap.cc:492] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:01:55.348300 10720 consensus_queue.cc:260] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.354125 10719 ts_tablet_manager.cc:1403] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.168s	user 0.025s	sys 0.017s
I20260709 13:01:55.354271 10721 ts_tablet_manager.cc:1403] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.006s
I20260709 13:01:55.354489 10754 raft_consensus.cc:515] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.354154 10749 raft_consensus.cc:515] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.354750 10759 raft_consensus.cc:493] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.358259 10725 raft_consensus.cc:493] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.361085 10752 leader_election.cc:290] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.363660 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.361392 10754 leader_election.cc:290] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:01:55.363783 10752 raft_consensus.cc:2749] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.364634 10605 raft_consensus.cc:2393] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11140cca63e141da877ecc4a11a12038 in current term 1: Already voted for candidate 67171027597c4e919b278b6f103d2b79 in this term.
I20260709 13:01:55.362061 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:01:55.365912 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.366037 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a223eb469244b6ba05201f21382bf9" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.366770 10527 raft_consensus.cc:2468] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:01:55.366788 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55f052034674a66930c284c698f08b4" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.362946 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55f052034674a66930c284c698f08b4" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.367563 10725 raft_consensus.cc:515] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.368934 10645 leader_election.cc:304] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.370572 10754 raft_consensus.cc:2804] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.370712 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d89abdc24409182a279c238d12367" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.371119 10754 raft_consensus.cc:493] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.371575 10754 raft_consensus.cc:3060] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:55.372488 10494 leader_election.cc:343] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.372882 10727 raft_consensus.cc:515] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.374914 10529 raft_consensus.cc:2393] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11140cca63e141da877ecc4a11a12038 in current term 1: Already voted for candidate f4190e0173b0466692d09b59af430573 in this term.
I20260709 13:01:55.375224 10727 leader_election.cc:290] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.374116 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.377921 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55f052034674a66930c284c698f08b4" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.378718 10678 raft_consensus.cc:3060] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.379307 10721 raft_consensus.cc:359] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.380026 10721 raft_consensus.cc:385] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.380054 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.380954 10677 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.384971 10759 raft_consensus.cc:515] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.381744 10725 leader_election.cc:290] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.385797 10721 raft_consensus.cc:740] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.369166 10749 leader_election.cc:290] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.383759 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d89abdc24409182a279c238d12367" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.388990 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a223eb469244b6ba05201f21382bf9" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.389394 10604 raft_consensus.cc:2468] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:01:55.385526 10754 raft_consensus.cc:515] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.391644 10493 leader_election.cc:304] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038
I20260709 13:01:55.386283 10527 raft_consensus.cc:2468] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 0.
I20260709 13:01:55.387267 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55f052034674a66930c284c698f08b4" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
W20260709 13:01:55.387748 10645 leader_election.cc:343] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.383157 10719 raft_consensus.cc:359] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.389819 10603 raft_consensus.cc:2468] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:01:55.395820 10719 raft_consensus.cc:385] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.393201 10754 leader_election.cc:290] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:01:55.396178 10645 leader_election.cc:304] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11140cca63e141da877ecc4a11a12038; no voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573
I20260709 13:01:55.396252 10719 raft_consensus.cc:740] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.393141 10749 raft_consensus.cc:2804] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.397747 10749 raft_consensus.cc:493] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.397756 10719 consensus_queue.cc:260] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.398375 10749 raft_consensus.cc:3060] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.400252 10759 leader_election.cc:290] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.400499 10719 ts_tablet_manager.cc:1434] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.042s	user 0.001s	sys 0.005s
I20260709 13:01:55.401386 10571 leader_election.cc:304] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.401798 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a223eb469244b6ba05201f21382bf9" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:01:55.402401 10603 raft_consensus.cc:3060] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.402787 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.403352 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
W20260709 13:01:55.401386 10493 leader_election.cc:343] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.388293 10720 ts_tablet_manager.cc:1434] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.005s
I20260709 13:01:55.403499 10676 raft_consensus.cc:2468] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
W20260709 13:01:55.405064 10642 leader_election.cc:343] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.406330 10494 leader_election.cc:304] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.407213 10642 leader_election.cc:304] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11140cca63e141da877ecc4a11a12038; no voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573
I20260709 13:01:55.407974 10759 raft_consensus.cc:2804] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.409221 10759 raft_consensus.cc:493] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.413911 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.410970 10719 tablet_bootstrap.cc:492] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:55.402575 10765 raft_consensus.cc:2804] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.408051 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a223eb469244b6ba05201f21382bf9" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:01:55.389091 10721 consensus_queue.cc:260] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.415058 10527 raft_consensus.cc:3060] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.417021 10721 ts_tablet_manager.cc:1434] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.002s
I20260709 13:01:55.417089 10530 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.414305 10759 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.415026 10605 raft_consensus.cc:2468] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:01:55.424631 10765 raft_consensus.cc:493] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.425067 10765 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.427547 10749 raft_consensus.cc:515] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.429504 10678 raft_consensus.cc:2468] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 1.
I20260709 13:01:55.430840 10494 leader_election.cc:304] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 67171027597c4e919b278b6f103d2b79
I20260709 13:01:55.431100 10754 raft_consensus.cc:2749] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.432179 10727 raft_consensus.cc:2804] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.433818 10530 raft_consensus.cc:2468] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 1.
I20260709 13:01:55.434408 10727 raft_consensus.cc:697] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:01:55.434919 10677 raft_consensus.cc:2468] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 1.
I20260709 13:01:55.435482 10726 raft_consensus.cc:2749] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.435531 10727 consensus_queue.cc:237] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.439898 10569 leader_election.cc:304] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:01:55.440783 10725 raft_consensus.cc:2804] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.412859 10720 tablet_bootstrap.cc:492] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:01:55.437958 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d89abdc24409182a279c238d12367" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.438453 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d89abdc24409182a279c238d12367" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:01:55.442082 10605 raft_consensus.cc:3060] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:55.442289 10494 leader_election.cc:343] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:55.438730 10719 tablet_bootstrap.cc:654] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.438541 10427 catalog_manager.cc:5697] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.441298 10725 raft_consensus.cc:697] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:01:55.443464 10725 consensus_queue.cc:237] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.443760 10765 raft_consensus.cc:515] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.441403 10759 raft_consensus.cc:515] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.447589 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:01:55.448371 10530 raft_consensus.cc:2393] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67171027597c4e919b278b6f103d2b79 in current term 1: Already voted for candidate f4190e0173b0466692d09b59af430573 in this term.
I20260709 13:01:55.450923 10765 leader_election.cc:290] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.451223 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.451807 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:01:55.452085 10676 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.452653 10604 raft_consensus.cc:2393] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4190e0173b0466692d09b59af430573 in current term 1: Already voted for candidate 67171027597c4e919b278b6f103d2b79 in this term.
I20260709 13:01:55.454416 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:55.414713 10603 raft_consensus.cc:2468] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:01:55.437253 10749 leader_election.cc:290] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.456944 10642 leader_election.cc:304] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:01:55.457860 10726 raft_consensus.cc:2804] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.457387 10605 raft_consensus.cc:2468] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 1.
I20260709 13:01:55.458252 10569 leader_election.cc:304] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67171027597c4e919b278b6f103d2b79; no voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573
I20260709 13:01:55.459790 10759 leader_election.cc:290] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.460995 10726 raft_consensus.cc:697] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:01:55.463164 10726 consensus_queue.cc:237] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.466902 10527 raft_consensus.cc:2468] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:01:55.467726 10427 catalog_manager.cc:5697] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.468852 10676 raft_consensus.cc:2468] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 1.
I20260709 13:01:55.470057 10765 raft_consensus.cc:2749] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.471485 10493 leader_election.cc:304] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038
I20260709 13:01:55.472754 10494 leader_election.cc:304] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 67171027597c4e919b278b6f103d2b79
I20260709 13:01:55.473644 10720 tablet_bootstrap.cc:654] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.474088 10727 raft_consensus.cc:2804] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.474646 10727 raft_consensus.cc:697] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:01:55.474798 10749 raft_consensus.cc:2804] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.475476 10749 raft_consensus.cc:697] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:01:55.475517 10727 consensus_queue.cc:237] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.476361 10749 consensus_queue.cc:237] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.478616 10426 catalog_manager.cc:5697] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.481841 10719 tablet_bootstrap.cc:492] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:55.482411 10719 ts_tablet_manager.cc:1403] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.002s
I20260709 13:01:55.485085 10719 raft_consensus.cc:359] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.491570 10719 raft_consensus.cc:385] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.491858 10719 raft_consensus.cc:740] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.492681 10719 consensus_queue.cc:260] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.495604 10719 ts_tablet_manager.cc:1434] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:01:55.497761 10719 tablet_bootstrap.cc:492] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:01:55.502269 10720 tablet_bootstrap.cc:492] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:55.503254 10720 ts_tablet_manager.cc:1403] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.017s
I20260709 13:01:55.506819 10719 tablet_bootstrap.cc:654] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.506335 10425 catalog_manager.cc:5697] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.507972 10720 raft_consensus.cc:359] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.508742 10720 raft_consensus.cc:385] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.509008 10720 raft_consensus.cc:740] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.509806 10720 consensus_queue.cc:260] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.511773 10720 ts_tablet_manager.cc:1434] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:55.512745 10720 tablet_bootstrap.cc:492] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:01:55.518227 10720 tablet_bootstrap.cc:654] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.525718 10719 tablet_bootstrap.cc:492] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:01:55.526422 10719 ts_tablet_manager.cc:1403] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.008s
I20260709 13:01:55.528034 10428 catalog_manager.cc:5697] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.530390 10719 raft_consensus.cc:359] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.531431 10719 raft_consensus.cc:385] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.531692 10719 raft_consensus.cc:740] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.531011 10428 catalog_manager.cc:5697] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.532373 10719 consensus_queue.cc:260] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.533726 10720 tablet_bootstrap.cc:492] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:01:55.534288 10720 ts_tablet_manager.cc:1403] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.012s
I20260709 13:01:55.534317 10719 ts_tablet_manager.cc:1434] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:55.537187 10720 raft_consensus.cc:359] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.537915 10720 raft_consensus.cc:385] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.538223 10720 raft_consensus.cc:740] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.538897 10720 consensus_queue.cc:260] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.540958 10720 ts_tablet_manager.cc:1434] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:55.582389 10726 raft_consensus.cc:493] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.582989 10726 raft_consensus.cc:515] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.585112 10726 leader_election.cc:290] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:01:55.585939 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.586285 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.586725 10527 raft_consensus.cc:2393] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11140cca63e141da877ecc4a11a12038 in current term 1: Already voted for candidate f4190e0173b0466692d09b59af430573 in this term.
I20260709 13:01:55.587157 10605 raft_consensus.cc:2393] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11140cca63e141da877ecc4a11a12038 in current term 1: Already voted for candidate 67171027597c4e919b278b6f103d2b79 in this term.
I20260709 13:01:55.588202 10642 leader_election.cc:304] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11140cca63e141da877ecc4a11a12038; no voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573
I20260709 13:01:55.588894 10726 raft_consensus.cc:3060] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.590747 10766 raft_consensus.cc:493] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.591323 10766 raft_consensus.cc:515] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.593497 10766 leader_election.cc:290] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:01:55.594333 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d89abdc24409182a279c238d12367" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.594712 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d89abdc24409182a279c238d12367" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.595593 10605 raft_consensus.cc:2393] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11140cca63e141da877ecc4a11a12038 in current term 1: Already voted for candidate f4190e0173b0466692d09b59af430573 in this term.
I20260709 13:01:55.596573 10642 leader_election.cc:304] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11140cca63e141da877ecc4a11a12038; no voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573
I20260709 13:01:55.596840 10726 raft_consensus.cc:2749] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.597630 10726 raft_consensus.cc:3060] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.599001 10749 consensus_queue.cc:1048] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:55.604126 10726 raft_consensus.cc:2749] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.611682 10749 consensus_queue.cc:1048] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:55.612902 10766 raft_consensus.cc:493] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.613525 10766 raft_consensus.cc:515] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.615986 10766 leader_election.cc:290] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:01:55.617419 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0b9cd3d4ed46bdb4c13dd19702fbbd" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:01:55.617549 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0b9cd3d4ed46bdb4c13dd19702fbbd" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.618427 10603 raft_consensus.cc:2468] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:01:55.618546 10527 raft_consensus.cc:2468] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:01:55.620072 10645 leader_election.cc:304] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:55.620934 10766 raft_consensus.cc:2804] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:55.621326 10766 raft_consensus.cc:493] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.621613 10766 raft_consensus.cc:3060] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.627326 10766 raft_consensus.cc:515] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.629634 10766 leader_election.cc:290] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:01:55.630553 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0b9cd3d4ed46bdb4c13dd19702fbbd" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:01:55.630879 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0b9cd3d4ed46bdb4c13dd19702fbbd" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:01:55.631261 10527 raft_consensus.cc:3060] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.631615 10603 raft_consensus.cc:3060] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.638267 10603 raft_consensus.cc:2468] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:01:55.638947 10527 raft_consensus.cc:2468] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:01:55.639599 10642 leader_election.cc:304] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:01:55.640519 10766 raft_consensus.cc:2804] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.640936 10766 raft_consensus.cc:697] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:01:55.641714 10766 consensus_queue.cc:237] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.650797 10428 catalog_manager.cc:5697] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.777545 10759 consensus_queue.cc:1048] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:55.789497 10727 consensus_queue.cc:1048] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:55.873914 10725 raft_consensus.cc:493] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.874718 10725 raft_consensus.cc:515] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:55.876039 10603 raft_consensus.cc:3060] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.877074 10725 leader_election.cc:290] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:55.877700 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55f052034674a66930c284c698f08b4" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:55.878675 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55f052034674a66930c284c698f08b4" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:55.879565 10677 raft_consensus.cc:2393] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67171027597c4e919b278b6f103d2b79 in current term 1: Already voted for candidate f4190e0173b0466692d09b59af430573 in this term.
I20260709 13:01:55.879684 10727 consensus_queue.cc:1048] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:55.880733 10569 leader_election.cc:304] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67171027597c4e919b278b6f103d2b79; no voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573
I20260709 13:01:55.883570 10725 raft_consensus.cc:2749] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:55.884537 10727 consensus_queue.cc:1048] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:55.900110 10746 consensus_queue.cc:1048] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:55.907955 10746 consensus_queue.cc:1048] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:55.908476 10725 consensus_queue.cc:1048] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:55.927387 10765 consensus_queue.cc:1048] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:55.990918 10766 consensus_queue.cc:1048] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:56.005239 10792 consensus_queue.cc:1048] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:56.028844 10786 consensus_queue.cc:1048] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:56.048503 10792 consensus_queue.cc:1048] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:56.050402 10746 consensus_queue.cc:1048] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:56.065547 10726 consensus_queue.cc:1048] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:56.133948 10476 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:56.969641 10765 raft_consensus.cc:493] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.970325 10765 raft_consensus.cc:515] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:56.972417 10765 leader_election.cc:290] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:56.973202 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:01:56.973471 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:01:56.973912 10527 raft_consensus.cc:2468] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 1.
I20260709 13:01:56.974236 10676 raft_consensus.cc:2468] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 1.
I20260709 13:01:56.975234 10571 leader_election.cc:304] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:56.976027 10765 raft_consensus.cc:2804] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:56.976353 10765 raft_consensus.cc:493] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.976759 10765 raft_consensus.cc:3060] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:56.981726 10765 raft_consensus.cc:515] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:56.983256 10765 leader_election.cc:290] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:56.984212 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:01:56.984282 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841df69af28445048305f460e47f68b1" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:56.984804 10527 raft_consensus.cc:3060] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:56.985040 10676 raft_consensus.cc:3060] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:56.991091 10527 raft_consensus.cc:2468] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:01:56.991209 10676 raft_consensus.cc:2468] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:01:56.992138 10571 leader_election.cc:304] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:56.993032 10765 raft_consensus.cc:2804] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:56.994182 10765 raft_consensus.cc:697] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:01:56.995019 10765 consensus_queue.cc:237] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.002936 10428 catalog_manager.cc:5697] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 0 to 2, leader changed from <none> to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.363108 10603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f589853ab39847069098b4c73622f928"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
mode: GRACEFUL
new_leader_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:36394
I20260709 13:01:57.363758 10603 raft_consensus.cc:606] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Received request to transfer leadership to TS f4190e0173b0466692d09b59af430573
I20260709 13:01:57.381904 10527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842"
dest_uuid: "f4190e0173b0466692d09b59af430573"
mode: GRACEFUL
new_leader_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:41270
I20260709 13:01:57.382516 10527 raft_consensus.cc:606] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Received request to transfer leadership to TS 67171027597c4e919b278b6f103d2b79
I20260709 13:01:57.387987 10527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2650143aa3d2445890518fcc7cc1753c"
dest_uuid: "f4190e0173b0466692d09b59af430573"
mode: GRACEFUL
new_leader_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:41270
I20260709 13:01:57.388612 10527 raft_consensus.cc:606] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Received request to transfer leadership to TS 67171027597c4e919b278b6f103d2b79
I20260709 13:01:57.392784 10807 raft_consensus.cc:993] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573: : Instructing follower 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:01:57.393239 10746 raft_consensus.cc:1081] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Signalling peer 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:01:57.395063 10603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:36390
I20260709 13:01:57.395712 10603 raft_consensus.cc:493] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.396091 10603 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.403244 10603 raft_consensus.cc:515] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.404881 10676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5a223eb469244b6ba05201f21382bf9"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
mode: GRACEFUL
new_leader_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:01:57.405308 10603 leader_election.cc:290] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:57.405719 10676 raft_consensus.cc:606] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Received request to transfer leadership to TS 67171027597c4e919b278b6f103d2b79
I20260709 13:01:57.406261 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:01:57.406472 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:57.406939 10527 raft_consensus.cc:3055] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:57.407166 10677 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.407334 10527 raft_consensus.cc:740] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:01:57.408447 10527 consensus_queue.cc:260] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.409696 10527 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.413434 10677 raft_consensus.cc:2468] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:01:57.414809 10569 leader_election.cc:304] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:01:57.415483 10527 raft_consensus.cc:2468] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:01:57.415566 10765 raft_consensus.cc:2804] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.416254 10765 raft_consensus.cc:697] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:01:57.417268 10765 consensus_queue.cc:237] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.424574 10428 catalog_manager.cc:5697] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 1 to 2, leader changed from f4190e0173b0466692d09b59af430573 (127.0.107.193) to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.458279 10677 raft_consensus.cc:1275] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:57.459815 10765 consensus_queue.cc:1048] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:57.473345 10527 raft_consensus.cc:1275] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:57.474923 10798 consensus_queue.cc:1048] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:57.757582 10792 raft_consensus.cc:993] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038: : Instructing follower 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:01:57.758054 10792 raft_consensus.cc:1081] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Signalling peer 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:01:57.759733 10603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5a223eb469244b6ba05201f21382bf9"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:36392
I20260709 13:01:57.760259 10603 raft_consensus.cc:493] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.760525 10603 raft_consensus.cc:3060] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.766192 10603 raft_consensus.cc:515] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.768486 10603 leader_election.cc:290] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:57.769374 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a223eb469244b6ba05201f21382bf9" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:01:57.769629 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a223eb469244b6ba05201f21382bf9" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:57.770120 10527 raft_consensus.cc:3060] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.770174 10677 raft_consensus.cc:3055] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:57.770609 10677 raft_consensus.cc:740] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:01:57.771472 10677 consensus_queue.cc:260] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.772782 10677 raft_consensus.cc:3060] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.777863 10527 raft_consensus.cc:2468] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:01:57.779912 10571 leader_election.cc:304] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:57.780225 10765 raft_consensus.cc:993] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79: : Instructing follower f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:01:57.780506 10677 raft_consensus.cc:2468] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:01:57.780766 10798 raft_consensus.cc:1081] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Signalling peer f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:01:57.781749 10798 raft_consensus.cc:2804] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.782199 10798 raft_consensus.cc:697] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:01:57.783532 10527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f589853ab39847069098b4c73622f928"
dest_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:41264
I20260709 13:01:57.783349 10798 consensus_queue.cc:237] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.784153 10527 raft_consensus.cc:493] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.784566 10527 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.792470 10527 raft_consensus.cc:515] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.793515 10807 raft_consensus.cc:993] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573: : Instructing follower 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:01:57.792661 10426 catalog_manager.cc:5697] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 1 to 2, leader changed from 11140cca63e141da877ecc4a11a12038 (127.0.107.195) to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.794086 10807 raft_consensus.cc:1081] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Signalling peer 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:01:57.795001 10527 leader_election.cc:290] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:57.796140 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:57.796607 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:01:57.796779 10677 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.797256 10603 raft_consensus.cc:3055] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:57.797502 10605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2650143aa3d2445890518fcc7cc1753c"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:36390
I20260709 13:01:57.797665 10603 raft_consensus.cc:740] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:01:57.798359 10605 raft_consensus.cc:493] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.798766 10605 raft_consensus.cc:3060] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.799116 10603 consensus_queue.cc:260] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.800859 10603 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.804842 10677 raft_consensus.cc:2468] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:01:57.806291 10494 leader_election.cc:304] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:57.807322 10746 raft_consensus.cc:2804] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.807852 10746 raft_consensus.cc:697] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:01:57.807945 10605 raft_consensus.cc:515] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.808393 10603 raft_consensus.cc:2468] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:01:57.808756 10746 consensus_queue.cc:237] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.809230 10527 raft_consensus.cc:1275] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.810604 10605 leader_election.cc:290] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:01:57.811663 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2650143aa3d2445890518fcc7cc1753c" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:01:57.811723 10798 consensus_queue.cc:1048] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:57.812376 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2650143aa3d2445890518fcc7cc1753c" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:01:57.812631 10527 raft_consensus.cc:3055] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:57.813124 10677 raft_consensus.cc:3060] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.813277 10527 raft_consensus.cc:740] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:01:57.818058 10527 consensus_queue.cc:260] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.819741 10527 raft_consensus.cc:3060] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.823626 10426 catalog_manager.cc:5697] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 1 to 2, leader changed from 67171027597c4e919b278b6f103d2b79 (127.0.107.194) to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.828435 10677 raft_consensus.cc:2468] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:01:57.830899 10527 raft_consensus.cc:2468] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:01:57.832262 10571 leader_election.cc:304] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:01:57.833232 10798 raft_consensus.cc:2804] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.837996 10677 raft_consensus.cc:1275] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.839537 10765 consensus_queue.cc:1048] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:57.843535 10798 raft_consensus.cc:697] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:01:57.844609 10798 consensus_queue.cc:237] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:01:57.854529 10428 catalog_manager.cc:5697] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 1 to 2, leader changed from f4190e0173b0466692d09b59af430573 (127.0.107.193) to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.221792 10605 raft_consensus.cc:1275] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:58.223284 10807 consensus_queue.cc:1048] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:58.236696 10676 raft_consensus.cc:1275] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:58.238170 10807 consensus_queue.cc:1048] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:58.328025 10676 raft_consensus.cc:1275] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:58.329695 10798 consensus_queue.cc:1048] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:58.330446 10530 raft_consensus.cc:1275] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:58.331887 10798 consensus_queue.cc:1048] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:58.339586 10527 raft_consensus.cc:1275] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:58.341547 10765 consensus_queue.cc:1048] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:58.347687 10677 raft_consensus.cc:1275] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:58.353089 10822 consensus_queue.cc:1048] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:00.444562 10426 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45190:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:00.447515 10426 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:00.503427 10518 tablet_service.cc:1511] Processing CreateTablet for tablet b6011907216b4c0f8b9bd2b6e3b11fc3 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:00.504930 10518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6011907216b4c0f8b9bd2b6e3b11fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.504470 10593 tablet_service.cc:1511] Processing CreateTablet for tablet b6011907216b4c0f8b9bd2b6e3b11fc3 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:00.505110 10669 tablet_service.cc:1511] Processing CreateTablet for tablet b6011907216b4c0f8b9bd2b6e3b11fc3 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:00.506172 10593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6011907216b4c0f8b9bd2b6e3b11fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.506453 10669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6011907216b4c0f8b9bd2b6e3b11fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.508737 10517 tablet_service.cc:1511] Processing CreateTablet for tablet 99c272c78eab4922ab12f736f031d8db (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:00.510231 10517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c272c78eab4922ab12f736f031d8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.509824 10595 tablet_service.cc:1511] Processing CreateTablet for tablet 99c272c78eab4922ab12f736f031d8db (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:00.510556 10667 tablet_service.cc:1511] Processing CreateTablet for tablet 99c272c78eab4922ab12f736f031d8db (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:00.511313 10595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c272c78eab4922ab12f736f031d8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.512202 10667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c272c78eab4922ab12f736f031d8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.520481 10515 tablet_service.cc:1511] Processing CreateTablet for tablet fa396dfc31ea40b2979db0bfff6ed1bb (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:00.522013 10515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa396dfc31ea40b2979db0bfff6ed1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.524457 10590 tablet_service.cc:1511] Processing CreateTablet for tablet fa396dfc31ea40b2979db0bfff6ed1bb (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:00.525210 10592 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4155fc9ebc44199a0575c4e7a88dde (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:00.525885 10590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa396dfc31ea40b2979db0bfff6ed1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.526535 10592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4155fc9ebc44199a0575c4e7a88dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.528693 10514 tablet_service.cc:1511] Processing CreateTablet for tablet 021a22a9f7b14f42b787f4d2eeb438d7 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:00.529699 10665 tablet_service.cc:1511] Processing CreateTablet for tablet fa396dfc31ea40b2979db0bfff6ed1bb (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:00.550836 10663 tablet_service.cc:1511] Processing CreateTablet for tablet 021a22a9f7b14f42b787f4d2eeb438d7 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:00.552042 10665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa396dfc31ea40b2979db0bfff6ed1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.552170 10591 tablet_service.cc:1511] Processing CreateTablet for tablet 021a22a9f7b14f42b787f4d2eeb438d7 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:00.553344 10519 tablet_service.cc:1511] Processing CreateTablet for tablet 232cc3870a6f4d4895e643c58203cc46 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:00.554212 10591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021a22a9f7b14f42b787f4d2eeb438d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.531406 10664 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4155fc9ebc44199a0575c4e7a88dde (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:00.557250 10664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4155fc9ebc44199a0575c4e7a88dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.559736 10594 tablet_service.cc:1511] Processing CreateTablet for tablet 232cc3870a6f4d4895e643c58203cc46 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:00.560681 10663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021a22a9f7b14f42b787f4d2eeb438d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.561311 10594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232cc3870a6f4d4895e643c58203cc46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.531730 10516 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4155fc9ebc44199a0575c4e7a88dde (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:00.549965 10514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021a22a9f7b14f42b787f4d2eeb438d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.562817 10516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4155fc9ebc44199a0575c4e7a88dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.569941 10519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232cc3870a6f4d4895e643c58203cc46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.584738 10845 tablet_bootstrap.cc:492] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:02:00.592936 10513 tablet_service.cc:1511] Processing CreateTablet for tablet f4d035bc5ff6447b87cddf20562d73ce (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:00.594795 10513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d035bc5ff6447b87cddf20562d73ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.594530 10589 tablet_service.cc:1511] Processing CreateTablet for tablet f4d035bc5ff6447b87cddf20562d73ce (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:00.596045 10589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d035bc5ff6447b87cddf20562d73ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.605104 10845 tablet_bootstrap.cc:654] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.605363 10846 tablet_bootstrap.cc:492] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:00.606858 10668 tablet_service.cc:1511] Processing CreateTablet for tablet 232cc3870a6f4d4895e643c58203cc46 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:00.608417 10668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232cc3870a6f4d4895e643c58203cc46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.626508 10845 tablet_bootstrap.cc:492] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:00.627077 10846 tablet_bootstrap.cc:654] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.627166 10845 ts_tablet_manager.cc:1403] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.006s
I20260709 13:02:00.633091 10665 tablet_service.cc:1511] Processing CreateTablet for tablet f4d035bc5ff6447b87cddf20562d73ce (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:00.635298 10665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d035bc5ff6447b87cddf20562d73ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.638585 10845 raft_consensus.cc:359] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.640039 10845 raft_consensus.cc:385] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.640455 10845 raft_consensus.cc:740] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.641383 10845 consensus_queue.cc:260] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.644325 10845 ts_tablet_manager.cc:1434] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.007s
I20260709 13:02:00.652855 10520 tablet_service.cc:1511] Processing CreateTablet for tablet 33587b7a200e4404ad6430066c4a0159 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:00.655612 10589 tablet_service.cc:1511] Processing CreateTablet for tablet 33587b7a200e4404ad6430066c4a0159 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:00.657061 10589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33587b7a200e4404ad6430066c4a0159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.657859 10845 tablet_bootstrap.cc:492] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:02:00.659698 10520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33587b7a200e4404ad6430066c4a0159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.684924 10512 tablet_service.cc:1511] Processing CreateTablet for tablet 3797e38171ab4a56a19737986751d00b (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:00.687023 10512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3797e38171ab4a56a19737986751d00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.688032 10594 tablet_service.cc:1511] Processing CreateTablet for tablet 3797e38171ab4a56a19737986751d00b (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:00.684829 10666 tablet_service.cc:1511] Processing CreateTablet for tablet 33587b7a200e4404ad6430066c4a0159 (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:00.689344 10594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3797e38171ab4a56a19737986751d00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.689756 10666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33587b7a200e4404ad6430066c4a0159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.695286 10662 tablet_service.cc:1511] Processing CreateTablet for tablet 3797e38171ab4a56a19737986751d00b (DEFAULT_TABLE table=soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:00.697513 10662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3797e38171ab4a56a19737986751d00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.730506 10845 tablet_bootstrap.cc:654] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.759618 10849 tablet_bootstrap.cc:492] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:00.764453 10846 tablet_bootstrap.cc:492] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:00.766088 10846 ts_tablet_manager.cc:1403] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.161s	user 0.022s	sys 0.009s
I20260709 13:02:00.769316 10846 raft_consensus.cc:359] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.770192 10846 raft_consensus.cc:385] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.770496 10846 raft_consensus.cc:740] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.771345 10846 consensus_queue.cc:260] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.778086 10846 ts_tablet_manager.cc:1434] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:00.779181 10846 tablet_bootstrap.cc:492] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:00.784595 10849 tablet_bootstrap.cc:654] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.786247 10846 tablet_bootstrap.cc:654] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.792930 10845 tablet_bootstrap.cc:492] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:00.793635 10845 ts_tablet_manager.cc:1403] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.019s
I20260709 13:02:00.795601 10849 tablet_bootstrap.cc:492] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:00.795699 10846 tablet_bootstrap.cc:492] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:00.796381 10849 ts_tablet_manager.cc:1403] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.006s
I20260709 13:02:00.796445 10846 ts_tablet_manager.cc:1403] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.005s
I20260709 13:02:00.797048 10845 raft_consensus.cc:359] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.798012 10845 raft_consensus.cc:385] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.798348 10845 raft_consensus.cc:740] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.799572 10846 raft_consensus.cc:359] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.799300 10845 consensus_queue.cc:260] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.800238 10846 raft_consensus.cc:385] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.799893 10849 raft_consensus.cc:359] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.801772 10849 raft_consensus.cc:385] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.802343 10849 raft_consensus.cc:740] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.803087 10845 ts_tablet_manager.cc:1434] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:02:00.803261 10849 consensus_queue.cc:260] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.800596 10846 raft_consensus.cc:740] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.804181 10845 tablet_bootstrap.cc:492] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:02:00.804653 10846 consensus_queue.cc:260] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.807262 10846 ts_tablet_manager.cc:1434] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:00.808320 10846 tablet_bootstrap.cc:492] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:00.811800 10845 tablet_bootstrap.cc:654] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.815282 10846 tablet_bootstrap.cc:654] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:00.826725 10705 tablet.cc:2406] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:00.831110 10846 tablet_bootstrap.cc:492] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:00.831929 10846 ts_tablet_manager.cc:1403] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 13:02:00.836434 10846 raft_consensus.cc:359] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.837471 10846 raft_consensus.cc:385] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.837888 10846 raft_consensus.cc:740] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.838651 10846 consensus_queue.cc:260] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.841877 10846 ts_tablet_manager.cc:1434] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:02:00.851974 10846 tablet_bootstrap.cc:492] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:00.854035 10849 ts_tablet_manager.cc:1434] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.057s	user 0.012s	sys 0.028s
I20260709 13:02:00.855341 10849 tablet_bootstrap.cc:492] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:00.858763 10845 tablet_bootstrap.cc:492] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:00.859056 10846 tablet_bootstrap.cc:654] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.859504 10845 ts_tablet_manager.cc:1403] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.023s
I20260709 13:02:00.861882 10849 tablet_bootstrap.cc:654] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.863389 10845 raft_consensus.cc:359] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.864591 10845 raft_consensus.cc:385] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.865034 10845 raft_consensus.cc:740] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.866135 10845 consensus_queue.cc:260] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.868980 10845 ts_tablet_manager.cc:1434] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:00.870146 10845 tablet_bootstrap.cc:492] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:02:00.874639 10846 tablet_bootstrap.cc:492] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:00.875265 10846 ts_tablet_manager.cc:1403] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:02:00.877532 10845 tablet_bootstrap.cc:654] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.878424 10846 raft_consensus.cc:359] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.879305 10846 raft_consensus.cc:385] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.879634 10846 raft_consensus.cc:740] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.880457 10846 consensus_queue.cc:260] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.885393 10849 tablet_bootstrap.cc:492] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:00.886174 10849 ts_tablet_manager.cc:1403] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.010s
I20260709 13:02:00.886802 10846 ts_tablet_manager.cc:1434] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:00.887949 10846 tablet_bootstrap.cc:492] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:00.890527 10849 raft_consensus.cc:359] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.891558 10849 raft_consensus.cc:385] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.891964 10849 raft_consensus.cc:740] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.893082 10849 consensus_queue.cc:260] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.895076 10846 tablet_bootstrap.cc:654] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.896255 10849 ts_tablet_manager.cc:1434] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:00.897291 10849 tablet_bootstrap.cc:492] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:00.902838 10845 tablet_bootstrap.cc:492] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:00.903941 10845 ts_tablet_manager.cc:1403] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.009s
I20260709 13:02:00.906046 10849 tablet_bootstrap.cc:654] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.907630 10845 raft_consensus.cc:359] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.908509 10845 raft_consensus.cc:385] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.908852 10845 raft_consensus.cc:740] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.910475 10845 consensus_queue.cc:260] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.914182 10845 ts_tablet_manager.cc:1434] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:02:00.915555 10792 raft_consensus.cc:493] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.916302 10792 raft_consensus.cc:515] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.919250 10792 leader_election.cc:290] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:00.921185 10845 tablet_bootstrap.cc:492] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:02:00.923494 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa396dfc31ea40b2979db0bfff6ed1bb" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:00.924647 10605 raft_consensus.cc:2468] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:02:00.931963 10845 tablet_bootstrap.cc:654] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.946424 10845 tablet_bootstrap.cc:492] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:00.947118 10845 ts_tablet_manager.cc:1403] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.006s
I20260709 13:02:00.948639 10642 leader_election.cc:304] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:02:00.950038 10792 raft_consensus.cc:2804] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.950577 10792 raft_consensus.cc:493] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.951000 10792 raft_consensus.cc:3060] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.951195 10845 raft_consensus.cc:359] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.952258 10845 raft_consensus.cc:385] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.952649 10845 raft_consensus.cc:740] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.953697 10845 consensus_queue.cc:260] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.964814 10845 ts_tablet_manager.cc:1434] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.017s	user 0.015s	sys 0.001s
I20260709 13:02:00.966328 10845 tablet_bootstrap.cc:492] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:02:00.968886 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa396dfc31ea40b2979db0bfff6ed1bb" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
W20260709 13:02:00.979120 10645 leader_election.cc:343] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.980326 10792 raft_consensus.cc:515] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:00.983707 10792 leader_election.cc:290] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:00.973760 10845 tablet_bootstrap.cc:654] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.985981 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa396dfc31ea40b2979db0bfff6ed1bb" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:00.987042 10605 raft_consensus.cc:3060] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.998211 10792 raft_consensus.cc:493] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.999187 10792 raft_consensus.cc:515] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.003703 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232cc3870a6f4d4895e643c58203cc46" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
W20260709 13:02:01.005997 10645 leader_election.cc:343] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.013180 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa396dfc31ea40b2979db0bfff6ed1bb" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.018117 10853 raft_consensus.cc:493] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.018944 10853 raft_consensus.cc:515] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.022912 10853 leader_election.cc:290] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
W20260709 13:02:01.017858 10645 leader_election.cc:343] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.026305 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:02:01.030509 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
W20260709 13:02:01.031288 10494 leader_election.cc:343] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.031399 10603 raft_consensus.cc:2468] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 0.
I20260709 13:02:01.033773 10493 leader_election.cc:304] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038
I20260709 13:02:01.037606 10853 raft_consensus.cc:2804] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.038357 10853 raft_consensus.cc:493] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.039343 10853 raft_consensus.cc:3060] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.043081 10792 leader_election.cc:290] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.044886 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232cc3870a6f4d4895e643c58203cc46" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.045958 10603 raft_consensus.cc:2468] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:02:01.049120 10642 leader_election.cc:304] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.050992 10792 raft_consensus.cc:2804] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.051544 10792 raft_consensus.cc:493] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.051980 10792 raft_consensus.cc:3060] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.070974 10792 raft_consensus.cc:515] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.071779 10605 raft_consensus.cc:2468] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:02:01.075140 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232cc3870a6f4d4895e643c58203cc46" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.077620 10849 tablet_bootstrap.cc:492] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:01.078186 10849 ts_tablet_manager.cc:1403] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.181s	user 0.047s	sys 0.089s
I20260709 13:02:01.078361 10845 tablet_bootstrap.cc:492] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:01.078878 10845 ts_tablet_manager.cc:1403] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.113s	user 0.042s	sys 0.055s
I20260709 13:02:01.078478 10853 raft_consensus.cc:515] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
W20260709 13:02:01.079005 10645 leader_election.cc:343] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.075201 10846 tablet_bootstrap.cc:492] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:01.079818 10846 ts_tablet_manager.cc:1403] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.192s	user 0.073s	sys 0.105s
I20260709 13:02:01.082185 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:01.081952 10845 raft_consensus.cc:359] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.082748 10845 raft_consensus.cc:385] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.082796 10603 raft_consensus.cc:3060] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.083137 10845 raft_consensus.cc:740] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.082975 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:01.083536 10846 raft_consensus.cc:359] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.084352 10846 raft_consensus.cc:385] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.084182 10845 consensus_queue.cc:260] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.084678 10846 raft_consensus.cc:740] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
W20260709 13:02:01.084997 10494 leader_election.cc:343] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.085467 10846 consensus_queue.cc:260] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.086927 10845 ts_tablet_manager.cc:1434] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:02:01.087792 10846 ts_tablet_manager.cc:1434] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:01.088128 10845 tablet_bootstrap.cc:492] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:02:01.090431 10849 raft_consensus.cc:359] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.091272 10849 raft_consensus.cc:385] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.091595 10849 raft_consensus.cc:740] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.092713 10849 consensus_queue.cc:260] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.095294 10849 ts_tablet_manager.cc:1434] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:02:01.095930 10845 tablet_bootstrap.cc:654] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.098021 10642 leader_election.cc:304] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.100765 10862 raft_consensus.cc:2804] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.099224 10603 raft_consensus.cc:2468] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 1.
I20260709 13:02:01.104076 10493 leader_election.cc:304] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038
I20260709 13:02:01.105540 10833 raft_consensus.cc:2804] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.109759 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232cc3870a6f4d4895e643c58203cc46" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:01.112818 10605 raft_consensus.cc:3060] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.113344 10833 raft_consensus.cc:697] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:02:01.115710 10833 consensus_queue.cc:237] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.117681 10862 raft_consensus.cc:697] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.099522 10846 tablet_bootstrap.cc:492] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:01.119403 10862 consensus_queue.cc:237] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.099663 10853 leader_election.cc:290] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.099556 10792 leader_election.cc:290] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.096853 10849 tablet_bootstrap.cc:492] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:01.134009 10849 tablet_bootstrap.cc:654] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.134192 10846 tablet_bootstrap.cc:654] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.140363 10428 catalog_manager.cc:5697] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.140866 10427 catalog_manager.cc:5697] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.133890 10605 raft_consensus.cc:2468] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:02:01.136260 10845 tablet_bootstrap.cc:492] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:01.139693 10862 raft_consensus.cc:493] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.144301 10845 ts_tablet_manager.cc:1403] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.008s
I20260709 13:02:01.144161 10862 raft_consensus.cc:515] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.144742 10642 leader_election.cc:304] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.145700 10865 raft_consensus.cc:2804] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.146451 10865 raft_consensus.cc:697] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.146603 10862 leader_election.cc:290] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.147946 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c272c78eab4922ab12f736f031d8db" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.147599 10865 consensus_queue.cc:237] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.148288 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c272c78eab4922ab12f736f031d8db" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:02:01.148977 10530 raft_consensus.cc:2468] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
W20260709 13:02:01.149358 10642 leader_election.cc:343] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.150701 10645 leader_election.cc:304] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 67171027597c4e919b278b6f103d2b79
I20260709 13:02:01.152347 10862 raft_consensus.cc:2804] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.152855 10862 raft_consensus.cc:493] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.153290 10862 raft_consensus.cc:3060] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.155156 10792 raft_consensus.cc:493] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.155763 10792 raft_consensus.cc:515] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.155856 10845 raft_consensus.cc:359] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.156567 10845 raft_consensus.cc:385] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.156857 10845 raft_consensus.cc:740] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.158035 10845 consensus_queue.cc:260] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.158949 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:02:01.160940 10845 ts_tablet_manager.cc:1434] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:02:01.162186 10845 tablet_bootstrap.cc:492] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
W20260709 13:02:01.162487 10645 leader_election.cc:343] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.162206 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.163952 10603 raft_consensus.cc:2468] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:02:01.165434 10642 leader_election.cc:304] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.166466 10792 leader_election.cc:290] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.166901 10862 raft_consensus.cc:515] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.167369 10792 raft_consensus.cc:2804] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.167982 10792 raft_consensus.cc:493] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.168438 10792 raft_consensus.cc:3060] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.168869 10845 tablet_bootstrap.cc:654] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.169162 10832 raft_consensus.cc:493] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.169796 10832 raft_consensus.cc:515] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.173729 10832 leader_election.cc:290] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.174464 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6011907216b4c0f8b9bd2b6e3b11fc3" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:02:01.175949 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6011907216b4c0f8b9bd2b6e3b11fc3" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:02:01.176892 10677 raft_consensus.cc:2468] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 0.
I20260709 13:02:01.178845 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c272c78eab4922ab12f736f031d8db" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.183272 10530 raft_consensus.cc:3060] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:01.177007 10571 leader_election.cc:343] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.184379 10846 tablet_bootstrap.cc:492] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:01.185191 10846 ts_tablet_manager.cc:1403] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.009s
I20260709 13:02:01.185441 10569 leader_election.cc:304] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.188215 10838 raft_consensus.cc:2804] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.188385 10846 raft_consensus.cc:359] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.188915 10838 raft_consensus.cc:493] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.189224 10846 raft_consensus.cc:385] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.189493 10838 raft_consensus.cc:3060] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.191864 10862 leader_election.cc:290] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.192230 10846 raft_consensus.cc:740] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.193070 10846 consensus_queue.cc:260] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.197824 10530 raft_consensus.cc:2468] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:02:01.199563 10645 leader_election.cc:304] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:01.200315 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c272c78eab4922ab12f736f031d8db" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:01.200721 10862 raft_consensus.cc:2804] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.201320 10605 raft_consensus.cc:3060] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.202123 10862 raft_consensus.cc:697] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.203830 10862 consensus_queue.cc:237] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.212296 10845 tablet_bootstrap.cc:492] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:01.213315 10845 ts_tablet_manager.cc:1403] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.022s
I20260709 13:02:01.211268 10605 raft_consensus.cc:2468] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:02:01.216580 10845 raft_consensus.cc:359] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.219575 10849 tablet_bootstrap.cc:492] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:01.219869 10846 ts_tablet_manager.cc:1434] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.003s
I20260709 13:02:01.220645 10849 ts_tablet_manager.cc:1403] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.010s
I20260709 13:02:01.217161 10845 raft_consensus.cc:385] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.221246 10846 tablet_bootstrap.cc:492] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:01.222059 10845 raft_consensus.cc:740] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.222970 10845 consensus_queue.cc:260] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.223939 10838 raft_consensus.cc:515] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.225435 10845 ts_tablet_manager.cc:1434] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:02:01.226876 10845 tablet_bootstrap.cc:492] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038: Bootstrap starting.
I20260709 13:02:01.227165 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6011907216b4c0f8b9bd2b6e3b11fc3" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
W20260709 13:02:01.229022 10571 leader_election.cc:343] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.234586 10845 tablet_bootstrap.cc:654] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.235939 10846 tablet_bootstrap.cc:654] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.236826 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6011907216b4c0f8b9bd2b6e3b11fc3" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:01.237811 10676 raft_consensus.cc:3060] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:01.238248 10476 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:01.249037 10838 leader_election.cc:290] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.234413 10792 raft_consensus.cc:515] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.257815 10849 raft_consensus.cc:359] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.261159 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.264824 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:01.266284 10605 raft_consensus.cc:3060] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:01.266779 10645 leader_election.cc:343] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.267696 10849 raft_consensus.cc:385] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.268963 10849 raft_consensus.cc:740] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.268507 10676 raft_consensus.cc:2468] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 1.
I20260709 13:02:01.270841 10569 leader_election.cc:304] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.272552 10876 raft_consensus.cc:2804] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.271456 10427 catalog_manager.cc:5697] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.274082 10605 raft_consensus.cc:2468] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:02:01.275378 10642 leader_election.cc:304] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.276007 10876 raft_consensus.cc:697] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:01.276284 10865 raft_consensus.cc:2804] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.277406 10876 consensus_queue.cc:237] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.268074 10792 leader_election.cc:290] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.292452 10865 raft_consensus.cc:697] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.292100 10849 consensus_queue.cc:260] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.296111 10865 consensus_queue.cc:237] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.274497 10427 catalog_manager.cc:5697] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.303694 10849 ts_tablet_manager.cc:1434] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 13:02:01.306941 10849 tablet_bootstrap.cc:492] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:01.314534 10845 tablet_bootstrap.cc:492] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038: No bootstrap required, opened a new log
I20260709 13:02:01.315136 10845 ts_tablet_manager.cc:1403] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038: Time spent bootstrapping tablet: real 0.088s	user 0.035s	sys 0.036s
I20260709 13:02:01.317871 10846 tablet_bootstrap.cc:492] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:01.317408 10428 catalog_manager.cc:5697] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.318158 10845 raft_consensus.cc:359] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.318456 10846 ts_tablet_manager.cc:1403] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.097s	user 0.058s	sys 0.024s
I20260709 13:02:01.318940 10845 raft_consensus.cc:385] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.319267 10845 raft_consensus.cc:740] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.319931 10845 consensus_queue.cc:260] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.321966 10845 ts_tablet_manager.cc:1434] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:01.322345 10846 raft_consensus.cc:359] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.323186 10846 raft_consensus.cc:385] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.323472 10846 raft_consensus.cc:740] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.330106 10846 consensus_queue.cc:260] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.332736 10846 ts_tablet_manager.cc:1434] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:01.333775 10846 tablet_bootstrap.cc:492] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:01.338096 10849 tablet_bootstrap.cc:654] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.337981 10427 catalog_manager.cc:5697] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.340520 10846 tablet_bootstrap.cc:654] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.348834 10846 tablet_bootstrap.cc:492] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:01.349614 10846 ts_tablet_manager.cc:1403] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.002s
I20260709 13:02:01.352061 10849 tablet_bootstrap.cc:492] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:01.352329 10846 raft_consensus.cc:359] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.352846 10849 ts_tablet_manager.cc:1403] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.003s
I20260709 13:02:01.353091 10846 raft_consensus.cc:385] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.353965 10846 raft_consensus.cc:740] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.354835 10846 consensus_queue.cc:260] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.356369 10849 raft_consensus.cc:359] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.356699 10846 ts_tablet_manager.cc:1434] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:02:01.357087 10849 raft_consensus.cc:385] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.357405 10849 raft_consensus.cc:740] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.358067 10846 tablet_bootstrap.cc:492] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79: Bootstrap starting.
I20260709 13:02:01.358117 10849 consensus_queue.cc:260] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.360957 10849 ts_tablet_manager.cc:1434] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:01.362116 10849 tablet_bootstrap.cc:492] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:01.364861 10846 tablet_bootstrap.cc:654] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.369190 10849 tablet_bootstrap.cc:654] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.376230 10846 tablet_bootstrap.cc:492] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79: No bootstrap required, opened a new log
I20260709 13:02:01.376742 10846 ts_tablet_manager.cc:1403] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:02:01.379379 10846 raft_consensus.cc:359] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.380074 10846 raft_consensus.cc:385] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.380359 10846 raft_consensus.cc:740] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.381127 10846 consensus_queue.cc:260] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.382830 10849 tablet_bootstrap.cc:492] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:01.383605 10846 ts_tablet_manager.cc:1434] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:01.384397 10849 ts_tablet_manager.cc:1403] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 13:02:01.388926 10849 raft_consensus.cc:359] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.389726 10849 raft_consensus.cc:385] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.390019 10849 raft_consensus.cc:740] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.390827 10849 consensus_queue.cc:260] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.393375 10849 ts_tablet_manager.cc:1434] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:02:01.394927 10849 tablet_bootstrap.cc:492] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:01.401451 10849 tablet_bootstrap.cc:654] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.402593 10865 raft_consensus.cc:493] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.403147 10865 raft_consensus.cc:515] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.405256 10865 leader_election.cc:290] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.405984 10876 raft_consensus.cc:493] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.406078 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021a22a9f7b14f42b787f4d2eeb438d7" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:02:01.406989 10530 raft_consensus.cc:2468] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:02:01.406672 10876 raft_consensus.cc:515] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.407485 10849 tablet_bootstrap.cc:492] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:01.407267 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021a22a9f7b14f42b787f4d2eeb438d7" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.408004 10849 ts_tablet_manager.cc:1403] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.002s
I20260709 13:02:01.408068 10605 raft_consensus.cc:2468] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:02:01.408355 10645 leader_election.cc:304] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:01.409165 10876 leader_election.cc:290] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.410022 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3797e38171ab4a56a19737986751d00b" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:02:01.411062 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3797e38171ab4a56a19737986751d00b" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
W20260709 13:02:01.411314 10571 leader_election.cc:343] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.411770 10676 raft_consensus.cc:2468] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 0.
I20260709 13:02:01.412271 10849 raft_consensus.cc:359] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.411406 10865 raft_consensus.cc:2804] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.412976 10849 raft_consensus.cc:385] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.413059 10865 raft_consensus.cc:493] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.413319 10849 raft_consensus.cc:740] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.413091 10569 leader_election.cc:304] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.414083 10865 raft_consensus.cc:3060] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.414677 10849 consensus_queue.cc:260] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.415019 10876 raft_consensus.cc:2804] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.415498 10876 raft_consensus.cc:493] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.415827 10876 raft_consensus.cc:3060] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.416702 10849 ts_tablet_manager.cc:1434] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:01.418066 10849 tablet_bootstrap.cc:492] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:01.423336 10882 raft_consensus.cc:493] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.423944 10882 raft_consensus.cc:515] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.424042 10865 raft_consensus.cc:515] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.424819 10849 tablet_bootstrap.cc:654] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.426270 10882 leader_election.cc:290] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.426697 10865 leader_election.cc:290] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.428274 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:02:01.428680 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021a22a9f7b14f42b787f4d2eeb438d7" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.429344 10527 raft_consensus.cc:3060] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.430907 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.431607 10605 raft_consensus.cc:2468] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 0.
I20260709 13:02:01.431950 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021a22a9f7b14f42b787f4d2eeb438d7" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:01.432546 10603 raft_consensus.cc:3060] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.432631 10642 leader_election.cc:304] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:02:01.433712 10865 raft_consensus.cc:2804] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.433147 10876 raft_consensus.cc:515] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
W20260709 13:02:01.433976 10645 leader_election.cc:343] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.434268 10865 raft_consensus.cc:493] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.434765 10865 raft_consensus.cc:3060] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.436779 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3797e38171ab4a56a19737986751d00b" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.436929 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3797e38171ab4a56a19737986751d00b" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:01.438146 10676 raft_consensus.cc:3060] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:01.439301 10571 leader_election.cc:343] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.442901 10865 raft_consensus.cc:515] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.444716 10865 leader_election.cc:290] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.445223 10882 raft_consensus.cc:493] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.445516 10876 leader_election.cc:290] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.445871 10882 raft_consensus.cc:515] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.446300 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:01.446982 10605 raft_consensus.cc:3060] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.448066 10882 leader_election.cc:290] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.448460 10676 raft_consensus.cc:2468] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 1.
I20260709 13:02:01.449970 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573" is_pre_election: true
I20260709 13:02:01.451323 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.452071 10604 raft_consensus.cc:2393] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11140cca63e141da877ecc4a11a12038 in current term 1: Already voted for candidate f4190e0173b0466692d09b59af430573 in this term.
I20260709 13:02:01.453141 10569 leader_election.cc:304] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.453189 10642 leader_election.cc:304] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11140cca63e141da877ecc4a11a12038; no voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573
I20260709 13:02:01.453325 10603 raft_consensus.cc:2468] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:02:01.454485 10882 raft_consensus.cc:3060] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.454938 10876 raft_consensus.cc:2804] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.455595 10876 raft_consensus.cc:697] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:01.456141 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.457980 10642 leader_election.cc:304] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:02:01.458724 10876 consensus_queue.cc:237] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
W20260709 13:02:01.459260 10645 leader_election.cc:343] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.459537 10849 tablet_bootstrap.cc:492] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:01.460067 10849 ts_tablet_manager.cc:1403] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.004s
I20260709 13:02:01.461786 10865 raft_consensus.cc:2804] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.462422 10865 raft_consensus.cc:697] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.463305 10865 consensus_queue.cc:237] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.463428 10849 raft_consensus.cc:359] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.456691 10527 raft_consensus.cc:2468] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:02:01.457154 10605 raft_consensus.cc:2468] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 1.
I20260709 13:02:01.466024 10849 raft_consensus.cc:385] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.466533 10849 raft_consensus.cc:740] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.467482 10849 consensus_queue.cc:260] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.470468 10849 ts_tablet_manager.cc:1434] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:01.466743 10642 leader_election.cc:304] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.464459 10882 raft_consensus.cc:2749] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.473296 10882 raft_consensus.cc:2804] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.473918 10882 raft_consensus.cc:697] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.476357 10849 tablet_bootstrap.cc:492] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573: Bootstrap starting.
I20260709 13:02:01.475222 10882 consensus_queue.cc:237] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.494910 10853 raft_consensus.cc:493] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.495601 10853 raft_consensus.cc:515] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.497875 10853 leader_election.cc:290] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.498476 10849 tablet_bootstrap.cc:654] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.500030 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.500880 10605 raft_consensus.cc:2393] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4190e0173b0466692d09b59af430573 in current term 1: Already voted for candidate 11140cca63e141da877ecc4a11a12038 in this term.
I20260709 13:02:01.501019 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:02:01.502646 10494 leader_election.cc:304] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79
I20260709 13:02:01.503706 10853 raft_consensus.cc:3060] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.506636 10425 catalog_manager.cc:5697] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.510013 10428 catalog_manager.cc:5697] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.516776 10853 raft_consensus.cc:2749] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.519500 10882 consensus_queue.cc:1048] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.522135 10849 tablet_bootstrap.cc:492] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573: No bootstrap required, opened a new log
I20260709 13:02:01.522693 10849 ts_tablet_manager.cc:1403] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.011s
I20260709 13:02:01.525509 10849 raft_consensus.cc:359] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.526294 10849 raft_consensus.cc:385] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.526621 10849 raft_consensus.cc:740] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.527273 10849 consensus_queue.cc:260] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.530252 10849 ts_tablet_manager.cc:1434] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:01.533170 10527 raft_consensus.cc:3060] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.534013 10425 catalog_manager.cc:5697] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.537811 10853 raft_consensus.cc:493] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.538373 10853 raft_consensus.cc:515] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.540534 10853 leader_election.cc:290] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.541666 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3797e38171ab4a56a19737986751d00b" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:02:01.542491 10676 raft_consensus.cc:2393] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4190e0173b0466692d09b59af430573 in current term 1: Already voted for candidate 67171027597c4e919b278b6f103d2b79 in this term.
I20260709 13:02:01.543401 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3797e38171ab4a56a19737986751d00b" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.545001 10494 leader_election.cc:304] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79
I20260709 13:02:01.546175 10853 raft_consensus.cc:3060] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.547689 10882 consensus_queue.cc:1048] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.557513 10853 raft_consensus.cc:2749] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.574167 10853 consensus_queue.cc:1048] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.585022 10866 consensus_queue.cc:1048] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.609369 10882 consensus_queue.cc:1048] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.619549 10527 raft_consensus.cc:3060] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.628432 10862 consensus_queue.cc:1048] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.645088 10862 consensus_queue.cc:1048] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.656395 10862 consensus_queue.cc:1048] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.679993 10838 consensus_queue.cc:1048] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.690265 10527 raft_consensus.cc:3060] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.698585 10832 consensus_queue.cc:1048] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.747869 10605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6011907216b4c0f8b9bd2b6e3b11fc3"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
mode: GRACEFUL
new_leader_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:36394
I20260709 13:02:01.748495 10605 raft_consensus.cc:606] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Received request to transfer leadership to TS f4190e0173b0466692d09b59af430573
I20260709 13:02:01.758870 10676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c272c78eab4922ab12f736f031d8db"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
mode: GRACEFUL
new_leader_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:02:01.759500 10676 raft_consensus.cc:606] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Received request to transfer leadership to TS f4190e0173b0466692d09b59af430573
I20260709 13:02:01.768373 10676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa396dfc31ea40b2979db0bfff6ed1bb"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
mode: GRACEFUL
new_leader_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:02:01.769227 10676 raft_consensus.cc:606] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Received request to transfer leadership to TS f4190e0173b0466692d09b59af430573
I20260709 13:02:01.776057 10676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
mode: GRACEFUL
new_leader_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:02:01.776603 10676 raft_consensus.cc:606] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Received request to transfer leadership to TS f4190e0173b0466692d09b59af430573
I20260709 13:02:01.777689 10862 consensus_queue.cc:1048] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.783043 10676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "021a22a9f7b14f42b787f4d2eeb438d7"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
mode: GRACEFUL
new_leader_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:02:01.783646 10676 raft_consensus.cc:606] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Received request to transfer leadership to TS 67171027597c4e919b278b6f103d2b79
I20260709 13:02:01.785305 10882 raft_consensus.cc:993] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: : Instructing follower f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:02:01.785881 10882 raft_consensus.cc:1081] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Signalling peer f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:02:01.788043 10530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde"
dest_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:41266
I20260709 13:02:01.788892 10530 raft_consensus.cc:493] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.789265 10530 raft_consensus.cc:3060] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.793787 10862 consensus_queue.cc:1048] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.796845 10530 raft_consensus.cc:515] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.802147 10530 leader_election.cc:290] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.804702 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:01.805526 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4155fc9ebc44199a0575c4e7a88dde" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:01.806123 10677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232cc3870a6f4d4895e643c58203cc46"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
mode: GRACEFUL
new_leader_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:02:01.808959 10676 raft_consensus.cc:3055] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:01.809427 10605 raft_consensus.cc:3060] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.809484 10676 raft_consensus.cc:740] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.810768 10676 consensus_queue.cc:260] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.809489 10677 raft_consensus.cc:606] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Received request to transfer leadership to TS 67171027597c4e919b278b6f103d2b79
I20260709 13:02:01.812247 10676 raft_consensus.cc:3060] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.817852 10605 raft_consensus.cc:2468] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:02:01.819865 10493 leader_election.cc:304] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:01.820700 10866 raft_consensus.cc:2804] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:01.821190 10866 raft_consensus.cc:697] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:02:01.822063 10676 raft_consensus.cc:2468] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:02:01.821934 10866 consensus_queue.cc:237] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.824527 10530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce"
dest_uuid: "f4190e0173b0466692d09b59af430573"
mode: GRACEFUL
new_leader_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:41270
I20260709 13:02:01.825331 10530 raft_consensus.cc:606] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Received request to transfer leadership to TS 67171027597c4e919b278b6f103d2b79
I20260709 13:02:01.831668 10425 catalog_manager.cc:5697] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 1 to 2, leader changed from 11140cca63e141da877ecc4a11a12038 (127.0.107.195) to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.833755 10676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
mode: GRACEFUL
new_leader_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:02:01.834527 10676 raft_consensus.cc:606] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Received request to transfer leadership to TS 67171027597c4e919b278b6f103d2b79
I20260709 13:02:01.841605 10605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3797e38171ab4a56a19737986751d00b"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
mode: GRACEFUL
new_leader_uuid: "11140cca63e141da877ecc4a11a12038"
 from {username='slave'} at 127.0.0.1:36394
I20260709 13:02:01.842245 10605 raft_consensus.cc:606] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Received request to transfer leadership to TS 11140cca63e141da877ecc4a11a12038
I20260709 13:02:01.850170 10877 consensus_queue.cc:1048] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.851754 10866 raft_consensus.cc:493] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.852327 10866 raft_consensus.cc:515] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.855930 10866 leader_election.cc:290] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.855794 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67171027597c4e919b278b6f103d2b79" is_pre_election: true
I20260709 13:02:01.856727 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11140cca63e141da877ecc4a11a12038" is_pre_election: true
I20260709 13:02:01.857388 10605 raft_consensus.cc:2393] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4190e0173b0466692d09b59af430573 in current term 1: Already voted for candidate 11140cca63e141da877ecc4a11a12038 in this term.
I20260709 13:02:01.857614 10832 raft_consensus.cc:993] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79: : Instructing follower 11140cca63e141da877ecc4a11a12038 to start an election
I20260709 13:02:01.858112 10832 raft_consensus.cc:1081] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Signalling peer 11140cca63e141da877ecc4a11a12038 to start an election
I20260709 13:02:01.859656 10676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3797e38171ab4a56a19737986751d00b"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
 from {username='slave'} at 127.0.0.1:57024
I20260709 13:02:01.860332 10676 raft_consensus.cc:493] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.860850 10676 raft_consensus.cc:3060] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.862129 10494 leader_election.cc:304] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4190e0173b0466692d09b59af430573; no voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79
I20260709 13:02:01.864003 10876 consensus_queue.cc:1048] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.866000 10866 raft_consensus.cc:3060] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.874437 10676 raft_consensus.cc:515] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.875031 10866 raft_consensus.cc:2749] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.875785 10677 raft_consensus.cc:1240] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Rejecting Update request from peer 67171027597c4e919b278b6f103d2b79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:01.877424 10676 leader_election.cc:290] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:01.879492 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3797e38171ab4a56a19737986751d00b" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:01.879381 10877 consensus_queue.cc:1059] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.880268 10605 raft_consensus.cc:3055] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:01.880616 10605 raft_consensus.cc:740] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:01.880586 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3797e38171ab4a56a19737986751d00b" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.881547 10530 raft_consensus.cc:3060] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.881796 10605 consensus_queue.cc:260] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.882828 10605 raft_consensus.cc:3060] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.887678 10605 raft_consensus.cc:2468] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 2.
W20260709 13:02:01.888109 10877 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:02:01.888752 10642 leader_election.cc:304] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:02:01.889039 10530 raft_consensus.cc:2468] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 2.
I20260709 13:02:01.889781 10862 raft_consensus.cc:2804] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:01.890318 10862 raft_consensus.cc:697] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 2 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.891230 10862 consensus_queue.cc:237] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.899418 10862 consensus_queue.cc:1048] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.900548 10425 catalog_manager.cc:5697] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 1 to 2, leader changed from 67171027597c4e919b278b6f103d2b79 (127.0.107.194) to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.909530 10882 raft_consensus.cc:993] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038: : Instructing follower 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:02:01.910207 10882 raft_consensus.cc:1081] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Signalling peer 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:02:01.912199 10605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:36392
I20260709 13:02:01.913631 10605 raft_consensus.cc:493] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.914011 10605 raft_consensus.cc:3060] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.916571 10882 consensus_queue.cc:1048] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.922219 10605 raft_consensus.cc:515] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.924408 10605 leader_election.cc:290] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:01.925814 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:01.927278 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33587b7a200e4404ad6430066c4a0159" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:01.928001 10677 raft_consensus.cc:3055] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:01.928357 10677 raft_consensus.cc:740] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:01.929270 10677 consensus_queue.cc:260] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.930516 10677 raft_consensus.cc:3060] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.936057 10677 raft_consensus.cc:2468] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:02:01.937543 10569 leader_election.cc:304] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: f4190e0173b0466692d09b59af430573
I20260709 13:02:01.938578 10877 raft_consensus.cc:2804] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:01.939177 10877 raft_consensus.cc:697] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:01.939934 10877 consensus_queue.cc:237] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:01.947742 10425 catalog_manager.cc:5697] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 1 to 2, leader changed from 11140cca63e141da877ecc4a11a12038 (127.0.107.195) to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.981267 10882 consensus_queue.cc:1048] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.993511 10865 consensus_queue.cc:1048] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.997395 10792 raft_consensus.cc:993] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038: : Instructing follower f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:02:01.997910 10792 raft_consensus.cc:1081] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Signalling peer f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:02:02.004153 10527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa396dfc31ea40b2979db0bfff6ed1bb"
dest_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:41266
I20260709 13:02:02.004737 10527 raft_consensus.cc:493] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.005091 10527 raft_consensus.cc:3060] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.006096 10792 raft_consensus.cc:993] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038: : Instructing follower 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:02:02.006600 10862 raft_consensus.cc:1081] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Signalling peer 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:02:02.008319 10605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "021a22a9f7b14f42b787f4d2eeb438d7"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:36392
I20260709 13:02:02.008842 10605 raft_consensus.cc:493] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.009351 10605 raft_consensus.cc:3060] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.013374 10527 raft_consensus.cc:515] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.015429 10527 leader_election.cc:290] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:02.016219 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa396dfc31ea40b2979db0bfff6ed1bb" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:02.016902 10603 raft_consensus.cc:3060] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.016899 10605 raft_consensus.cc:515] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.018873 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa396dfc31ea40b2979db0bfff6ed1bb" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:02.019495 10677 raft_consensus.cc:3055] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.019785 10677 raft_consensus.cc:740] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:02.020512 10677 consensus_queue.cc:260] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.021854 10677 raft_consensus.cc:3060] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.024565 10605 leader_election.cc:290] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:02.024647 10853 raft_consensus.cc:993] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573: : Instructing follower 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:02:02.024639 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021a22a9f7b14f42b787f4d2eeb438d7" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:02.025446 10853 raft_consensus.cc:1081] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Signalling peer 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:02:02.025588 10676 raft_consensus.cc:3055] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.025997 10676 raft_consensus.cc:740] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:02.026822 10676 consensus_queue.cc:260] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.028098 10676 raft_consensus.cc:3060] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.031745 10605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:36390
I20260709 13:02:02.032030 10603 raft_consensus.cc:2468] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:02:02.032490 10605 raft_consensus.cc:493] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.032997 10605 raft_consensus.cc:3060] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.033457 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021a22a9f7b14f42b787f4d2eeb438d7" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:02.033540 10493 leader_election.cc:304] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:02.034087 10677 raft_consensus.cc:2468] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:02:02.034313 10527 raft_consensus.cc:3060] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.035831 10866 raft_consensus.cc:2804] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.036500 10866 raft_consensus.cc:697] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:02:02.037529 10866 consensus_queue.cc:237] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.039386 10676 raft_consensus.cc:2468] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:02:02.040761 10569 leader_election.cc:304] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:02:02.041519 10877 raft_consensus.cc:2804] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.042272 10877 raft_consensus.cc:697] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:02.041340 10527 raft_consensus.cc:2468] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:02:02.043174 10877 consensus_queue.cc:237] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.042294 10605 raft_consensus.cc:515] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.046574 10605 leader_election.cc:290] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:02.047673 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:02.048986 10425 catalog_manager.cc:5697] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 1 to 2, leader changed from 11140cca63e141da877ecc4a11a12038 (127.0.107.195) to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.049882 10676 raft_consensus.cc:3060] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.053442 10428 catalog_manager.cc:5697] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 1 to 2, leader changed from 11140cca63e141da877ecc4a11a12038 (127.0.107.195) to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.054927 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d035bc5ff6447b87cddf20562d73ce" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:02.055577 10527 raft_consensus.cc:3055] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.055873 10527 raft_consensus.cc:740] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:02:02.059307 10676 raft_consensus.cc:2468] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:02:02.059249 10527 consensus_queue.cc:260] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.060563 10527 raft_consensus.cc:3060] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.060676 10569 leader_election.cc:304] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, 67171027597c4e919b278b6f103d2b79; no voters: 
I20260709 13:02:02.061990 10877 raft_consensus.cc:2804] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.062960 10877 raft_consensus.cc:697] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:02.063879 10877 consensus_queue.cc:237] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.067878 10527 raft_consensus.cc:2468] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:02:02.071390 10428 catalog_manager.cc:5697] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 1 to 2, leader changed from f4190e0173b0466692d09b59af430573 (127.0.107.193) to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.220394 10792 raft_consensus.cc:993] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038: : Instructing follower 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:02:02.220891 10792 raft_consensus.cc:1081] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Signalling peer 67171027597c4e919b278b6f103d2b79 to start an election
I20260709 13:02:02.223354 10605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "232cc3870a6f4d4895e643c58203cc46"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
 from {username='slave'} at 127.0.0.1:36392
I20260709 13:02:02.224035 10605 raft_consensus.cc:493] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.224341 10605 raft_consensus.cc:3060] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.230690 10605 raft_consensus.cc:515] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.232613 10605 leader_election.cc:290] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:02.233271 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232cc3870a6f4d4895e643c58203cc46" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:02.233955 10527 raft_consensus.cc:3060] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.234175 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232cc3870a6f4d4895e643c58203cc46" candidate_uuid: "67171027597c4e919b278b6f103d2b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:02.234906 10676 raft_consensus.cc:3055] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.235225 10676 raft_consensus.cc:740] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:02.236325 10676 consensus_queue.cc:260] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.237620 10676 raft_consensus.cc:3060] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.239593 10527 raft_consensus.cc:2468] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:02:02.240783 10571 leader_election.cc:304] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:02.241510 10877 raft_consensus.cc:2804] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.242058 10877 raft_consensus.cc:697] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Leader. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:02.243170 10877 consensus_queue.cc:237] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.244975 10676 raft_consensus.cc:2468] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67171027597c4e919b278b6f103d2b79 in term 2.
I20260709 13:02:02.251590 10428 catalog_manager.cc:5697] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 reported cstate change: term changed from 1 to 2, leader changed from 11140cca63e141da877ecc4a11a12038 (127.0.107.195) to 67171027597c4e919b278b6f103d2b79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "67171027597c4e919b278b6f103d2b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.254232 10792 raft_consensus.cc:993] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038: : Instructing follower f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:02:02.254426 10676 raft_consensus.cc:1275] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.254948 10792 raft_consensus.cc:1081] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Signalling peer f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:02:02.256171 10866 consensus_queue.cc:1048] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.256875 10527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99c272c78eab4922ab12f736f031d8db"
dest_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:41266
I20260709 13:02:02.257413 10527 raft_consensus.cc:493] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.257791 10527 raft_consensus.cc:3060] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.266930 10605 raft_consensus.cc:1275] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.271065 10833 consensus_queue.cc:1048] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.274729 10876 raft_consensus.cc:993] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: : Instructing follower f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:02:02.275233 10838 raft_consensus.cc:1081] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Signalling peer f4190e0173b0466692d09b59af430573 to start an election
I20260709 13:02:02.276939 10530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6011907216b4c0f8b9bd2b6e3b11fc3"
dest_uuid: "f4190e0173b0466692d09b59af430573"
 from {username='slave'} at 127.0.0.1:41264
I20260709 13:02:02.277521 10530 raft_consensus.cc:493] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.277937 10530 raft_consensus.cc:3060] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.282460 10527 raft_consensus.cc:515] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.285274 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c272c78eab4922ab12f736f031d8db" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:02.285974 10603 raft_consensus.cc:3060] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.286001 10676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c272c78eab4922ab12f736f031d8db" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:02.286679 10676 raft_consensus.cc:3055] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.286972 10676 raft_consensus.cc:740] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:02.287704 10676 consensus_queue.cc:260] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.288771 10676 raft_consensus.cc:3060] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.285384 10527 leader_election.cc:290] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:02.291162 10530 raft_consensus.cc:515] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.292776 10527 raft_consensus.cc:1275] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 11140cca63e141da877ecc4a11a12038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.294181 10792 consensus_queue.cc:1048] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.295819 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6011907216b4c0f8b9bd2b6e3b11fc3" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11140cca63e141da877ecc4a11a12038"
I20260709 13:02:02.296440 10677 raft_consensus.cc:3060] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.296558 10605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6011907216b4c0f8b9bd2b6e3b11fc3" candidate_uuid: "f4190e0173b0466692d09b59af430573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:02.297124 10605 raft_consensus.cc:3055] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.297380 10605 raft_consensus.cc:740] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:02.297816 10603 raft_consensus.cc:2468] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:02:02.298309 10605 consensus_queue.cc:260] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.299437 10605 raft_consensus.cc:3060] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.300293 10493 leader_election.cc:304] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67171027597c4e919b278b6f103d2b79, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:02.301345 10866 raft_consensus.cc:2804] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.301841 10866 raft_consensus.cc:697] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:02:02.302649 10866 consensus_queue.cc:237] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.301134 10676 raft_consensus.cc:2468] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:02:02.306044 10530 leader_election.cc:290] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Requested vote from peers 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769), 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715)
I20260709 13:02:02.308780 10677 raft_consensus.cc:2468] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:02:02.311546 10494 leader_election.cc:304] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:02.312547 10605 raft_consensus.cc:2468] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4190e0173b0466692d09b59af430573 in term 2.
I20260709 13:02:02.314317 10425 catalog_manager.cc:5697] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 1 to 2, leader changed from 11140cca63e141da877ecc4a11a12038 (127.0.107.195) to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.316370 10605 raft_consensus.cc:1275] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Refusing update from remote peer 11140cca63e141da877ecc4a11a12038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.316457 10833 raft_consensus.cc:2804] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.317040 10833 raft_consensus.cc:697] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Becoming Leader. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:02:02.317906 10833 consensus_queue.cc:237] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:02.319792 10882 consensus_queue.cc:1048] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.333284 10425 catalog_manager.cc:5697] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 reported cstate change: term changed from 1 to 2, leader changed from 67171027597c4e919b278b6f103d2b79 (127.0.107.194) to f4190e0173b0466692d09b59af430573 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f4190e0173b0466692d09b59af430573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.433353 10677 raft_consensus.cc:1275] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.434892 10838 consensus_queue.cc:1048] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.438021 10527 raft_consensus.cc:3060] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.445690 10527 raft_consensus.cc:1275] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.446972 10838 consensus_queue.cc:1048] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.524178 10605 raft_consensus.cc:1275] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.525540 10866 consensus_queue.cc:1048] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.535948 10677 raft_consensus.cc:1275] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.537631 10853 consensus_queue.cc:1048] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.539342 10677 raft_consensus.cc:1275] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.543972 10838 consensus_queue.cc:1048] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.553356 10527 raft_consensus.cc:1275] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.555025 10838 consensus_queue.cc:1048] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.640588 10527 raft_consensus.cc:1275] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.642449 10838 consensus_queue.cc:1048] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.660215 10678 raft_consensus.cc:1275] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.671518 10876 consensus_queue.cc:1048] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.704931 10676 raft_consensus.cc:1275] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.707036 10866 consensus_queue.cc:1048] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.713055 10678 raft_consensus.cc:1275] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.718495 10838 consensus_queue.cc:1048] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.732643 10527 raft_consensus.cc:1275] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Refusing update from remote peer 67171027597c4e919b278b6f103d2b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.735419 10877 consensus_queue.cc:1048] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.738572 10605 raft_consensus.cc:1275] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.741585 10853 consensus_queue.cc:1048] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.836061 10678 raft_consensus.cc:1275] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.837740 10853 consensus_queue.cc:1048] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.851329 10605 raft_consensus.cc:1275] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Refusing update from remote peer f4190e0173b0466692d09b59af430573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.853109 10833 consensus_queue.cc:1048] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:04.846557 10425 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45190:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:02:04.875663 10425 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45190:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:02:04.903321   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:05.109696 10955 log.cc:927] Time spent T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
I20260709 13:02:05.205022 10977 tablet.cc:1724] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.251574 10985 tablet.cc:1724] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:05.283485 10967 log.cc:927] Time spent T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:02:05.320717 10978 tablet.cc:1724] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:05.321676 10494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46715, user_credentials={real_user=slave}} blocked reactor thread for 66235.5us
I20260709 13:02:05.260450 10975 tablet.cc:1724] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.326318 10991 tablet.cc:1724] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.324618 10982 tablet.cc:1724] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.336434 10990 tablet.cc:1724] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.340469 10605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842"
dest_uuid: "67171027597c4e919b278b6f103d2b79"
mode: GRACEFUL
new_leader_uuid: "11140cca63e141da877ecc4a11a12038"
 from {username='slave'} at 127.0.0.1:51142
I20260709 13:02:05.341450 10605 raft_consensus.cc:606] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Received request to transfer leadership to TS 11140cca63e141da877ecc4a11a12038
I20260709 13:02:05.392302 10977 tablet.cc:1724] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.396409 10990 tablet.cc:1724] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:05.435468 10976 log.cc:927] Time spent T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
W20260709 13:02:05.459908 10986 log.cc:927] Time spent T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:02:05.461022 10993 tablet.cc:1724] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.472385 10992 tablet.cc:1724] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.444866 10982 tablet.cc:1724] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.496240 10983 raft_consensus.cc:993] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79: : Instructing follower 11140cca63e141da877ecc4a11a12038 to start an election
I20260709 13:02:05.510634 10983 raft_consensus.cc:1081] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Signalling peer 11140cca63e141da877ecc4a11a12038 to start an election
W20260709 13:02:05.514781 10984 log.cc:927] Time spent T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573: Append to log took a long time: real 0.194s	user 0.001s	sys 0.003s
I20260709 13:02:05.542804 11004 tablet.cc:1724] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.552091 10985 tablet.cc:1724] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.563804 11004 tablet.cc:1724] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.574406 10530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f589853ab39847069098b4c73622f928"
dest_uuid: "f4190e0173b0466692d09b59af430573"
mode: GRACEFUL
new_leader_uuid: "11140cca63e141da877ecc4a11a12038"
 from {username='slave'} at 127.0.0.1:39026
I20260709 13:02:05.575261 10530 raft_consensus.cc:606] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Received request to transfer leadership to TS 11140cca63e141da877ecc4a11a12038
I20260709 13:02:05.577595   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:05.578297   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:05.579370 10427 catalog_manager.cc:5789] TS f4190e0173b0466692d09b59af430573 (127.0.107.193:36167) does not have the latest schema for tablet 99c272c78eab4922ab12f736f031d8db (table soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]). Expected version 1 got 0
I20260709 13:02:05.580276 10427 catalog_manager.cc:5789] TS f4190e0173b0466692d09b59af430573 (127.0.107.193:36167) does not have the latest schema for tablet 7e4155fc9ebc44199a0575c4e7a88dde (table soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]). Expected version 1 got 0
I20260709 13:02:05.582803 10425 catalog_manager.cc:5789] TS 11140cca63e141da877ecc4a11a12038 (127.0.107.195:46715) does not have the latest schema for tablet 3797e38171ab4a56a19737986751d00b (table soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]). Expected version 1 got 0
I20260709 13:02:05.586757 10998 tablet.cc:1724] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.589727 10991 tablet.cc:1724] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.435568 10975 tablet.cc:1724] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:05.597703 10642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43769, user_credentials={real_user=slave}} blocked reactor thread for 90065.4us
W20260709 13:02:05.607916 10645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:36167, user_credentials={real_user=slave}} blocked reactor thread for 102227us
I20260709 13:02:05.627367 10674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
 from {username='slave'} at 127.0.0.1:57024
I20260709 13:02:05.628592 10674 raft_consensus.cc:493] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:05.628796 10428 catalog_manager.cc:5789] TS 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769) does not have the latest schema for tablet f4d035bc5ff6447b87cddf20562d73ce (table soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed]). Expected version 1 got 0
I20260709 13:02:05.628810 10985 tablet.cc:1724] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.629211 10674 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.638727 10990 tablet.cc:1724] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.651136 10994 tablet.cc:1724] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.654560 10978 tablet.cc:1724] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.653460 10992 tablet.cc:1724] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.660024 10991 tablet.cc:1724] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.680086 10993 tablet.cc:1724] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.662591 10998 tablet.cc:1724] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.711285 10674 raft_consensus.cc:515] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:05.711755 10977 tablet.cc:1724] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:05.714600 10674 leader_election.cc:290] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 3 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:05.715425 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:05.729112 10530 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.720758 10602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c74073742bf4c30bbd1b63946306842" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:05.732048 10602 raft_consensus.cc:3055] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:05.732477 10602 raft_consensus.cc:740] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67171027597c4e919b278b6f103d2b79, State: Running, Role: LEADER
I20260709 13:02:05.734184 10674 raft_consensus.cc:1240] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 3 FOLLOWER]: Rejecting Update request from peer 67171027597c4e919b278b6f103d2b79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:05.733634 10602 consensus_queue.cc:260] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:05.736119 10602 raft_consensus.cc:3060] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.750695 10530 raft_consensus.cc:2468] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 3.
I20260709 13:02:05.752298 10602 raft_consensus.cc:2468] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 3.
I20260709 13:02:05.752656 10645 leader_election.cc:304] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:05.754716 11005 raft_consensus.cc:2804] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:05.755314 11005 raft_consensus.cc:697] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 3 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:05.756407 11005 consensus_queue.cc:237] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:05.773687 10426 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428: soft_deleted_table [id=e6882e7fd8e5495cb35e76540f75dbed] alter complete (version 1)
I20260709 13:02:05.798424 10428 catalog_manager.cc:5697] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 2 to 3, leader changed from 67171027597c4e919b278b6f103d2b79 (127.0.107.194) to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.819890 10989 raft_consensus.cc:993] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573: : Instructing follower 11140cca63e141da877ecc4a11a12038 to start an election
I20260709 13:02:05.820663 10980 raft_consensus.cc:1081] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Signalling peer 11140cca63e141da877ecc4a11a12038 to start an election
I20260709 13:02:05.824044 10674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f589853ab39847069098b4c73622f928"
dest_uuid: "11140cca63e141da877ecc4a11a12038"
 from {username='slave'} at 127.0.0.1:57040
I20260709 13:02:05.824810 10674 raft_consensus.cc:493] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:05.825383 10674 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.835697 10674 raft_consensus.cc:515] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:05.838114 10674 leader_election.cc:290] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 3 election: Requested vote from peers f4190e0173b0466692d09b59af430573 (127.0.107.193:36167), 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769)
I20260709 13:02:05.838986 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4190e0173b0466692d09b59af430573"
I20260709 13:02:05.839434 10602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f589853ab39847069098b4c73622f928" candidate_uuid: "11140cca63e141da877ecc4a11a12038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67171027597c4e919b278b6f103d2b79"
I20260709 13:02:05.839916 10530 raft_consensus.cc:3055] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:05.840142 10602 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.840724 10530 raft_consensus.cc:740] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4190e0173b0466692d09b59af430573, State: Running, Role: LEADER
I20260709 13:02:05.841701 10530 consensus_queue.cc:260] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:05.842778 10530 raft_consensus.cc:3060] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.849532 10530 raft_consensus.cc:2468] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 3.
I20260709 13:02:05.850910 10645 leader_election.cc:304] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11140cca63e141da877ecc4a11a12038, f4190e0173b0466692d09b59af430573; no voters: 
I20260709 13:02:05.851773 11005 raft_consensus.cc:2804] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:05.852257 11005 raft_consensus.cc:697] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 3 LEADER]: Becoming Leader. State: Replica: 11140cca63e141da877ecc4a11a12038, State: Running, Role: LEADER
I20260709 13:02:05.852834 10602 raft_consensus.cc:2468] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11140cca63e141da877ecc4a11a12038 in term 3.
I20260709 13:02:05.853528 11005 consensus_queue.cc:237] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } }
I20260709 13:02:05.863842 10428 catalog_manager.cc:5697] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 reported cstate change: term changed from 2 to 3, leader changed from f4190e0173b0466692d09b59af430573 (127.0.107.193) to 11140cca63e141da877ecc4a11a12038 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "11140cca63e141da877ecc4a11a12038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11140cca63e141da877ecc4a11a12038" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46715 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:06.244524 10602 raft_consensus.cc:1275] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 3 FOLLOWER]: Refusing update from remote peer 11140cca63e141da877ecc4a11a12038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:06.245942 11005 consensus_queue.cc:1048] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:06.257316 10530 raft_consensus.cc:1275] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 3 FOLLOWER]: Refusing update from remote peer 11140cca63e141da877ecc4a11a12038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:06.259569 11005 consensus_queue.cc:1048] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:06.381212 10602 raft_consensus.cc:1275] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 3 FOLLOWER]: Refusing update from remote peer 11140cca63e141da877ecc4a11a12038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:06.382620 11005 consensus_queue.cc:1048] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67171027597c4e919b278b6f103d2b79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:06.396552 10530 raft_consensus.cc:1275] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 3 FOLLOWER]: Refusing update from remote peer 11140cca63e141da877ecc4a11a12038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:06.398116 11005 consensus_queue.cc:1048] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4190e0173b0466692d09b59af430573" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:06.646497   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:06.661320 10645 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260709 13:02:06.664722 10645 consensus_peers.cc:597] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 -> Peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Couldn't send request to peer f4190e0173b0466692d09b59af430573. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.681425   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:06.682816   431 tablet_replica.cc:333] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.683722   431 raft_consensus.cc:2243] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.684234   431 raft_consensus.cc:2272] T 3797e38171ab4a56a19737986751d00b P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.688565   431 tablet_replica.cc:333] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.689384   431 raft_consensus.cc:2243] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.690353   431 raft_consensus.cc:2272] T 7e4155fc9ebc44199a0575c4e7a88dde P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.693506   431 tablet_replica.cc:333] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.694468   431 raft_consensus.cc:2243] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.695458   431 raft_consensus.cc:2272] T fa396dfc31ea40b2979db0bfff6ed1bb P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.697881   431 tablet_replica.cc:333] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.698745   431 raft_consensus.cc:2243] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.699273   431 raft_consensus.cc:2272] T 232cc3870a6f4d4895e643c58203cc46 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.702436   431 tablet_replica.cc:333] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.703263   431 raft_consensus.cc:2243] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.703761   431 raft_consensus.cc:2272] T 021a22a9f7b14f42b787f4d2eeb438d7 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.706043   431 tablet_replica.cc:333] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.706700   431 raft_consensus.cc:2243] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.707623   431 raft_consensus.cc:2272] T d537ce7a7c704c82ad0931398f54f5b0 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.710186   431 tablet_replica.cc:333] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.710749   431 raft_consensus.cc:2243] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.711448   431 raft_consensus.cc:2272] T 99c272c78eab4922ab12f736f031d8db P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.714222   431 tablet_replica.cc:333] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.714810   431 raft_consensus.cc:2243] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.715191   431 raft_consensus.cc:2272] T f589853ab39847069098b4c73622f928 P f4190e0173b0466692d09b59af430573 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.717890   431 tablet_replica.cc:333] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.718465   431 raft_consensus.cc:2243] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.718883   431 raft_consensus.cc:2272] T 841df69af28445048305f460e47f68b1 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.722311   431 tablet_replica.cc:333] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.722975   431 raft_consensus.cc:2243] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.723551   431 raft_consensus.cc:2272] T 2650143aa3d2445890518fcc7cc1753c P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.726262   431 tablet_replica.cc:333] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.727166   431 raft_consensus.cc:2243] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.727892   431 raft_consensus.cc:2272] T f4d035bc5ff6447b87cddf20562d73ce P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.731156   431 tablet_replica.cc:333] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.732118   431 raft_consensus.cc:2243] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.733781   431 raft_consensus.cc:2272] T b6011907216b4c0f8b9bd2b6e3b11fc3 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.736688   431 tablet_replica.cc:333] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.737317   431 raft_consensus.cc:2243] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:02:06.737772 11017 consensus_queue.cc:1175] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "11140cca63e141da877ecc4a11a12038" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:02:06.739061   431 raft_consensus.cc:2272] T c55f052034674a66930c284c698f08b4 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.741354   431 tablet_replica.cc:333] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.742255   431 raft_consensus.cc:2243] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.742786   431 raft_consensus.cc:2272] T c5a223eb469244b6ba05201f21382bf9 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.746266   431 tablet_replica.cc:333] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.747202   431 raft_consensus.cc:2243] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.747855   431 raft_consensus.cc:2272] T 33587b7a200e4404ad6430066c4a0159 P f4190e0173b0466692d09b59af430573 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.751264   431 tablet_replica.cc:333] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.752027   431 raft_consensus.cc:2243] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.752748   431 raft_consensus.cc:2272] T 6c74073742bf4c30bbd1b63946306842 P f4190e0173b0466692d09b59af430573 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.756910   431 tablet_replica.cc:333] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.757454   431 raft_consensus.cc:2243] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.758052   431 raft_consensus.cc:2272] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.760268   431 tablet_replica.cc:333] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573: stopping tablet replica
I20260709 13:02:06.760742   431 raft_consensus.cc:2243] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.761636   431 raft_consensus.cc:2272] T a62d89abdc24409182a279c238d12367 P f4190e0173b0466692d09b59af430573 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.813380   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:06.860891 10571 consensus_peers.cc:597] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 -> Peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Couldn't send request to peer f4190e0173b0466692d09b59af430573. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.868948   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:06.908255 10645 consensus_peers.cc:597] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 -> Peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Couldn't send request to peer f4190e0173b0466692d09b59af430573. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:06.911934 10571 consensus_peers.cc:597] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 -> Peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Couldn't send request to peer f4190e0173b0466692d09b59af430573. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:06.923074 10645 consensus_peers.cc:597] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 -> Peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Couldn't send request to peer f4190e0173b0466692d09b59af430573. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.930171   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:02:06.930184 10642 consensus_peers.cc:597] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 -> Peer 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769): Couldn't send request to peer 67171027597c4e919b278b6f103d2b79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.931430   431 tablet_replica.cc:333] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.932518   431 raft_consensus.cc:2243] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.933271   431 raft_consensus.cc:2272] T 3797e38171ab4a56a19737986751d00b P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.936367   431 tablet_replica.cc:333] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.937218   431 raft_consensus.cc:2243] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.938238   431 raft_consensus.cc:2272] T 021a22a9f7b14f42b787f4d2eeb438d7 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.940994   431 tablet_replica.cc:333] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
W20260709 13:02:06.941056 10571 consensus_peers.cc:597] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 -> Peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Couldn't send request to peer f4190e0173b0466692d09b59af430573. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.941740   431 raft_consensus.cc:2243] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.942253   431 raft_consensus.cc:2272] T 7e4155fc9ebc44199a0575c4e7a88dde P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.944458   431 tablet_replica.cc:333] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.945071   431 raft_consensus.cc:2243] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.945524   431 raft_consensus.cc:2272] T fa396dfc31ea40b2979db0bfff6ed1bb P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.947659   431 tablet_replica.cc:333] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.948367   431 raft_consensus.cc:2243] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.949152   431 raft_consensus.cc:2272] T 232cc3870a6f4d4895e643c58203cc46 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.951407   431 tablet_replica.cc:333] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.952064   431 raft_consensus.cc:2243] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.952638   431 raft_consensus.cc:2272] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.955612   431 tablet_replica.cc:333] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.956305   431 raft_consensus.cc:2243] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.957314   431 raft_consensus.cc:2272] T 2650143aa3d2445890518fcc7cc1753c P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:06.957792 10571 consensus_peers.cc:597] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 -> Peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Couldn't send request to peer f4190e0173b0466692d09b59af430573. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.959769   431 tablet_replica.cc:333] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.960439   431 raft_consensus.cc:2243] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.961268   431 raft_consensus.cc:2272] T f4d035bc5ff6447b87cddf20562d73ce P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.963380   431 tablet_replica.cc:333] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.963967   431 raft_consensus.cc:2243] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.964432   431 raft_consensus.cc:2272] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.966457   431 tablet_replica.cc:333] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.966990   431 raft_consensus.cc:2243] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.967423   431 raft_consensus.cc:2272] T c55f052034674a66930c284c698f08b4 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.970078   431 tablet_replica.cc:333] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.970656   431 raft_consensus.cc:2243] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.971479   431 raft_consensus.cc:2272] T 33587b7a200e4404ad6430066c4a0159 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.973938   431 tablet_replica.cc:333] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.974586   431 raft_consensus.cc:2243] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.975167   431 raft_consensus.cc:2272] T 6c74073742bf4c30bbd1b63946306842 P 67171027597c4e919b278b6f103d2b79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.978346   431 tablet_replica.cc:333] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.978986   431 raft_consensus.cc:2243] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.980116   431 raft_consensus.cc:2272] T c5a223eb469244b6ba05201f21382bf9 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.982472   431 tablet_replica.cc:333] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.982995   431 raft_consensus.cc:2243] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.983398   431 raft_consensus.cc:2272] T 99c272c78eab4922ab12f736f031d8db P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.985249   431 tablet_replica.cc:333] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.986095   431 raft_consensus.cc:2243] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.986691   431 raft_consensus.cc:2272] T d537ce7a7c704c82ad0931398f54f5b0 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.989372   431 tablet_replica.cc:333] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.990257   431 raft_consensus.cc:2243] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.990737   431 raft_consensus.cc:2272] T f589853ab39847069098b4c73622f928 P 67171027597c4e919b278b6f103d2b79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.994390   431 tablet_replica.cc:333] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:06.995131   431 raft_consensus.cc:2243] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.996495   431 raft_consensus.cc:2272] T 841df69af28445048305f460e47f68b1 P 67171027597c4e919b278b6f103d2b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.000257   431 tablet_replica.cc:333] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79: stopping tablet replica
I20260709 13:02:07.001302   431 raft_consensus.cc:2243] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.002110   431 raft_consensus.cc:2272] T a62d89abdc24409182a279c238d12367 P 67171027597c4e919b278b6f103d2b79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.050551   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:07.082643 10645 consensus_peers.cc:597] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 -> Peer f4190e0173b0466692d09b59af430573 (127.0.107.193:36167): Couldn't send request to peer f4190e0173b0466692d09b59af430573. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:07.093344   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:07.131953   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:07.132849   431 tablet_replica.cc:333] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.133790   431 raft_consensus.cc:2243] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:07.134717   431 raft_consensus.cc:2272] T 3797e38171ab4a56a19737986751d00b P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.136772   431 tablet_replica.cc:333] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.137359   431 raft_consensus.cc:2243] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.137916   431 raft_consensus.cc:2272] T 021a22a9f7b14f42b787f4d2eeb438d7 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.139928   431 tablet_replica.cc:333] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.140511   431 raft_consensus.cc:2243] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.140995   431 raft_consensus.cc:2272] T 232cc3870a6f4d4895e643c58203cc46 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.142992   431 tablet_replica.cc:333] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.143584   431 raft_consensus.cc:2243] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.144047   431 raft_consensus.cc:2272] T fa396dfc31ea40b2979db0bfff6ed1bb P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.146045   431 tablet_replica.cc:333] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.146620   431 raft_consensus.cc:2243] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:07.147516   431 raft_consensus.cc:2272] T cf0b9cd3d4ed46bdb4c13dd19702fbbd P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.149813   431 tablet_replica.cc:333] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.150375   431 raft_consensus.cc:2243] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.150843   431 raft_consensus.cc:2272] T 7e4155fc9ebc44199a0575c4e7a88dde P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.153177   431 tablet_replica.cc:333] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.153828   431 raft_consensus.cc:2243] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.154314   431 raft_consensus.cc:2272] T f4d035bc5ff6447b87cddf20562d73ce P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.156364   431 tablet_replica.cc:333] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.156917   431 raft_consensus.cc:2243] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.157363   431 raft_consensus.cc:2272] T 2650143aa3d2445890518fcc7cc1753c P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.159905   431 tablet_replica.cc:333] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.160645   431 raft_consensus.cc:2243] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.161135   431 raft_consensus.cc:2272] T 841df69af28445048305f460e47f68b1 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.163473   431 tablet_replica.cc:333] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.164119   431 raft_consensus.cc:2243] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.164821   431 raft_consensus.cc:2272] T 99c272c78eab4922ab12f736f031d8db P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.166987   431 tablet_replica.cc:333] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.168149   431 raft_consensus.cc:2243] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.169059   431 raft_consensus.cc:2272] T d537ce7a7c704c82ad0931398f54f5b0 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.172330   431 tablet_replica.cc:333] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.173032   431 raft_consensus.cc:2243] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:07.174458   431 raft_consensus.cc:2272] T f589853ab39847069098b4c73622f928 P 11140cca63e141da877ecc4a11a12038 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:07.175217 10642 consensus_peers.cc:597] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 -> Peer 67171027597c4e919b278b6f103d2b79 (127.0.107.194:43769): Couldn't send request to peer 67171027597c4e919b278b6f103d2b79. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:07.177394   431 tablet_replica.cc:333] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.178143   431 raft_consensus.cc:2243] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.178648   431 raft_consensus.cc:2272] T 33587b7a200e4404ad6430066c4a0159 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.180693   431 tablet_replica.cc:333] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.181305   431 raft_consensus.cc:2243] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:07.182992   431 raft_consensus.cc:2272] T 6c74073742bf4c30bbd1b63946306842 P 11140cca63e141da877ecc4a11a12038 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.186332   431 tablet_replica.cc:333] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.187135   431 raft_consensus.cc:2243] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.187961   431 raft_consensus.cc:2272] T c5a223eb469244b6ba05201f21382bf9 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.190101   431 tablet_replica.cc:333] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.190891   431 raft_consensus.cc:2243] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.191418   431 raft_consensus.cc:2272] T b6011907216b4c0f8b9bd2b6e3b11fc3 P 11140cca63e141da877ecc4a11a12038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.194532   431 tablet_replica.cc:333] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.195112   431 raft_consensus.cc:2243] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.195569   431 raft_consensus.cc:2272] T c55f052034674a66930c284c698f08b4 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.198566   431 tablet_replica.cc:333] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038: stopping tablet replica
I20260709 13:02:07.199110   431 raft_consensus.cc:2243] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.199589   431 raft_consensus.cc:2272] T a62d89abdc24409182a279c238d12367 P 11140cca63e141da877ecc4a11a12038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.237191   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:07.271274   431 master.cc:562] Master@127.0.107.254:33353 shutting down...
I20260709 13:02:07.294409   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:07.295069   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.295377   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P ad4a4f663e834a519c3a65f3c6c69428: stopping tablet replica
I20260709 13:02:07.317288   431 master.cc:584] Master@127.0.107.254:33353 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (13429 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26530 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (324471 ms total)
[  PASSED  ] 8 tests.
I20260709 13:02:07.395895   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 401 messages since previous log ~527 seconds ago
I20260709 13:02:07.396229   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 401 messages since previous log ~527 seconds ago
I20260709 13:02:07.396445   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 395 messages since previous log ~527 seconds ago
I20260709 13:02:07.396664   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:02:07.396867   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:02:07.397081   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 4 messages since previous log ~165 seconds ago
I20260709 13:02:07.397279   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 4 messages since previous log ~165 seconds ago
I20260709 13:02:07.397742   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~141 seconds ago
I20260709 13:02:07.398041   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:02:07.398350   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 25 messages since previous log ~6 seconds ago
